I have a similar setup but with 32 GB of RAM. Do you partly offload the model to... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

dexterlagan 11 months ago | parent | context | favorite | on: Running GPT-OSS-120B at 500 tokens per second on N...

I have a similar setup but with 32 GB of RAM. Do you partly offload the model to RAM? Do you use LMStudio or other to achieve this? Thanks!

SirMaster 11 months ago [–]

Yes, LMStudio and it automatically does this.

Consider applying for YC's Fall 2026 batch! Applications are open till July 27.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact