Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
MacsHeadroom
on April 20, 2023
|
parent
|
context
|
favorite
| on:
StableLM: A new open-source language model
In 4bit 7B requires 6GB of RAM and runs at ChatGPT speeds on CPU (with llama.cpp).
The 15B model coming out soon will require 12GB of RAM and still run at good speeds on CPU.
Consider applying for YC's Fall 2026 batch!
Applications
are open till July 27.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
The 15B model coming out soon will require 12GB of RAM and still run at good speeds on CPU.