Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

This is one reason why price of SSDs also doubled, not just of RAM.

> LMCache extends the KV Cache from the NVIDIA GPU's fast HBM (Tier 1) to larger, more cost-effective tiers like CPU RAM and local SSDs.

https://cloud.google.com/blog/topics/developers-practitioner...



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: