Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Hopefully you also bought a switch


they have 2 interfaces each so you typically daisy chain them


That will hurt latency and latency is very important for good tensor-parallelism performance


I think I need one now that I have four - reduce is ring-oriented and still works I believe, but IIRC you only get 200gbps if you use _one_ of two connectx ports.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: