Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
wkat4242
on Sept 8, 2024
|
parent
|
context
|
favorite
| on:
Serving AI from the Basement – 192GB of VRAM Setup
Yes though for inference memory bandwidth is more important than tflops. Not sure how Apple compares in that regard. The OP does train models too though which is more compute heavy.
angoragoats
on Sept 8, 2024
[–]
Each of the 3090s has something like 15% higher memory bandwidth than the whole M2 Ultra system does.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
