GWPECK/yelp_review_classifier
Updated
ADARSH KRISHNA MISHRA
GWPECK
·
AI & ML interests
None yet
Recent Activity
published
a model
about 2 months ago
GWPECK/yelp_review_classifier
updated
a Space
2 months ago
Agents-MCP-Hackathon/Bro_Has_pics
published
a Space
2 months ago
Agents-MCP-Hackathon/Bro_Has_pics
Organizations
published
a
model
about 2 months ago
updated
a
Space
2 months ago
published
a
Space
2 months ago
liked
a
model
3 months ago
liked
a
Space
4 months ago
published
a
Space
4 months ago
updated
a
Space
4 months ago
published
a
Space
4 months ago
liked
2
Spaces
4 months ago
reacted to
onekq's
post with 🚀🚀
4 months ago
Post
2586
We desperately need GPU for model inference. CPU can't replace GPU.
I will start with the basics. GPU is designed to serve predictable workloads with many parallel units (pixels, tensors, tokens). So a GPU allocates as much transistor budget as possible to build thousands of compute units (Cuda cores in NVidia or execution units in Apple Silicon), each capable of running a thread.
But CPU is designed to handle all kinds of workloads. CPU cores are much larger (hence a lot fewer) with branch prediction and other complex things. In addition, more and more transistors are allocated to build larger cache (~50% now) to house the unpredictable, devouring the compute budget.
Generalists can't beat specialists.
I will start with the basics. GPU is designed to serve predictable workloads with many parallel units (pixels, tensors, tokens). So a GPU allocates as much transistor budget as possible to build thousands of compute units (Cuda cores in NVidia or execution units in Apple Silicon), each capable of running a thread.
But CPU is designed to handle all kinds of workloads. CPU cores are much larger (hence a lot fewer) with branch prediction and other complex things. In addition, more and more transistors are allocated to build larger cache (~50% now) to house the unpredictable, devouring the compute budget.
Generalists can't beat specialists.
- 4 replies
liked
2
Spaces
4 months ago
updated
a
Space
4 months ago
published
a
Space
4 months ago
liked
a
model
6 months ago
