LLM Hardware Calculator
Can anyone here link me to an LLM hardware sizing calculator? Something that takes in parameters like:
1) Model
2) Quantization
3)T/s
4) Context
5) GPU or CPU inferencing option
and then suggests hardware requirements.
Can anyone here link me to an LLM hardware sizing calculator? Something that takes in parameters like:
1) Model
2) Quantization
3)T/s
4) Context
5) GPU or CPU inferencing option
and then suggests hardware requirements.