Roman Peskov
Cian
Talk
LLM Under Load: How to Measure the Performance of Self-Hosted Models
In Russian
In this talk, I will analyze a practical approach to measuring self-hosted LLM performance.
In this talk, I will analyze a practical approach to measuring self-hosted LLM performance.
Cian