Talk

LLM Under Load: How to Measure the Performance of Self-Hosted Models

In Russian
Presentation pdf

In this talk, I will analyze a practical approach to measuring self-hosted LLM performance.

Speakers

Invited experts

Schedule