Prompt processing
tokens/s
Choose comparisons
Loading…
Models and profiles
Models
Profiles
Chart view
Text generation
tokens/s
Generation throughput
Exact measurements
Selected results
Each point measures a 2,048-token prefill or 128-token generation after the listed starting depth. Values after ± are standard deviations.