Hourly Usage
Performance Metrics
Median Total Time
15.58s
Median TTFT
6.44s
Median Prefill TPS
1130.86
Median Gen TPS
33.85
Model Information
Context Size
262144
Quantization
r64 on INT8
Engine
vllm
Creation Method
Finetune
Model Type
Gemma31B
Chat Template
Gemma4
Reasoning
Yes
Vision
Yes
Parameters
31B
Added At
5/1/2026
No Model Read Me file available.