Hourly Usage
Performance Metrics
Median Total Time
39.43s
Median TTFT
13.19s
Median Prefill TPS
817.77
Median Gen TPS
12.07
Model Information
Context Size
262144
Quantization
r128 on INT8
Engine
vllm
Creation Method
Finetune
Model Type
Gemma31B
Chat Template
Gemma4
Reasoning
Yes
Vision
Yes
Parameters
31B
Added At
5/1/2026
No Model Read Me file available.