Hourly Usage
Performance Metrics
Typical Total Time
31.93s
Typical TTFT
8.26s
Typical Input TPS
1566.24
Typical Output TPS
14.05
Model Information
Context Size
262144
Quantization
r128 on INT8
Engine
vllm
Creation Method
Finetune
Model Type
Gemma31B
Chat Template
Gemma4
Reasoning
Yes
Vision
Yes
Parameters
31B
Added At
5/1/2026
No Model Read Me file available.