Hourly Usage
Performance Metrics
Typical Total Time
7.38s
Typical TTFT
10.38s
Typical Input TPS
803.92
Typical Output TPS
14.67
Model Information
Context Size
262144
Quantization
r128 on INT8
Engine
vllm
Creation Method
Finetune
Model Type
Gemma31B
Chat Template
Gemma4
Reasoning
Yes
Vision
Yes
Parameters
31B
Added At
7/25/2026
No Model Read Me file available.