Typical Total Time
31.93s
Typical TTFT
8.26s
Typical Input TPS
1566.24
Typical Output TPS
14.05
Context Size
262144
Quantization
r128 on INT8
Engine
vllm
Creation Method
Finetune
Model Type
Gemma31B
Chat Template
Gemma4
Reasoning
Yes
Vision
Yes
Parameters
31B
Added At
5/1/2026
license: apache-2.0 base_model: google/gemma-4-31B-it pipeline_tag: text-generation datasets:
A finetune primarily focused on improving the prose and writing capabilities of Gemma 4. This does generalize strongly to roleplay and most other creative domains as well.
More / better roleplay data as well as shifting to using more primarily fantasy and sci fi books for training over literary fiction.