Avg. Total Time
21.05s
Avg. TTFT
4.92s
Avg. Prefill TPS
1819.10
Avg. Gen TPS
20.02
Context Size
32768
Quantization
r64
Engine
aphrodite
Creation Method
LoRA Finetune
Model Type
Llama70B
Chat Template
Llama 3
Reasoning
No
Vision
No
Parameters
70B
Added At
7/2/2025
No Model Read Me file available.