Avg. Total Time
26.15s
Avg. TTFT
9.29s
Avg. Prefill TPS
1223.14
Avg. Gen TPS
17.98
Context Size
32768
Quantization
r64
Engine
aphrodite
Creation Method
Merge
Model Type
Llama70B
Chat Template
Llama 3
Reasoning
No
Vision
No
Parameters
70B
Added At
6/23/2025
No Model Read Me file available.