Avg. Total Time

10.14s

Avg. TTFT

2.94s

Avg. Prefill TPS

12.25

Avg. Gen TPS

14.63

Context Size

32768

Quantization

r64

Engine

aphrodite

Creation Method

Merge

Model Type

Llama70B

Chat Template

Llama 3

Reasoning

No

Vision

No

Parameters

70B

Added At

3/17/2025