Avg. Total Time

4.90s

Avg. TTFT

4.48s

Avg. Prefill TPS

8.03

Avg. Gen TPS

24.15

Context Size

32768

Quantization

r64

Engine

aphrodite

Creation Method

Merge

Model Type

Llama70B

Chat Template

Llama 3

Reasoning

No

Vision

No

Parameters

70B

Added At

3/17/2025