Avg. Total Time

53.32s

Avg. TTFT

65.55s

Avg. Prefill TPS

3.71

Avg. Gen TPS

14.91

Context Size

32768

Quantization

r64

Engine

aphrodite

Creation Method

Merge

Model Type

Llama70B

Chat Template

Llama 3

Reasoning

No

Vision

No

Parameters

70B

Added At

3/17/2025