Avg. Total Time

41.34s

Avg. TTFT

11.84s

Avg. Prefill TPS

3.49

Avg. Gen TPS

17.25

Context Size

32768

Quantization

r64

Engine

aphrodite

Creation Method

Merge

Model Type

Llama70B

Chat Template

Llama 3

Reasoning

No

Vision

No

Parameters

70B

Added At

3/17/2025