Avg. Total Time
23.54s
Avg. TTFT
9.42s
Avg. Prefill TPS
618.93
Avg. Gen TPS
18.47
Context Size
32768
Quantization
r64
Engine
aphrodite
Creation Method
Merge
Model Type
Llama70B
Chat Template
Llama 3
Reasoning
No
Vision
No
Parameters
70B
Added At
8/7/2025
thumbnail: >- https://cdn-uploads.huggingface.co/production/uploads/67c10cfba43d7939d60160ff/xpcplub7ILP-NgrOhnLe9.jpeg language:

Support Mawdistical finetunes here
Thank you fizz for the help on this model.
Support her here →
I have a bag full of shit that doesn't fit together, Just means i'll force it to be!
All Anthrobomination-70B Quants
temperature: 0.6-0.9
Experiment to find your taste.
(Check each model individually for their strong suits.)
License: CC BY-ND 4.0
This release is possible thanks to compute from Shuttleai.com