Avg. Total Time
24.08s
Avg. TTFT
2.77s
Avg. Prefill TPS
443.16
Avg. Gen TPS
20.47
Context Size
32768
Quantization
r64
Engine
aphrodite
Creation Method
Merge
Model Type
Llama70B
Chat Template
Llama 3
Reasoning
No
Vision
No
Parameters
70B
Added At
8/7/2025
thumbnail: >- https://cdn-uploads.huggingface.co/production/uploads/67c10cfba43d7939d60160ff/oXhtnROu1smiQcWpkZgKU.png language:

Support Mawdistical finetunes here
Thank you fizz for the help on this model.
Support her here →
Questions are a burden on others. Answers are a burden upon yourself..
RAWMAW-70B Was made specially for Anthrobomination-70B. Find the collection here
temperature: 0.6-0.9
Experiment to find your taste.
License: CC BY-ND 4.0
This release is possible thanks to compute from Shuttleai.com