Avg. Total Time
24.90s
Avg. TTFT
4.96s
Avg. Prefill TPS
720.57
Avg. Gen TPS
19.04
Context Size
32768
Quantization
r64
Engine
aphrodite
Creation Method
Merge
Model Type
Llama70B
Chat Template
Llama 3
Reasoning
No
Vision
No
Parameters
70B
Added At
7/5/2025
thumbnail: >- https://cdn-uploads.huggingface.co/production/uploads/67c10cfba43d7939d60160ff/9A2TLWqWt6YyQVjY6jORN.png language:

Support Mawdistical finetunes here
Thank you fizz for the help on this model.
Support her here →
Questions are a burden on others. Answers are a burden upon yourself..
All Predatorial-Extasy-70B Quants
temperature: 0.6-0.9
Experiment to find your taste.
License: CC BY-ND 4.0
This release is possible thanks to compute from Shuttleai.com