Hourly Usage
Performance Metrics
Avg. Total Time
23.42s
Avg. TTFT
9.04s
Avg. Prefill TPS
434.61
Avg. Gen TPS
19.12
Model Information
Context Size
32768
Quantization
r64
Engine
aphrodite
Creation Method
Merge
Model Type
Llama70B
Chat Template
Llama 3
Reasoning
No
Vision
No
Parameters
70B
Added At
12/23/2024
base_model:
- TheDrummer/Anubis-70B-v1
- Sao10K/L3.3-70B-Euryale-v2.3
- unsloth/Llama-3.3-70B-Instruct
- EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.1 library_name: transformers tags:
- mergekit
- merge
L3.3-MS-Evalebis-70b
Creator: SteelSkull
About Evalebis-70b:
Name Legend:
L3.3 = Llama 3.3
MS = Model Stock
Evalebis = mix of EVA-LLAMA-0.1, EURYALE-v2.3 and Anubis-v1
70B = its 70B
This model was created as I liked the storytelling of EVA, the prose and details of scenes from EURYALE and Anubis, my goal is to merge the robust storytelling of all three models while attempting to maintain the positives of the models.
My recommended Templates / System prompts: (List of Prompt-Gremlins)
LLam@ception <<< Template / System prompt [Made by @.konnect]
DWK-SP0.02 <<< System prompt [Made by @daimonwk]
Quants: (List of badasses) [will add once created]
GGUF Quant:
- bartowski: Combined-GGUF
- mradermacher: GGUF // Imat-GGUF
Config:
MODEL_NAME = "L3.3-MS-Evayale-70B"
base_model: unsloth/Llama-3.3-70B-Instruct
merge_method: model_stock
dtype: bfloat16
models:
- model: EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.1
- model: Sao10K/L3.3-70B-Euryale-v2.3
- model: TheDrummer/Anubis-70B-v1
If you wish to support:
