Hourly Usage
Performance Metrics
Avg. Total Time
59.06s
Avg. TTFT
58.18s
Avg. Prefill TPS
4.08
Avg. Gen TPS
20.31
Model Information
Context Size
32768
Quantization
r64
Engine
aphrodite
Creation Method
Merge
Model Type
Llama70B
Chat Template
Llama 3
Reasoning
No
Vision
No
Parameters
70B
Added At
12/22/2024
base_model:
- EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.0
- unsloth/Llama-3.3-70B-Instruct
- Sao10K/L3.3-70B-Euryale-v2.3 library_name: transformers tags:
- mergekit
- merge
L3.3-MS-Evayale-70B
Creator: SteelSkull
About Evayale-70B:
Name Legend:
L3.3 = Llama 3.3
MS = Model Stock
Evayale = mix of EVA-LLAMA-0.0 and EURYALE-v2.3
70B = its 70B
This model was created as I liked the storytelling of EVA but the prose and details of scenes from EURYALE, my goal is to merge the robust storytelling of both models while attempting to maintain the positives of both models.
My recommended Templates / System prompts: (List of Prompt-Gremlins)
LLam@ception <<< Template / System prompt [Made by @.konnect]
DWK-SP0.02 <<< System prompt [Made by @daimonwk]
Quants: (List of badasses) [will add once created]
GGUF Quant:
- bartowski: Combined-GGUF
- mradermacher: GGUF // Imat-GGUF
Config:
MODEL_NAME = "L3.3-MS-Evayale-70B"
base_model: unsloth/Llama-3.3-70B-Instruct
merge_method: model_stock
dtype: bfloat16
models:
- model: EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.0
- model: Sao10K/L3.3-70B-Euryale-v2.3
If you wish to support:
