Avg. Total Time
46.46s
Avg. TTFT
11.62s
Avg. Prefill TPS
3286.01
Avg. Gen TPS
11.30
Context Size
32768
Quantization
r64
Engine
aphrodite
Creation Method
Merge
Model Type
Llama70B
Chat Template
Llama 3
Reasoning
No
Vision
No
Parameters
70B
Added At
12/22/2024
base_model:

SAO Good anime.
Merge notes:
This is a merge of pre-trained language models created using mergekit.
Temperature: 1.6
Top A: 0.05
Min P: 0.05
Like Mirai, it doesn't enjoy Repetition Penalty.
This model was merged using the TIES merge method using EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.0 as a base.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
models:
- model: Blackroot/Mirai-70B-1.0
parameters:
density: 0.6
weight: 0.5
- model: EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.0
parameters:
density: 0.4
weight: 0.5
merge_method: ties
base_model: EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.0
parameters:
normalize: true
dtype: bfloat16