Avg. Total Time
24.38s
Avg. TTFT
6.81s
Avg. Prefill TPS
422.49
Avg. Gen TPS
15.57
Context Size
32768
Quantization
r64
Engine
aphrodite
Creation Method
Merge
Model Type
Llama70B
Chat Template
Llama 3
Reasoning
No
Vision
No
Parameters
70B
Added At
12/22/2024
base_model:
Milasha is my 3rd and final series with Llama 3.1.

L3.1-70b-Milasha is a merge of the following models using LazyMergekit running on a server:
NOTE: Following Sao10k's preferences, this model is licenced as cc-by-nc-4.0
This model kinda returns to tradition of merging the best models. MeowMix was used as language reinforcement for CJK while the rest of the models are more or less from the first in the series.
Llama 3 Instruct.
As I'm writing this, I'm overseas waiting for beef to arrive at my table. I'll probably finish writing this up properly later.
This model uses model stock. The rest just refer to the merge config file.