Llama-3.3+(3.1v3.3)-70B-Rombos-LLM-V2.6-Nemotron

Creative Model

View on Hugging FaceBack to Models

Hourly Usage

Performance Metrics

Avg. Total Time

12.64s

Avg. TTFT

8.40s

Avg. Prefill TPS

338.91

Avg. Gen TPS

13.21

Model Information

Context Size

32768

Quantization

r64

Engine

aphrodite

Creation Method

Unknown

Model Type

Llama70B

Chat Template

Llama 3

Reasoning

No

Vision

No

Parameters

70B

Added At

12/22/2024

license: llama3.1

Rombos-LLM-V2.6-Nemotron-70b

image/jpeg

I applied the last step of my continuous finetuning method to the Nemotron-70b model from Nvidia. More details bellow:

Quants: (Coming Soon)

Open-LLM-Leaderboard scores: (Coming soon)