G

Gemma-4-31B-Garnet

Writing

1.0(1)
Prose
—(0)
Intelligence
—(0)
Knowledge
—(0)
Instruction Following
—(0)
Coding
—(0)
Steerability
—(0)

Ratings reflect this model as run on Arli AI.

Gemma-4-31B-Garnet is a text generation model available on Arli AI. It offers 31B parameters, 262K token context, reasoning support, vision input. Recommended use: Writing. Run it through the OpenAI-compatible chat completions API with unlimited requests and zero-log privacy.

View on Hugging FaceBack to Models

Hourly Usage

Token Usage

Input (24H)

101K

Output (24H)

385

Input (7D)

2M

Output (7D)

5K

Performance Metrics

Typical Total Time

18.18s

Typical TTFT

3.33s

Typical Input TPS

1471.32

Typical Output TPS

15.00

Model Information

Context Size

262144

Quantization

r128 on FP8

Engine

vllm

Creation Method

Finetune

Model Class

Gemma-4-31B - LoRA

Chat Template

Gemma4

Reasoning

Yes

Vision

Yes

Parameters

31B

Added At

5/2/2026

Use Gemma-4-31B-Garnet with the Arli AI API

Gemma-4-31B-Garnet is available through an OpenAI-compatible chat completions endpoint. Point any OpenAI SDK at https://api.arliai.com/v1, pass Gemma-4-31B-Garnet as the model, and requests are served without logging.

cURL

curl https://api.arliai.com/v1/chat/completions \
  -H "Authorization: Bearer $ARLIAI_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "Gemma-4-31B-Garnet",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Python

from openai import OpenAI

client = OpenAI(
    base_url="https://api.arliai.com/v1",
    api_key="YOUR_ARLIAI_API_KEY",
)

response = client.chat.completions.create(
    model="Gemma-4-31B-Garnet",
    messages=[{"role": "user", "content": "Hello!"}],
)
print(response.choices[0].message.content)

See the text generation docs for every parameter, or read the quick start guide to make your first request.


license: apache-2.0 base_model: google/gemma-4-31B-it pipeline_tag: text-generation datasets:

  • ConicCat/Gutenberg-SFT
  • ConicCat/Condor-SFT-Filtered

ConicCat/Gemma4-Garnet-31B

A finetune primarily focused on improving the prose and writing capabilities of Gemma 4. This does generalize strongly to roleplay and most other creative domains as well.

Features:

  • Improved longform writing capabilites; output context extension allows for prompting for up to 4000 words of text in one go.
  • Markedly less AI slop and identifiable Gemini-isms in writing.
  • Improved swipe or output diversity.
  • Fewer 'soft' refusals in writing.

Datasets

  • internlm/Condor-SFT-20K for instruct; even though instruct capabilities are not the primary focus, adding some instruct data helps mitigate forgetting and maintains general intellect and instruction following capabilites.
  • ConicCat/Gutenberg-SFT. A reformatted version of the original Gutenberg DPO dataset by jondurbin for SFT with some slight augmentation to address many of the samples being overly long.
  • A dataset of backtranslated books. Unfortunately, I am unable to release this set as all of the data is under copyright.
  • A dash of a certain third owned archive.