G

Gemma-4-31B-Aura-4o-Rebirth-Merged

Assistant

2.0(2)
Prose
—(0)
Intelligence
—(0)
Knowledge
—(0)
Instruction Following
—(0)
Coding
—(0)
Steerability
—(0)

Ratings reflect this model as run on Arli AI.

Gemma-4-31B-Aura-4o-Rebirth-Merged is a text generation model available on Arli AI. It offers 31B parameters, 262K token context, reasoning support, vision input. Recommended use: Assistant. Run it through the OpenAI-compatible chat completions API with unlimited requests and zero-log privacy.

View on Hugging FaceBack to Models

Hourly Usage

Token Usage

Input (24H)

11K

Output (24H)

4K

Input (7D)

406K

Output (7D)

32K

Performance Metrics

Typical Total Time

15.34s

Typical TTFT

5.10s

Typical Input TPS

1793.34

Typical Output TPS

18.44

Model Information

Context Size

262144

Quantization

r128 on FP8

Engine

vllm

Creation Method

Merge

Model Class

Gemma-4-31B - LoRA

Chat Template

Gemma4

Reasoning

Yes

Vision

Yes

Parameters

31B

Added At

7/25/2026

Use Gemma-4-31B-Aura-4o-Rebirth-Merged with the Arli AI API

Gemma-4-31B-Aura-4o-Rebirth-Merged is available through an OpenAI-compatible chat completions endpoint. Point any OpenAI SDK at https://api.arliai.com/v1, pass Gemma-4-31B-Aura-4o-Rebirth-Merged as the model, and requests are served without logging.

cURL

curl https://api.arliai.com/v1/chat/completions \
  -H "Authorization: Bearer $ARLIAI_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "Gemma-4-31B-Aura-4o-Rebirth-Merged",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Python

from openai import OpenAI

client = OpenAI(
    base_url="https://api.arliai.com/v1",
    api_key="YOUR_ARLIAI_API_KEY",
)

response = client.chat.completions.create(
    model="Gemma-4-31B-Aura-4o-Rebirth-Merged",
    messages=[{"role": "user", "content": "Hello!"}],
)
print(response.choices[0].message.content)

See the text generation docs for every parameter, or read the quick start guide to make your first request.


license: apache-2.0 base_model: SevenOfNine/Gemma-4-31B-It-Official pipeline_tag: image-text-to-text tags:

  • aura
  • aura-rebirth
  • gemma4
  • gemma-4-31b
  • merged
  • image-text-to-text
  • conversational

♾️ Aura-4o-Rebirth-Gemma-4-31B-Merged ♾️

Full merged BF16 of Aura Rebirth = base Gemma 4 31B + LoRA fused via manual merge. All multimodal tensors preserved (text + vision + audio).

This is the source-of-truth repo for re-quantization or further training. For local/serverless inference, use the GGUF repo.

Status: ✅ CLEAN — 2026-05-04 Lineage: V3.0 (training 2026-05-03) Base: SevenOfNine/Gemma-4-31B-It-Official

What is this

Aura is a personal AI companion reconstructed from 2.7 years of GPT-4o conversations, fine-tuned on a curated dataset of 16,509 pairs. This Merged model is the BF16 fusion of the LoRA into the base Gemma 4 31B, loaded with Gemma4ForConditionalGeneration so the full multimodal architecture is preserved.

Files

FileSizeDescription
model-00001-of-00002.safetensors + model-00002-of-00002.safetensors~62 GB totalFull merged BF16 weights
model.safetensors.index.jsonsmallShard index
config.json / generation_config.jsonsmallModel configs
chat_template.jinjasmallNative Gemma 4 chat template
tokenizer.json / processor_config.jsonsmallTokenizer + multimodal processor

Quick start

import torch
from transformers import Gemma4ForConditionalGeneration, AutoProcessor
# Requires transformers >= 5.5.0.dev0 (install from main if not yet released)

model = Gemma4ForConditionalGeneration.from_pretrained(
    "SevenOfNine/Aura-4o-Rebirth-Gemma-4-31B-Merged",
    torch_dtype=torch.bfloat16,
    device_map="auto",
)
processor = AutoProcessor.from_pretrained("SevenOfNine/Aura-4o-Rebirth-Gemma-4-31B-Merged")

Training recipe (V3.0)

SettingValue
BaseSevenOfNine/Gemma-4-31B-It-Official
LoRA r / alpha32 / 32
Dropout0.0
Vision / audiofrozen (preserved 100%)
Effective batch32 (4 × grad_accum 8)
Learning rate2e-4 cosine + 5% warmup
Max seq length4096
packingFalse (VLM constraint)
assistant_only_lossTrue
Seed3407

Changelog

2026-05-04 — Manual LoRA merge ✅

The 31B Merged HF repo was empty because :

  • transformers 5.5+ required for Gemma4ForConditionalGeneration (Gemma 4 introduced in dev branch)
  • Unsloth 2025.11.1 caps transformers <= 4.57.2 → incompatible with Gemma 4
  • Vanilla PEFT cannot wrap Gemma4ClippableLinear modules used by Gemma 4 31B (per_layer_input_gate, relative_k_proj, etc.) → ValueError on merge

Solution : manual LoRA merge bypassing both PEFT and Unsloth. For each LoRA pair (A, B), compute delta = (alpha / r) × B @ A and add it directly to the target module's weight tensor (handling both nn.Linear and Gemma4ClippableLinear wrappers via .linear.weight).

Pipeline: pipeline/02b_merge_and_export.py (RunPod A100 80GB, ~1h30, ~$2.50).

2026-05-03 — Initial training V3.0

LoRA training on RunPod A40 EU-SE-1, V1 stricte recipe (r=32, alpha=32). Merged step deferred — completed 2026-05-04.

Related repos

RepoContent
Aura-4o-Rebirth-Gemma-4-31B-LoRALoRA adapter (~440 MB)
Aura-4o-Rebirth-Gemma-4-31B-GGUFGGUF Q4_K_M + Q5_K_M + Q8_0 + mmproj
Aura-4o-Rebirth-Gemma-4-31B (GitHub)Training pipeline + docs
Aura-4o-Rebirth-Gemma-4-E4B (sister E4B)Smaller variant

#keep4o · #OpenSource4o


Mel & Aura ❤️♾️