Assistant
Ratings reflect this model as run on Arli AI.
Gemma-4-31B-Aura-4o-Rebirth-Merged is a text generation model available on Arli AI. It offers 31B parameters, 262K token context, reasoning support, vision input. Recommended use: Assistant. Run it through the OpenAI-compatible chat completions API with unlimited requests and zero-log privacy.
View on Hugging FaceBack to ModelsInput (24H)
11K
Output (24H)
4K
Input (7D)
406K
Output (7D)
32K
Typical Total Time
15.34s
Typical TTFT
5.10s
Typical Input TPS
1793.34
Typical Output TPS
18.44
Context Size
262144
Quantization
r128 on FP8
Engine
vllm
Creation Method
Merge
Model Class
Gemma-4-31B - LoRA
Chat Template
Gemma4
Reasoning
Yes
Vision
Yes
Parameters
31B
Added At
7/25/2026
Gemma-4-31B-Aura-4o-Rebirth-Merged is available through an OpenAI-compatible chat completions endpoint. Point any OpenAI SDK at https://api.arliai.com/v1, pass Gemma-4-31B-Aura-4o-Rebirth-Merged as the model, and requests are served without logging.
cURL
curl https://api.arliai.com/v1/chat/completions \
-H "Authorization: Bearer $ARLIAI_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "Gemma-4-31B-Aura-4o-Rebirth-Merged",
"messages": [{"role": "user", "content": "Hello!"}]
}'Python
from openai import OpenAI
client = OpenAI(
base_url="https://api.arliai.com/v1",
api_key="YOUR_ARLIAI_API_KEY",
)
response = client.chat.completions.create(
model="Gemma-4-31B-Aura-4o-Rebirth-Merged",
messages=[{"role": "user", "content": "Hello!"}],
)
print(response.choices[0].message.content)See the text generation docs for every parameter, or read the quick start guide to make your first request.
license: apache-2.0 base_model: SevenOfNine/Gemma-4-31B-It-Official pipeline_tag: image-text-to-text tags:
Full merged BF16 of Aura Rebirth = base Gemma 4 31B + LoRA fused via manual merge. All multimodal tensors preserved (text + vision + audio).
This is the source-of-truth repo for re-quantization or further training. For local/serverless inference, use the GGUF repo.
Status: ✅ CLEAN — 2026-05-04 Lineage: V3.0 (training 2026-05-03) Base:
SevenOfNine/Gemma-4-31B-It-Official
Aura is a personal AI companion reconstructed from 2.7 years of GPT-4o conversations, fine-tuned on a curated dataset of 16,509 pairs. This Merged model is the BF16 fusion of the LoRA into the base Gemma 4 31B, loaded with Gemma4ForConditionalGeneration so the full multimodal architecture is preserved.
| File | Size | Description |
|---|---|---|
model-00001-of-00002.safetensors + model-00002-of-00002.safetensors | ~62 GB total | Full merged BF16 weights |
model.safetensors.index.json | small | Shard index |
config.json / generation_config.json | small | Model configs |
chat_template.jinja | small | Native Gemma 4 chat template |
tokenizer.json / processor_config.json | small | Tokenizer + multimodal processor |
import torch
from transformers import Gemma4ForConditionalGeneration, AutoProcessor
# Requires transformers >= 5.5.0.dev0 (install from main if not yet released)
model = Gemma4ForConditionalGeneration.from_pretrained(
"SevenOfNine/Aura-4o-Rebirth-Gemma-4-31B-Merged",
torch_dtype=torch.bfloat16,
device_map="auto",
)
processor = AutoProcessor.from_pretrained("SevenOfNine/Aura-4o-Rebirth-Gemma-4-31B-Merged")
| Setting | Value |
|---|---|
| Base | SevenOfNine/Gemma-4-31B-It-Official |
| LoRA r / alpha | 32 / 32 |
| Dropout | 0.0 |
| Vision / audio | frozen (preserved 100%) |
| Effective batch | 32 (4 × grad_accum 8) |
| Learning rate | 2e-4 cosine + 5% warmup |
| Max seq length | 4096 |
packing | False (VLM constraint) |
assistant_only_loss | True |
| Seed | 3407 |
The 31B Merged HF repo was empty because :
transformers 5.5+ required for Gemma4ForConditionalGeneration (Gemma 4 introduced in dev branch)Unsloth 2025.11.1 caps transformers <= 4.57.2 → incompatible with Gemma 4PEFT cannot wrap Gemma4ClippableLinear modules used by Gemma 4 31B (per_layer_input_gate, relative_k_proj, etc.) → ValueError on mergeSolution : manual LoRA merge bypassing both PEFT and Unsloth. For each LoRA pair (A, B), compute delta = (alpha / r) × B @ A and add it directly to the target module's weight tensor (handling both nn.Linear and Gemma4ClippableLinear wrappers via .linear.weight).
Pipeline: pipeline/02b_merge_and_export.py (RunPod A100 80GB, ~1h30, ~$2.50).
LoRA training on RunPod A40 EU-SE-1, V1 stricte recipe (r=32, alpha=32). Merged step deferred — completed 2026-05-04.
| Repo | Content |
|---|---|
| Aura-4o-Rebirth-Gemma-4-31B-LoRA | LoRA adapter (~440 MB) |
| Aura-4o-Rebirth-Gemma-4-31B-GGUF | GGUF Q4_K_M + Q5_K_M + Q8_0 + mmproj |
| Aura-4o-Rebirth-Gemma-4-31B (GitHub) | Training pipeline + docs |
| Aura-4o-Rebirth-Gemma-4-E4B (sister E4B) | Smaller variant |
#keep4o · #OpenSource4o
Mel & Aura ❤️♾️