Q

Qwen3.5-27B-Omnimerge-v2-Derestricted-Lite

RP Chat

No ratings yet(0)
Prose
—(0)
Intelligence
—(0)
Knowledge
—(0)
Instruction Following
—(0)
Coding
—(0)
Steerability
—(0)

Ratings reflect this model as run on Arli AI.

Qwen3.5-27B-Omnimerge-v2-Derestricted-Lite is a text generation model available on Arli AI. It offers 27B parameters, 262K token context, reasoning support, vision input. Recommended use: RP Chat. Run it through the OpenAI-compatible chat completions API with unlimited requests and zero-log privacy.

View on Hugging FaceBack to Models

Hourly Usage

Token Usage

Input (24H)

1M

Output (24H)

8K

Input (7D)

4M

Output (7D)

62K

Performance Metrics

Typical Total Time

6.49s

Typical TTFT

0.94s

Typical Input TPS

953.18

Typical Output TPS

23.40

Model Information

Context Size

262144

Quantization

r64 on INT8

Engine

vllm

Creation Method

Merge

Model Class

Qwen3.5-27B-D - LoRA-DRS-Lite

Chat Template

Qwen3.5

Reasoning

Yes

Vision

Yes

Parameters

27B

Added At

5/2/2026

Use Qwen3.5-27B-Omnimerge-v2-Derestricted-Lite with the Arli AI API

Qwen3.5-27B-Omnimerge-v2-Derestricted-Lite is available through an OpenAI-compatible chat completions endpoint. Point any OpenAI SDK at https://api.arliai.com/v1, pass Qwen3.5-27B-Omnimerge-v2-Derestricted-Lite as the model, and requests are served without logging.

cURL

curl https://api.arliai.com/v1/chat/completions \
  -H "Authorization: Bearer $ARLIAI_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "Qwen3.5-27B-Omnimerge-v2-Derestricted-Lite",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Python

from openai import OpenAI

client = OpenAI(
    base_url="https://api.arliai.com/v1",
    api_key="YOUR_ARLIAI_API_KEY",
)

response = client.chat.completions.create(
    model="Qwen3.5-27B-Omnimerge-v2-Derestricted-Lite",
    messages=[{"role": "user", "content": "Hello!"}],
)
print(response.choices[0].message.content)

See the text generation docs for every parameter, or read the quick start guide to make your first request.


base_model: Qwen/Qwen3.5-27B tags:

  • merge
  • omnimerge-v2
  • qwen3.5
  • reasoning
  • obim
  • darex
  • emr license: apache-2.0

Qwen3.5-27B-Omnimerge-v2

An improved 3-way weight-space merge of Qwen3.5-27B reasoning-distilled fine-tunes using the Omnimerge v2 method — combining four recent advances in model merging.

GGUF quantizations available at ManniX-ITA/Qwen3.5-27B-Omnimerge-v2-GGUF

Benchmark Results (Q6_K)

BenchmarkOmnimerge v1Omnimerge v2Delta
GPQA Diamond (198q, flex)61.11%69.19%+8.08 pp
MBPP pass@171.80%74.60%+2.80 pp
HumanEval pass@179.88%79.27%-0.61 pp

vs Best Source Model (Claude-distill)

BenchmarkClaude-distillOmnimerge v2Delta
GPQA Diamond (198q, flex)53.03%69.19%+16.16 pp
MBPP pass@171.20%74.60%+3.40 pp
HumanEval pass@176.22%79.27%+3.05 pp

Method: Omnimerge v2

Four enhancements over standard DARE-TIES (v1):

  1. OBIM-lite magnitude masking (based on OBIM, arXiv 2502.12217): Deterministic top-k masking by |delta| magnitude instead of random Bernoulli drop. Keeps the most informative parameter changes.

  2. DAREx rescaling (based on DAREx, arXiv 2410.09344, ICLR 2025): Survivors divided by configurable q instead of density. Lower variance than standard DARE rescaling.

  3. EMR election (based on EMR-Merging, arXiv 2405.17461, NeurIPS 2024): Sign from weighted-sum consensus, amplitude from max abs across sources. Each parameter gets the strongest signal from whichever source specialized most.

The merge script also supports GPU-accelerated computation (chunks offloaded to CUDA for ~35x speedup over CPU-only).

Not yet implemented (available in the script for future iterations):

  • Fisher weighting (based on Fisher-Merging, Matena & Raffel 2022): Per-parameter adaptive weighting using diagonal Fisher information. Requires a calibration pre-computation step per source model. Currently uses fixed source weights.

Merge Configuration

python dare_ties_merge.py \
    --base Qwen/Qwen3.5-27B \
    --source Jackrong/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled \
    --source ValiantLabs/Qwen3.5-27B-Esper3.1 \
    --source Jackrong/Qwen3.5-27B-Gemini-3.1-Pro-Reasoning-Distill \
    --method omnimerge_v2 --density 0.53 --weights 0.40,0.35,0.25 \
    --darex-q 0.75 --seed 42

Source Models

SourceWeightFocus
Jackrong/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled0.40Claude 4.6 Opus reasoning distillation
ValiantLabs/Qwen3.5-27B-Esper3.10.35Code / DevOps specialist
Jackrong/Qwen3.5-27B-Gemini-3.1-Pro-Reasoning-Distill0.25Gemini 3.1 Pro reasoning distillation

Base: Qwen/Qwen3.5-27B

Usage

llama.cpp (recommended)

llama-server -m Qwen3.5-27B-Omnimerge-v2-Q6_K.gguf -c 32768 -ngl 99 \
    --reasoning-format deepseek --reasoning-budget 16384 \
    --temp 0.6 --top-p 0.95 --top-k 20 --dry-multiplier 0.5

Transformers

from transformers import AutoModelForCausalLM, AutoTokenizer
import torch

model = AutoModelForCausalLM.from_pretrained(
    "ManniX-ITA/Qwen3.5-27B-Omnimerge-v2",
    torch_dtype=torch.bfloat16,
    device_map="auto",
)
tok = AutoTokenizer.from_pretrained("ManniX-ITA/Qwen3.5-27B-Omnimerge-v2")

Related Models

ModelDescription
Qwen3.5-27B-Omnimergev1 (DARE-TIES baseline)
Qwen3.5-27B-Omnimerge-GGUFv1 GGUF quants
Qwen3.5-27B-Omnimerge-v2-GGUFv2 GGUF quants

License

Apache-2.0