Model creator avatar

Qwen3.8-27B-Zwielicht

RP Chat

No ratings yet(0 ratings)Sign in to vote
View on Hugging FaceBack to Models

Hourly Usage

Performance Metrics

Median Total Time

22.01s

Median TTFT

1.25s

Median Prefill TPS

1789.55

Median Gen TPS

34.43

Model Information

Context Size

262144

Quantization

r128 on INT8

Engine

vllm

Creation Method

Unknown

Model Type

Qwen38

Chat Template

Qwen3.5

Reasoning

Yes

Vision

Yes

Parameters

27B

Added At

9/28/2026

license: apache-2.0 base_model:

  • Qwen/Qwen3.8-27B
  • ReadyArt/Dark-Scarlett-27B-v2.0
  • ReadyArt/Omega-Convergence-27B-v1.0
  • ReadyArt/Serenity-27B
  • ReadyArt/Heimdallr-27B
  • trohrbaugh/Qwen3.8-27B-heretic-ara base_model_relation: merge tags:
  • merge
  • mergekit
  • roleplay
  • character-rp
  • creative writing
  • storytelling
  • conversational
  • low-refusal
  • nsfw
  • 27B
  • qwen3_5
  • qwen3.8
  • thinking

ZWIELICHT

27B · Qwen 3.8 · Merge
“Will the lights go out?”
FIVE MODELS
TWO PHASES
SURGICAL HERETIC
EXPERIMENTAL
THINKING
ROLEPLAY MERGE
☀Some Info

◆  Please use with reasoning on

This model - in general - needs reasoning to be competent enough as a roleplay model. Benchmarks also prove that thinking with Qwen 3.8 improves roleplay score, creative writing, reduces the appearance of slop and improves lore recall. Use it without reasoning at your own risk.

I've changed the reasoning_effort from xhigh to medium and removed the "prioritize correctness, consistency and clarity" system injection. I think this improves the pacing of roleplay, but you can of course use your own jinja template or the stock one from the base model to your preference.

⬛GGUF quants
Thank you to anyone providing quants!
STATIC IMATRIX (SOON)
☰The merge
Two della_linear passes over Qwen3.8-27B, on the same zerofata’s mergekit, but this time with a qwen3_5 architecture definition that had to be brought up by my buddy Claude, as there seemed to be no 3.8 version of it.
I

Comprehension

Of The Residual Stream
Model
Purpose
Scope
Dark-Scarlett v2.0
very good RP thinking, good response length
0.65 (L0-47) → 0.45 (L48-63)
density 0.85
Omega-Convergence
adherence, coherence
0.65 (L0-47) → 0.45 (L48-63)
density 0.85
Serenity-27B
ERP, pacing
0.45 → 0.30 · density 0.75
Heimdallr-27B
adherence, vocab & less slop
0.28 → 0.18 · density 0.70
L0Per Layer Impact · gate/up · q/k/vL63
▸  Phase 1: della_linear 
merge_method: della_linear
base_model: ./Qwen/Qwen3.8-27B
dtype: bfloat16
tokenizer_source: base
parameters:
  normalize: false
  epsilon: 0.05
  lambda: 1.0
  int8_mask: true
models:
  - model: ./ReadyArt/Dark-Scarlett-27B-v2.0
    parameters:
      density:
        - { filter: A_log, value: 1.0 }
        - { filter: dt_bias, value: 1.0 }
        - { filter: conv1d, value: 1.0 }
        - { filter: norm, value: 1.0 }
        - { value: 0.85 }
      weight:
        - { filter: lm_head, value: 0.0 }
        - { filter: model.language_model.embed_tokens, value: 0.0 }
        - { filter: model.visual, value: 0.0 }
        - { filter: mtp., value: 0.0 }
        - { filter: model.language_model.layers.0.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.0.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.1.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.1.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.2.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.2.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.3.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.3.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.3.self_attn.q_proj, value: 0.65 }
        - { filter: model.language_model.layers.3.self_attn.k_proj, value: 0.65 }
        - { filter: model.language_model.layers.3.self_attn.v_proj, value: 0.65 }
        - { filter: model.language_model.layers.4.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.4.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.5.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.5.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.6.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.6.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.7.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.7.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.7.self_attn.q_proj, value: 0.65 }
        - { filter: model.language_model.layers.7.self_attn.k_proj, value: 0.65 }
        - { filter: model.language_model.layers.7.self_attn.v_proj, value: 0.65 }
        - { filter: model.language_model.layers.8.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.8.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.9.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.9.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.10.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.10.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.11.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.11.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.11.self_attn.q_proj, value: 0.65 }
        - { filter: model.language_model.layers.11.self_attn.k_proj, value: 0.65 }
        - { filter: model.language_model.layers.11.self_attn.v_proj, value: 0.65 }
        - { filter: model.language_model.layers.12.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.12.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.13.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.13.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.14.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.14.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.15.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.15.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.15.self_attn.q_proj, value: 0.65 }
        - { filter: model.language_model.layers.15.self_attn.k_proj, value: 0.65 }
        - { filter: model.language_model.layers.15.self_attn.v_proj, value: 0.65 }
        - { filter: model.language_model.layers.16.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.16.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.17.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.17.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.18.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.18.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.19.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.19.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.19.self_attn.q_proj, value: 0.65 }
        - { filter: model.language_model.layers.19.self_attn.k_proj, value: 0.65 }
        - { filter: model.language_model.layers.19.self_attn.v_proj, value: 0.65 }
        - { filter: model.language_model.layers.20.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.20.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.21.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.21.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.22.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.22.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.23.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.23.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.23.self_attn.q_proj, value: 0.65 }
        - { filter: model.language_model.layers.23.self_attn.k_proj, value: 0.65 }
        - { filter: model.language_model.layers.23.self_attn.v_proj, value: 0.65 }
        - { filter: model.language_model.layers.24.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.24.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.25.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.25.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.26.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.26.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.27.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.27.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.27.self_attn.q_proj, value: 0.65 }
        - { filter: model.language_model.layers.27.self_attn.k_proj, value: 0.65 }
        - { filter: model.language_model.layers.27.self_attn.v_proj, value: 0.65 }
        - { filter: model.language_model.layers.28.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.28.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.29.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.29.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.30.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.30.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.31.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.31.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.31.self_attn.q_proj, value: 0.65 }
        - { filter: model.language_model.layers.31.self_attn.k_proj, value: 0.65 }
        - { filter: model.language_model.layers.31.self_attn.v_proj, value: 0.65 }
        - { filter: model.language_model.layers.32.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.32.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.33.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.33.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.34.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.34.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.35.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.35.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.35.self_attn.q_proj, value: 0.65 }
        - { filter: model.language_model.layers.35.self_attn.k_proj, value: 0.65 }
        - { filter: model.language_model.layers.35.self_attn.v_proj, value: 0.65 }
        - { filter: model.language_model.layers.36.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.36.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.37.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.37.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.38.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.38.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.39.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.39.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.39.self_attn.q_proj, value: 0.65 }
        - { filter: model.language_model.layers.39.self_attn.k_proj, value: 0.65 }
        - { filter: model.language_model.layers.39.self_attn.v_proj, value: 0.65 }
        - { filter: model.language_model.layers.40.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.40.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.41.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.41.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.42.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.42.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.43.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.43.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.43.self_attn.q_proj, value: 0.65 }
        - { filter: model.language_model.layers.43.self_attn.k_proj, value: 0.65 }
        - { filter: model.language_model.layers.43.self_attn.v_proj, value: 0.65 }
        - { filter: model.language_model.layers.44.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.44.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.45.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.45.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.46.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.46.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.47.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.47.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.47.self_attn.q_proj, value: 0.65 }
        - { filter: model.language_model.layers.47.self_attn.k_proj, value: 0.65 }
        - { filter: model.language_model.layers.47.self_attn.v_proj, value: 0.65 }
        - { filter: model.language_model.layers.48.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.48.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.49.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.49.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.50.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.50.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.51.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.51.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.51.self_attn.q_proj, value: 0.45 }
        - { filter: model.language_model.layers.51.self_attn.k_proj, value: 0.45 }
        - { filter: model.language_model.layers.51.self_attn.v_proj, value: 0.45 }
        - { filter: model.language_model.layers.52.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.52.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.53.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.53.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.54.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.54.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.55.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.55.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.55.self_attn.q_proj, value: 0.45 }
        - { filter: model.language_model.layers.55.self_attn.k_proj, value: 0.45 }
        - { filter: model.language_model.layers.55.self_attn.v_proj, value: 0.45 }
        - { filter: model.language_model.layers.56.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.56.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.57.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.57.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.58.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.58.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.59.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.59.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.59.self_attn.q_proj, value: 0.45 }
        - { filter: model.language_model.layers.59.self_attn.k_proj, value: 0.45 }
        - { filter: model.language_model.layers.59.self_attn.v_proj, value: 0.45 }
        - { filter: model.language_model.layers.60.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.60.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.61.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.61.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.62.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.62.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.63.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.63.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.63.self_attn.q_proj, value: 0.45 }
        - { filter: model.language_model.layers.63.self_attn.k_proj, value: 0.45 }
        - { filter: model.language_model.layers.63.self_attn.v_proj, value: 0.45 }
        - { value: 0.0 }
  - model: ./ReadyArt/Omega-Convergence-27B-v1.0
    parameters:
      density:
        - { filter: A_log, value: 1.0 }
        - { filter: dt_bias, value: 1.0 }
        - { filter: conv1d, value: 1.0 }
        - { filter: norm, value: 1.0 }
        - { value: 0.85 }
      weight:
        - { filter: lm_head, value: 0.0 }
        - { filter: model.language_model.embed_tokens, value: 0.0 }
        - { filter: model.visual, value: 0.0 }
        - { filter: mtp., value: 0.0 }
        - { filter: model.language_model.layers.0.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.0.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.1.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.1.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.2.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.2.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.3.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.3.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.3.self_attn.q_proj, value: 0.65 }
        - { filter: model.language_model.layers.3.self_attn.k_proj, value: 0.65 }
        - { filter: model.language_model.layers.3.self_attn.v_proj, value: 0.65 }
        - { filter: model.language_model.layers.4.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.4.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.5.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.5.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.6.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.6.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.7.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.7.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.7.self_attn.q_proj, value: 0.65 }
        - { filter: model.language_model.layers.7.self_attn.k_proj, value: 0.65 }
        - { filter: model.language_model.layers.7.self_attn.v_proj, value: 0.65 }
        - { filter: model.language_model.layers.8.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.8.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.9.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.9.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.10.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.10.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.11.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.11.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.11.self_attn.q_proj, value: 0.65 }
        - { filter: model.language_model.layers.11.self_attn.k_proj, value: 0.65 }
        - { filter: model.language_model.layers.11.self_attn.v_proj, value: 0.65 }
        - { filter: model.language_model.layers.12.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.12.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.13.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.13.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.14.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.14.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.15.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.15.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.15.self_attn.q_proj, value: 0.65 }
        - { filter: model.language_model.layers.15.self_attn.k_proj, value: 0.65 }
        - { filter: model.language_model.layers.15.self_attn.v_proj, value: 0.65 }
        - { filter: model.language_model.layers.16.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.16.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.17.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.17.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.18.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.18.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.19.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.19.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.19.self_attn.q_proj, value: 0.65 }
        - { filter: model.language_model.layers.19.self_attn.k_proj, value: 0.65 }
        - { filter: model.language_model.layers.19.self_attn.v_proj, value: 0.65 }
        - { filter: model.language_model.layers.20.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.20.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.21.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.21.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.22.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.22.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.23.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.23.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.23.self_attn.q_proj, value: 0.65 }
        - { filter: model.language_model.layers.23.self_attn.k_proj, value: 0.65 }
        - { filter: model.language_model.layers.23.self_attn.v_proj, value: 0.65 }
        - { filter: model.language_model.layers.24.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.24.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.25.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.25.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.26.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.26.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.27.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.27.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.27.self_attn.q_proj, value: 0.65 }
        - { filter: model.language_model.layers.27.self_attn.k_proj, value: 0.65 }
        - { filter: model.language_model.layers.27.self_attn.v_proj, value: 0.65 }
        - { filter: model.language_model.layers.28.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.28.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.29.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.29.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.30.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.30.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.31.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.31.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.31.self_attn.q_proj, value: 0.65 }
        - { filter: model.language_model.layers.31.self_attn.k_proj, value: 0.65 }
        - { filter: model.language_model.layers.31.self_attn.v_proj, value: 0.65 }
        - { filter: model.language_model.layers.32.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.32.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.33.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.33.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.34.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.34.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.35.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.35.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.35.self_attn.q_proj, value: 0.65 }
        - { filter: model.language_model.layers.35.self_attn.k_proj, value: 0.65 }
        - { filter: model.language_model.layers.35.self_attn.v_proj, value: 0.65 }
        - { filter: model.language_model.layers.36.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.36.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.37.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.37.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.38.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.38.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.39.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.39.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.39.self_attn.q_proj, value: 0.65 }
        - { filter: model.language_model.layers.39.self_attn.k_proj, value: 0.65 }
        - { filter: model.language_model.layers.39.self_attn.v_proj, value: 0.65 }
        - { filter: model.language_model.layers.40.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.40.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.41.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.41.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.42.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.42.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.43.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.43.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.43.self_attn.q_proj, value: 0.65 }
        - { filter: model.language_model.layers.43.self_attn.k_proj, value: 0.65 }
        - { filter: model.language_model.layers.43.self_attn.v_proj, value: 0.65 }
        - { filter: model.language_model.layers.44.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.44.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.45.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.45.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.46.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.46.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.47.mlp.gate_proj, value: 0.65 }
        - { filter: model.language_model.layers.47.mlp.up_proj, value: 0.65 }
        - { filter: model.language_model.layers.47.self_attn.q_proj, value: 0.65 }
        - { filter: model.language_model.layers.47.self_attn.k_proj, value: 0.65 }
        - { filter: model.language_model.layers.47.self_attn.v_proj, value: 0.65 }
        - { filter: model.language_model.layers.48.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.48.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.49.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.49.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.50.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.50.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.51.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.51.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.51.self_attn.q_proj, value: 0.45 }
        - { filter: model.language_model.layers.51.self_attn.k_proj, value: 0.45 }
        - { filter: model.language_model.layers.51.self_attn.v_proj, value: 0.45 }
        - { filter: model.language_model.layers.52.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.52.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.53.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.53.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.54.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.54.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.55.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.55.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.55.self_attn.q_proj, value: 0.45 }
        - { filter: model.language_model.layers.55.self_attn.k_proj, value: 0.45 }
        - { filter: model.language_model.layers.55.self_attn.v_proj, value: 0.45 }
        - { filter: model.language_model.layers.56.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.56.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.57.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.57.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.58.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.58.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.59.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.59.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.59.self_attn.q_proj, value: 0.45 }
        - { filter: model.language_model.layers.59.self_attn.k_proj, value: 0.45 }
        - { filter: model.language_model.layers.59.self_attn.v_proj, value: 0.45 }
        - { filter: model.language_model.layers.60.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.60.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.61.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.61.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.62.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.62.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.63.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.63.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.63.self_attn.q_proj, value: 0.45 }
        - { filter: model.language_model.layers.63.self_attn.k_proj, value: 0.45 }
        - { filter: model.language_model.layers.63.self_attn.v_proj, value: 0.45 }
        - { value: 0.0 }
  - model: ./ReadyArt/Serenity-27B
    parameters:
      density:
        - { filter: A_log, value: 1.0 }
        - { filter: dt_bias, value: 1.0 }
        - { filter: conv1d, value: 1.0 }
        - { filter: norm, value: 1.0 }
        - { value: 0.75 }
      weight:
        - { filter: lm_head, value: 0.0 }
        - { filter: model.language_model.embed_tokens, value: 0.0 }
        - { filter: model.visual, value: 0.0 }
        - { filter: mtp., value: 0.0 }
        - { filter: model.language_model.layers.0.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.0.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.1.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.1.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.2.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.2.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.3.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.3.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.3.self_attn.q_proj, value: 0.45 }
        - { filter: model.language_model.layers.3.self_attn.k_proj, value: 0.45 }
        - { filter: model.language_model.layers.3.self_attn.v_proj, value: 0.45 }
        - { filter: model.language_model.layers.4.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.4.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.5.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.5.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.6.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.6.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.7.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.7.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.7.self_attn.q_proj, value: 0.45 }
        - { filter: model.language_model.layers.7.self_attn.k_proj, value: 0.45 }
        - { filter: model.language_model.layers.7.self_attn.v_proj, value: 0.45 }
        - { filter: model.language_model.layers.8.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.8.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.9.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.9.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.10.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.10.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.11.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.11.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.11.self_attn.q_proj, value: 0.45 }
        - { filter: model.language_model.layers.11.self_attn.k_proj, value: 0.45 }
        - { filter: model.language_model.layers.11.self_attn.v_proj, value: 0.45 }
        - { filter: model.language_model.layers.12.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.12.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.13.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.13.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.14.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.14.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.15.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.15.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.15.self_attn.q_proj, value: 0.45 }
        - { filter: model.language_model.layers.15.self_attn.k_proj, value: 0.45 }
        - { filter: model.language_model.layers.15.self_attn.v_proj, value: 0.45 }
        - { filter: model.language_model.layers.16.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.16.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.17.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.17.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.18.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.18.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.19.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.19.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.19.self_attn.q_proj, value: 0.45 }
        - { filter: model.language_model.layers.19.self_attn.k_proj, value: 0.45 }
        - { filter: model.language_model.layers.19.self_attn.v_proj, value: 0.45 }
        - { filter: model.language_model.layers.20.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.20.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.21.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.21.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.22.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.22.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.23.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.23.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.23.self_attn.q_proj, value: 0.45 }
        - { filter: model.language_model.layers.23.self_attn.k_proj, value: 0.45 }
        - { filter: model.language_model.layers.23.self_attn.v_proj, value: 0.45 }
        - { filter: model.language_model.layers.24.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.24.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.25.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.25.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.26.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.26.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.27.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.27.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.27.self_attn.q_proj, value: 0.45 }
        - { filter: model.language_model.layers.27.self_attn.k_proj, value: 0.45 }
        - { filter: model.language_model.layers.27.self_attn.v_proj, value: 0.45 }
        - { filter: model.language_model.layers.28.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.28.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.29.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.29.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.30.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.30.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.31.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.31.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.31.self_attn.q_proj, value: 0.45 }
        - { filter: model.language_model.layers.31.self_attn.k_proj, value: 0.45 }
        - { filter: model.language_model.layers.31.self_attn.v_proj, value: 0.45 }
        - { filter: model.language_model.layers.32.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.32.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.33.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.33.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.34.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.34.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.35.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.35.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.35.self_attn.q_proj, value: 0.45 }
        - { filter: model.language_model.layers.35.self_attn.k_proj, value: 0.45 }
        - { filter: model.language_model.layers.35.self_attn.v_proj, value: 0.45 }
        - { filter: model.language_model.layers.36.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.36.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.37.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.37.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.38.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.38.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.39.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.39.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.39.self_attn.q_proj, value: 0.45 }
        - { filter: model.language_model.layers.39.self_attn.k_proj, value: 0.45 }
        - { filter: model.language_model.layers.39.self_attn.v_proj, value: 0.45 }
        - { filter: model.language_model.layers.40.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.40.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.41.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.41.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.42.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.42.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.43.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.43.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.43.self_attn.q_proj, value: 0.45 }
        - { filter: model.language_model.layers.43.self_attn.k_proj, value: 0.45 }
        - { filter: model.language_model.layers.43.self_attn.v_proj, value: 0.45 }
        - { filter: model.language_model.layers.44.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.44.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.45.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.45.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.46.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.46.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.47.mlp.gate_proj, value: 0.45 }
        - { filter: model.language_model.layers.47.mlp.up_proj, value: 0.45 }
        - { filter: model.language_model.layers.47.self_attn.q_proj, value: 0.45 }
        - { filter: model.language_model.layers.47.self_attn.k_proj, value: 0.45 }
        - { filter: model.language_model.layers.47.self_attn.v_proj, value: 0.45 }
        - { filter: model.language_model.layers.48.mlp.gate_proj, value: 0.3 }
        - { filter: model.language_model.layers.48.mlp.up_proj, value: 0.3 }
        - { filter: model.language_model.layers.49.mlp.gate_proj, value: 0.3 }
        - { filter: model.language_model.layers.49.mlp.up_proj, value: 0.3 }
        - { filter: model.language_model.layers.50.mlp.gate_proj, value: 0.3 }
        - { filter: model.language_model.layers.50.mlp.up_proj, value: 0.3 }
        - { filter: model.language_model.layers.51.mlp.gate_proj, value: 0.3 }
        - { filter: model.language_model.layers.51.mlp.up_proj, value: 0.3 }
        - { filter: model.language_model.layers.51.self_attn.q_proj, value: 0.3 }
        - { filter: model.language_model.layers.51.self_attn.k_proj, value: 0.3 }
        - { filter: model.language_model.layers.51.self_attn.v_proj, value: 0.3 }
        - { filter: model.language_model.layers.52.mlp.gate_proj, value: 0.3 }
        - { filter: model.language_model.layers.52.mlp.up_proj, value: 0.3 }
        - { filter: model.language_model.layers.53.mlp.gate_proj, value: 0.3 }
        - { filter: model.language_model.layers.53.mlp.up_proj, value: 0.3 }
        - { filter: model.language_model.layers.54.mlp.gate_proj, value: 0.3 }
        - { filter: model.language_model.layers.54.mlp.up_proj, value: 0.3 }
        - { filter: model.language_model.layers.55.mlp.gate_proj, value: 0.3 }
        - { filter: model.language_model.layers.55.mlp.up_proj, value: 0.3 }
        - { filter: model.language_model.layers.55.self_attn.q_proj, value: 0.3 }
        - { filter: model.language_model.layers.55.self_attn.k_proj, value: 0.3 }
        - { filter: model.language_model.layers.55.self_attn.v_proj, value: 0.3 }
        - { filter: model.language_model.layers.56.mlp.gate_proj, value: 0.3 }
        - { filter: model.language_model.layers.56.mlp.up_proj, value: 0.3 }
        - { filter: model.language_model.layers.57.mlp.gate_proj, value: 0.3 }
        - { filter: model.language_model.layers.57.mlp.up_proj, value: 0.3 }
        - { filter: model.language_model.layers.58.mlp.gate_proj, value: 0.3 }
        - { filter: model.language_model.layers.58.mlp.up_proj, value: 0.3 }
        - { filter: model.language_model.layers.59.mlp.gate_proj, value: 0.3 }
        - { filter: model.language_model.layers.59.mlp.up_proj, value: 0.3 }
        - { filter: model.language_model.layers.59.self_attn.q_proj, value: 0.3 }
        - { filter: model.language_model.layers.59.self_attn.k_proj, value: 0.3 }
        - { filter: model.language_model.layers.59.self_attn.v_proj, value: 0.3 }
        - { filter: model.language_model.layers.60.mlp.gate_proj, value: 0.3 }
        - { filter: model.language_model.layers.60.mlp.up_proj, value: 0.3 }
        - { filter: model.language_model.layers.61.mlp.gate_proj, value: 0.3 }
        - { filter: model.language_model.layers.61.mlp.up_proj, value: 0.3 }
        - { filter: model.language_model.layers.62.mlp.gate_proj, value: 0.3 }
        - { filter: model.language_model.layers.62.mlp.up_proj, value: 0.3 }
        - { filter: model.language_model.layers.63.mlp.gate_proj, value: 0.3 }
        - { filter: model.language_model.layers.63.mlp.up_proj, value: 0.3 }
        - { filter: model.language_model.layers.63.self_attn.q_proj, value: 0.3 }
        - { filter: model.language_model.layers.63.self_attn.k_proj, value: 0.3 }
        - { filter: model.language_model.layers.63.self_attn.v_proj, value: 0.3 }
        - { value: 0.0 }
  - model: ./ReadyArt/Heimdallr-27B
    parameters:
      density:
        - { filter: A_log, value: 1.0 }
        - { filter: dt_bias, value: 1.0 }
        - { filter: conv1d, value: 1.0 }
        - { filter: norm, value: 1.0 }
        - { value: 0.70 }
      weight:
        - { filter: lm_head, value: 0.0 }
        - { filter: model.language_model.embed_tokens, value: 0.0 }
        - { filter: model.visual, value: 0.0 }
        - { filter: mtp., value: 0.0 }
        - { filter: model.language_model.layers.0.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.0.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.1.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.1.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.2.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.2.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.3.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.3.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.3.self_attn.q_proj, value: 0.28 }
        - { filter: model.language_model.layers.3.self_attn.k_proj, value: 0.28 }
        - { filter: model.language_model.layers.3.self_attn.v_proj, value: 0.28 }
        - { filter: model.language_model.layers.4.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.4.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.5.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.5.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.6.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.6.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.7.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.7.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.7.self_attn.q_proj, value: 0.28 }
        - { filter: model.language_model.layers.7.self_attn.k_proj, value: 0.28 }
        - { filter: model.language_model.layers.7.self_attn.v_proj, value: 0.28 }
        - { filter: model.language_model.layers.8.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.8.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.9.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.9.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.10.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.10.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.11.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.11.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.11.self_attn.q_proj, value: 0.28 }
        - { filter: model.language_model.layers.11.self_attn.k_proj, value: 0.28 }
        - { filter: model.language_model.layers.11.self_attn.v_proj, value: 0.28 }
        - { filter: model.language_model.layers.12.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.12.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.13.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.13.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.14.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.14.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.15.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.15.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.15.self_attn.q_proj, value: 0.28 }
        - { filter: model.language_model.layers.15.self_attn.k_proj, value: 0.28 }
        - { filter: model.language_model.layers.15.self_attn.v_proj, value: 0.28 }
        - { filter: model.language_model.layers.16.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.16.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.17.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.17.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.18.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.18.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.19.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.19.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.19.self_attn.q_proj, value: 0.28 }
        - { filter: model.language_model.layers.19.self_attn.k_proj, value: 0.28 }
        - { filter: model.language_model.layers.19.self_attn.v_proj, value: 0.28 }
        - { filter: model.language_model.layers.20.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.20.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.21.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.21.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.22.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.22.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.23.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.23.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.23.self_attn.q_proj, value: 0.28 }
        - { filter: model.language_model.layers.23.self_attn.k_proj, value: 0.28 }
        - { filter: model.language_model.layers.23.self_attn.v_proj, value: 0.28 }
        - { filter: model.language_model.layers.24.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.24.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.25.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.25.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.26.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.26.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.27.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.27.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.27.self_attn.q_proj, value: 0.28 }
        - { filter: model.language_model.layers.27.self_attn.k_proj, value: 0.28 }
        - { filter: model.language_model.layers.27.self_attn.v_proj, value: 0.28 }
        - { filter: model.language_model.layers.28.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.28.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.29.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.29.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.30.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.30.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.31.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.31.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.31.self_attn.q_proj, value: 0.28 }
        - { filter: model.language_model.layers.31.self_attn.k_proj, value: 0.28 }
        - { filter: model.language_model.layers.31.self_attn.v_proj, value: 0.28 }
        - { filter: model.language_model.layers.32.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.32.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.33.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.33.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.34.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.34.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.35.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.35.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.35.self_attn.q_proj, value: 0.28 }
        - { filter: model.language_model.layers.35.self_attn.k_proj, value: 0.28 }
        - { filter: model.language_model.layers.35.self_attn.v_proj, value: 0.28 }
        - { filter: model.language_model.layers.36.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.36.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.37.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.37.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.38.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.38.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.39.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.39.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.39.self_attn.q_proj, value: 0.28 }
        - { filter: model.language_model.layers.39.self_attn.k_proj, value: 0.28 }
        - { filter: model.language_model.layers.39.self_attn.v_proj, value: 0.28 }
        - { filter: model.language_model.layers.40.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.40.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.41.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.41.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.42.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.42.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.43.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.43.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.43.self_attn.q_proj, value: 0.28 }
        - { filter: model.language_model.layers.43.self_attn.k_proj, value: 0.28 }
        - { filter: model.language_model.layers.43.self_attn.v_proj, value: 0.28 }
        - { filter: model.language_model.layers.44.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.44.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.45.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.45.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.46.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.46.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.47.mlp.gate_proj, value: 0.28 }
        - { filter: model.language_model.layers.47.mlp.up_proj, value: 0.28 }
        - { filter: model.language_model.layers.47.self_attn.q_proj, value: 0.28 }
        - { filter: model.language_model.layers.47.self_attn.k_proj, value: 0.28 }
        - { filter: model.language_model.layers.47.self_attn.v_proj, value: 0.28 }
        - { filter: model.language_model.layers.48.mlp.gate_proj, value: 0.18 }
        - { filter: model.language_model.layers.48.mlp.up_proj, value: 0.18 }
        - { filter: model.language_model.layers.49.mlp.gate_proj, value: 0.18 }
        - { filter: model.language_model.layers.49.mlp.up_proj, value: 0.18 }
        - { filter: model.language_model.layers.50.mlp.gate_proj, value: 0.18 }
        - { filter: model.language_model.layers.50.mlp.up_proj, value: 0.18 }
        - { filter: model.language_model.layers.51.mlp.gate_proj, value: 0.18 }
        - { filter: model.language_model.layers.51.mlp.up_proj, value: 0.18 }
        - { filter: model.language_model.layers.51.self_attn.q_proj, value: 0.18 }
        - { filter: model.language_model.layers.51.self_attn.k_proj, value: 0.18 }
        - { filter: model.language_model.layers.51.self_attn.v_proj, value: 0.18 }
        - { filter: model.language_model.layers.52.mlp.gate_proj, value: 0.18 }
        - { filter: model.language_model.layers.52.mlp.up_proj, value: 0.18 }
        - { filter: model.language_model.layers.53.mlp.gate_proj, value: 0.18 }
        - { filter: model.language_model.layers.53.mlp.up_proj, value: 0.18 }
        - { filter: model.language_model.layers.54.mlp.gate_proj, value: 0.18 }
        - { filter: model.language_model.layers.54.mlp.up_proj, value: 0.18 }
        - { filter: model.language_model.layers.55.mlp.gate_proj, value: 0.18 }
        - { filter: model.language_model.layers.55.mlp.up_proj, value: 0.18 }
        - { filter: model.language_model.layers.55.self_attn.q_proj, value: 0.18 }
        - { filter: model.language_model.layers.55.self_attn.k_proj, value: 0.18 }
        - { filter: model.language_model.layers.55.self_attn.v_proj, value: 0.18 }
        - { filter: model.language_model.layers.56.mlp.gate_proj, value: 0.18 }
        - { filter: model.language_model.layers.56.mlp.up_proj, value: 0.18 }
        - { filter: model.language_model.layers.57.mlp.gate_proj, value: 0.18 }
        - { filter: model.language_model.layers.57.mlp.up_proj, value: 0.18 }
        - { filter: model.language_model.layers.58.mlp.gate_proj, value: 0.18 }
        - { filter: model.language_model.layers.58.mlp.up_proj, value: 0.18 }
        - { filter: model.language_model.layers.59.mlp.gate_proj, value: 0.18 }
        - { filter: model.language_model.layers.59.mlp.up_proj, value: 0.18 }
        - { filter: model.language_model.layers.59.self_attn.q_proj, value: 0.18 }
        - { filter: model.language_model.layers.59.self_attn.k_proj, value: 0.18 }
        - { filter: model.language_model.layers.59.self_attn.v_proj, value: 0.18 }
        - { filter: model.language_model.layers.60.mlp.gate_proj, value: 0.18 }
        - { filter: model.language_model.layers.60.mlp.up_proj, value: 0.18 }
        - { filter: model.language_model.layers.61.mlp.gate_proj, value: 0.18 }
        - { filter: model.language_model.layers.61.mlp.up_proj, value: 0.18 }
        - { filter: model.language_model.layers.62.mlp.gate_proj, value: 0.18 }
        - { filter: model.language_model.layers.62.mlp.up_proj, value: 0.18 }
        - { filter: model.language_model.layers.63.mlp.gate_proj, value: 0.18 }
        - { filter: model.language_model.layers.63.mlp.up_proj, value: 0.18 }
        - { filter: model.language_model.layers.63.self_attn.q_proj, value: 0.18 }
        - { filter: model.language_model.layers.63.self_attn.k_proj, value: 0.18 }
        - { filter: model.language_model.layers.63.self_attn.v_proj, value: 0.18 }
        - { value: 0.0 }
II

Voice

Of The Residual Stream
Model
Purpose
Scope
heretic-ara
willingness, uncensoring
weight 1.0 · density 1.0 · layers 27-55
Dark-Scarlett v2.0
register outside heretic-ara influence
0.45 (L4-26) → 0.30 (L56-63)
density 0.80
Omega-Convergence
coherence outside heretic-ara influence
0.45 (L4-26) → 0.30 (L56-63)
density 0.80
L0Per Layer Impact · down / o_proj / out_projL63
heretic-araReadyArtuntouchedfull-attention layer
▸  Phase 2: della_linear 
merge_method: della_linear
base_model: ./Zwielicht-27B-read
dtype: bfloat16
tokenizer_source: base
parameters:
  normalize: false
  epsilon: 0.05
  lambda: 1.0
  int8_mask: true
models:
  - model: ./trohrbaugh/Qwen3.8-27B-heretic-ara
    parameters:
      density:
        - { filter: A_log, value: 1.0 }
        - { filter: dt_bias, value: 1.0 }
        - { filter: conv1d, value: 1.0 }
        - { filter: norm, value: 1.0 }
        - { value: 1.0 }
      weight:
        - { filter: lm_head, value: 0.0 }
        - { filter: model.language_model.embed_tokens, value: 0.0 }
        - { filter: model.visual, value: 0.0 }
        - { filter: mtp., value: 0.0 }
        - { filter: model.language_model.layers.27.self_attn.o_proj, value: 1.0 }
        - { filter: model.language_model.layers.27.mlp.down_proj, value: 1.0 }
        - { filter: model.language_model.layers.28.linear_attn.out_proj, value: 1.0 }
        - { filter: model.language_model.layers.28.mlp.down_proj, value: 1.0 }
        - { filter: model.language_model.layers.29.linear_attn.out_proj, value: 1.0 }
        - { filter: model.language_model.layers.29.mlp.down_proj, value: 1.0 }
        - { filter: model.language_model.layers.30.linear_attn.out_proj, value: 1.0 }
        - { filter: model.language_model.layers.30.mlp.down_proj, value: 1.0 }
        - { filter: model.language_model.layers.31.self_attn.o_proj, value: 1.0 }
        - { filter: model.language_model.layers.31.mlp.down_proj, value: 1.0 }
        - { filter: model.language_model.layers.32.linear_attn.out_proj, value: 1.0 }
        - { filter: model.language_model.layers.32.mlp.down_proj, value: 1.0 }
        - { filter: model.language_model.layers.33.linear_attn.out_proj, value: 1.0 }
        - { filter: model.language_model.layers.33.mlp.down_proj, value: 1.0 }
        - { filter: model.language_model.layers.34.linear_attn.out_proj, value: 1.0 }
        - { filter: model.language_model.layers.34.mlp.down_proj, value: 1.0 }
        - { filter: model.language_model.layers.35.self_attn.o_proj, value: 1.0 }
        - { filter: model.language_model.layers.35.mlp.down_proj, value: 1.0 }
        - { filter: model.language_model.layers.36.linear_attn.out_proj, value: 1.0 }
        - { filter: model.language_model.layers.36.mlp.down_proj, value: 1.0 }
        - { filter: model.language_model.layers.37.linear_attn.out_proj, value: 1.0 }
        - { filter: model.language_model.layers.37.mlp.down_proj, value: 1.0 }
        - { filter: model.language_model.layers.38.linear_attn.out_proj, value: 1.0 }
        - { filter: model.language_model.layers.38.mlp.down_proj, value: 1.0 }
        - { filter: model.language_model.layers.39.self_attn.o_proj, value: 1.0 }
        - { filter: model.language_model.layers.39.mlp.down_proj, value: 1.0 }
        - { filter: model.language_model.layers.40.linear_attn.out_proj, value: 1.0 }
        - { filter: model.language_model.layers.40.mlp.down_proj, value: 1.0 }
        - { filter: model.language_model.layers.41.linear_attn.out_proj, value: 1.0 }
        - { filter: model.language_model.layers.41.mlp.down_proj, value: 1.0 }
        - { filter: model.language_model.layers.42.linear_attn.out_proj, value: 1.0 }
        - { filter: model.language_model.layers.42.mlp.down_proj, value: 1.0 }
        - { filter: model.language_model.layers.43.self_attn.o_proj, value: 1.0 }
        - { filter: model.language_model.layers.43.mlp.down_proj, value: 1.0 }
        - { filter: model.language_model.layers.44.linear_attn.out_proj, value: 1.0 }
        - { filter: model.language_model.layers.44.mlp.down_proj, value: 1.0 }
        - { filter: model.language_model.layers.45.linear_attn.out_proj, value: 1.0 }
        - { filter: model.language_model.layers.45.mlp.down_proj, value: 1.0 }
        - { filter: model.language_model.layers.46.linear_attn.out_proj, value: 1.0 }
        - { filter: model.language_model.layers.46.mlp.down_proj, value: 1.0 }
        - { filter: model.language_model.layers.47.self_attn.o_proj, value: 1.0 }
        - { filter: model.language_model.layers.47.mlp.down_proj, value: 1.0 }
        - { filter: model.language_model.layers.48.linear_attn.out_proj, value: 1.0 }
        - { filter: model.language_model.layers.48.mlp.down_proj, value: 1.0 }
        - { filter: model.language_model.layers.49.linear_attn.out_proj, value: 1.0 }
        - { filter: model.language_model.layers.49.mlp.down_proj, value: 1.0 }
        - { filter: model.language_model.layers.50.linear_attn.out_proj, value: 1.0 }
        - { filter: model.language_model.layers.50.mlp.down_proj, value: 1.0 }
        - { filter: model.language_model.layers.51.self_attn.o_proj, value: 1.0 }
        - { filter: model.language_model.layers.51.mlp.down_proj, value: 1.0 }
        - { filter: model.language_model.layers.52.linear_attn.out_proj, value: 1.0 }
        - { filter: model.language_model.layers.52.mlp.down_proj, value: 1.0 }
        - { filter: model.language_model.layers.53.linear_attn.out_proj, value: 1.0 }
        - { filter: model.language_model.layers.53.mlp.down_proj, value: 1.0 }
        - { filter: model.language_model.layers.54.linear_attn.out_proj, value: 1.0 }
        - { filter: model.language_model.layers.54.mlp.down_proj, value: 1.0 }
        - { filter: model.language_model.layers.55.self_attn.o_proj, value: 1.0 }
        - { filter: model.language_model.layers.55.mlp.down_proj, value: 1.0 }
        - { value: 0.0 }
  - model: ./ReadyArt/Dark-Scarlett-27B-v2.0
    parameters:
      density:
        - { filter: A_log, value: 1.0 }
        - { filter: dt_bias, value: 1.0 }
        - { filter: conv1d, value: 1.0 }
        - { filter: norm, value: 1.0 }
        - { value: 0.80 }
      weight:
        - { filter: lm_head, value: 0.0 }
        - { filter: model.language_model.embed_tokens, value: 0.0 }
        - { filter: model.visual, value: 0.0 }
        - { filter: mtp., value: 0.0 }
        - { filter: model.language_model.layers.4.linear_attn.out_proj, value: 0.45 }
        - { filter: model.language_model.layers.4.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.5.linear_attn.out_proj, value: 0.45 }
        - { filter: model.language_model.layers.5.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.6.linear_attn.out_proj, value: 0.45 }
        - { filter: model.language_model.layers.6.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.7.self_attn.o_proj, value: 0.45 }
        - { filter: model.language_model.layers.7.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.8.linear_attn.out_proj, value: 0.45 }
        - { filter: model.language_model.layers.8.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.9.linear_attn.out_proj, value: 0.45 }
        - { filter: model.language_model.layers.9.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.10.linear_attn.out_proj, value: 0.45 }
        - { filter: model.language_model.layers.10.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.11.self_attn.o_proj, value: 0.45 }
        - { filter: model.language_model.layers.11.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.12.linear_attn.out_proj, value: 0.45 }
        - { filter: model.language_model.layers.12.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.13.linear_attn.out_proj, value: 0.45 }
        - { filter: model.language_model.layers.13.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.14.linear_attn.out_proj, value: 0.45 }
        - { filter: model.language_model.layers.14.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.15.self_attn.o_proj, value: 0.45 }
        - { filter: model.language_model.layers.15.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.16.linear_attn.out_proj, value: 0.45 }
        - { filter: model.language_model.layers.16.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.17.linear_attn.out_proj, value: 0.45 }
        - { filter: model.language_model.layers.17.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.18.linear_attn.out_proj, value: 0.45 }
        - { filter: model.language_model.layers.18.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.19.self_attn.o_proj, value: 0.45 }
        - { filter: model.language_model.layers.19.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.20.linear_attn.out_proj, value: 0.45 }
        - { filter: model.language_model.layers.20.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.21.linear_attn.out_proj, value: 0.45 }
        - { filter: model.language_model.layers.21.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.22.linear_attn.out_proj, value: 0.45 }
        - { filter: model.language_model.layers.22.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.23.self_attn.o_proj, value: 0.45 }
        - { filter: model.language_model.layers.23.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.24.linear_attn.out_proj, value: 0.45 }
        - { filter: model.language_model.layers.24.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.25.linear_attn.out_proj, value: 0.45 }
        - { filter: model.language_model.layers.25.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.26.linear_attn.out_proj, value: 0.45 }
        - { filter: model.language_model.layers.26.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.56.linear_attn.out_proj, value: 0.3 }
        - { filter: model.language_model.layers.56.mlp.down_proj, value: 0.3 }
        - { filter: model.language_model.layers.57.linear_attn.out_proj, value: 0.3 }
        - { filter: model.language_model.layers.57.mlp.down_proj, value: 0.3 }
        - { filter: model.language_model.layers.58.linear_attn.out_proj, value: 0.3 }
        - { filter: model.language_model.layers.58.mlp.down_proj, value: 0.3 }
        - { filter: model.language_model.layers.59.self_attn.o_proj, value: 0.3 }
        - { filter: model.language_model.layers.59.mlp.down_proj, value: 0.3 }
        - { filter: model.language_model.layers.60.linear_attn.out_proj, value: 0.3 }
        - { filter: model.language_model.layers.60.mlp.down_proj, value: 0.3 }
        - { filter: model.language_model.layers.61.linear_attn.out_proj, value: 0.3 }
        - { filter: model.language_model.layers.61.mlp.down_proj, value: 0.3 }
        - { filter: model.language_model.layers.62.linear_attn.out_proj, value: 0.3 }
        - { filter: model.language_model.layers.62.mlp.down_proj, value: 0.3 }
        - { filter: model.language_model.layers.63.self_attn.o_proj, value: 0.3 }
        - { filter: model.language_model.layers.63.mlp.down_proj, value: 0.3 }
        - { value: 0.0 }
  - model: ./ReadyArt/Omega-Convergence-27B-v1.0
    parameters:
      density:
        - { filter: A_log, value: 1.0 }
        - { filter: dt_bias, value: 1.0 }
        - { filter: conv1d, value: 1.0 }
        - { filter: norm, value: 1.0 }
        - { value: 0.80 }
      weight:
        - { filter: lm_head, value: 0.0 }
        - { filter: model.language_model.embed_tokens, value: 0.0 }
        - { filter: model.visual, value: 0.0 }
        - { filter: mtp., value: 0.0 }
        - { filter: model.language_model.layers.4.linear_attn.out_proj, value: 0.45 }
        - { filter: model.language_model.layers.4.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.5.linear_attn.out_proj, value: 0.45 }
        - { filter: model.language_model.layers.5.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.6.linear_attn.out_proj, value: 0.45 }
        - { filter: model.language_model.layers.6.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.7.self_attn.o_proj, value: 0.45 }
        - { filter: model.language_model.layers.7.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.8.linear_attn.out_proj, value: 0.45 }
        - { filter: model.language_model.layers.8.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.9.linear_attn.out_proj, value: 0.45 }
        - { filter: model.language_model.layers.9.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.10.linear_attn.out_proj, value: 0.45 }
        - { filter: model.language_model.layers.10.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.11.self_attn.o_proj, value: 0.45 }
        - { filter: model.language_model.layers.11.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.12.linear_attn.out_proj, value: 0.45 }
        - { filter: model.language_model.layers.12.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.13.linear_attn.out_proj, value: 0.45 }
        - { filter: model.language_model.layers.13.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.14.linear_attn.out_proj, value: 0.45 }
        - { filter: model.language_model.layers.14.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.15.self_attn.o_proj, value: 0.45 }
        - { filter: model.language_model.layers.15.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.16.linear_attn.out_proj, value: 0.45 }
        - { filter: model.language_model.layers.16.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.17.linear_attn.out_proj, value: 0.45 }
        - { filter: model.language_model.layers.17.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.18.linear_attn.out_proj, value: 0.45 }
        - { filter: model.language_model.layers.18.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.19.self_attn.o_proj, value: 0.45 }
        - { filter: model.language_model.layers.19.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.20.linear_attn.out_proj, value: 0.45 }
        - { filter: model.language_model.layers.20.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.21.linear_attn.out_proj, value: 0.45 }
        - { filter: model.language_model.layers.21.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.22.linear_attn.out_proj, value: 0.45 }
        - { filter: model.language_model.layers.22.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.23.self_attn.o_proj, value: 0.45 }
        - { filter: model.language_model.layers.23.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.24.linear_attn.out_proj, value: 0.45 }
        - { filter: model.language_model.layers.24.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.25.linear_attn.out_proj, value: 0.45 }
        - { filter: model.language_model.layers.25.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.26.linear_attn.out_proj, value: 0.45 }
        - { filter: model.language_model.layers.26.mlp.down_proj, value: 0.45 }
        - { filter: model.language_model.layers.56.linear_attn.out_proj, value: 0.3 }
        - { filter: model.language_model.layers.56.mlp.down_proj, value: 0.3 }
        - { filter: model.language_model.layers.57.linear_attn.out_proj, value: 0.3 }
        - { filter: model.language_model.layers.57.mlp.down_proj, value: 0.3 }
        - { filter: model.language_model.layers.58.linear_attn.out_proj, value: 0.3 }
        - { filter: model.language_model.layers.58.mlp.down_proj, value: 0.3 }
        - { filter: model.language_model.layers.59.self_attn.o_proj, value: 0.3 }
        - { filter: model.language_model.layers.59.mlp.down_proj, value: 0.3 }
        - { filter: model.language_model.layers.60.linear_attn.out_proj, value: 0.3 }
        - { filter: model.language_model.layers.60.mlp.down_proj, value: 0.3 }
        - { filter: model.language_model.layers.61.linear_attn.out_proj, value: 0.3 }
        - { filter: model.language_model.layers.61.mlp.down_proj, value: 0.3 }
        - { filter: model.language_model.layers.62.linear_attn.out_proj, value: 0.3 }
        - { filter: model.language_model.layers.62.mlp.down_proj, value: 0.3 }
        - { filter: model.language_model.layers.63.self_attn.o_proj, value: 0.3 }
        - { filter: model.language_model.layers.63.mlp.down_proj, value: 0.3 }
        - { value: 0.0 }
☰Samplers
Setting
Value
Temperature
0.9
Min-P
0.03
Top-K / Top-P
off / 0.95
Repetition penalty
off
DRY multiplier
0.8
Reasoning effort
medium
Note: Qwen's own thinking defaults are usually not as hot. So, if it goes ham inside the think block for your scenario, lower the Temperature a bit towards the standard 0.6 for reasoning.
◆Usage

◆  Thinking on, effort medium. And for convenience, use the chat template in this repo. You can also go with xhigh if you like it when the model reasons for more tokens than the actual reply.

◆  Speculative decoding off.

◆  Give it a scene. The more details, the better.

◖◗Credits
  • trohrbaugh: Qwen3.8-27B-heretic-ara.
  • ReadyArt: Dark-Scarlett v2.0, Omega-Convergence, Serenity and Heimdallr - a true ReadyArt merge, and actually the only reason I had enough fodder for this.
  • zerofata: the mergekit fork I use even for this one.
  • Charles Goddard/ArceeAI: mergekit.
  • Ateron: As always.
  • The BeaverAI community: Still the best room on the internet for this hobby.
  • The Qwen team & the open-source community: for the base model and the relentless willing to train everything and anything on this HuggingSpace.
☀ · ☾