🆕 New: Contained-emotion optimization — agent-discovered recipes (gpt-5.4 + Gemini) for making an intense emotion sound held back, with the VoiceNet TENS/RESP separation.

Emotion × Voice · v2 — Delivery, Edge Cases & Styles

6 cloned voices × (40 emotions × 4 conditions + 8 vocal-burst edge cases + 4 delivery styles) · best-of-32 · hard speaker-similarity floor.

6
voices
172
cells per voice
1032
selected takes
33,024
candidates (best-of-32)
113
below spk-floor (flagged)
0.59
mean speaker similarity

What is this?

The setup

MOSS-VA-v2 (laion/moss-tts-local-transformer-4.55b-voice-acting-v2) is a 4.55B expressive text-to-speech model that can clone a voice from a few seconds of reference audio and follow a written stage direction. Per-emotion LoRA adapters nudge the voice toward a target feeling; a dial λ controls the dose. Each of 6 reference voices speaks 40 emotions in 4 delivery conditions — A intense & free, B moderate & free, C intense but contained, D moderate & contained.

What's new in v2

1. A hard speaker floor. Every winner must have ECAPA speaker similarity ≥ 0.50 to its reference — candidates below it are rejected; if none of 32 passes, the best available take is shown but flagged red (113 of 1032 cells). No more "different person" outliers. 2. Harder intensities. Intense conditions now merge the emotion LoRA at λ up to 1.9 (was 1.5) with more extreme stage directions for the high-arousal emotions (Fear, Anger, Pain, Distress, Triumph…). 3. Longer sentences. Every carrier sentence rewritten to ≥ 20 words (median 27) so there is room to act. 4. Edge cases. 8 vocal-burst situations per voice — fear/pain screams, groaning, shivering, laughter, crying, whimpering, tears — reproduced from our evolutionary edge-case search recipes, best-of-32 under the same floor. 5. Delivery styles. Very-quiet whispering, ASMR whispering, ranting and shouting via VoiceNet-dimension LoRA blends.

Selection

Per cell 32 candidates are generated; ranked by reward = z(genuineness)+z(vocal-burst-blend)+1.25·emotion-strength; the top-8 are checked against the speaker floor and the highest-reward take that still sounds like the speaker wins.

The 6 voices

voiceclustercellsbelow floorspk meanemo mean
Voice 0 · humanmedium172120.6010.313
Voice 1 · voice-01medium172490.5150.301
Voice 2 · goblinmedium172140.6070.308
Voice 3 · ladybugsmall172170.5990.271
Voice 4 · murlocsmall172130.5860.301
Voice 5 · sheepsmall17280.6240.305
Reading it: five of six voices keep speaker similarity ≈0.59–0.62 with only 8–17 flagged cells. Voice 1 is the hard case (49 flagged, spk 0.515) — its timbre sits far from the model's prior, so extreme deliveries pull it off-voice much faster. The floor makes this visible instead of hiding it.

The 4 conditions (all voices pooled, 240 cells each)

conditionemo ↑genu ↑blend ↑spk ↑below floor
A · intense-free
full-blast, nothing held back
0.4370.3620.3550.56941/240
B · moderate-free
present but dialed down
0.2730.4000.3360.6176/240
C · intense-contained
strong feeling fought down — it leaks out
0.2940.2650.3170.55948/240
D · moderate-contained
gentle, quietly kept inside
0.1850.3260.3360.6176/240
Intensity is what breaks the clone: the two intense conditions carry 89 of the 113 flags (A: 41, C: 48) while the moderate ones have 6 each. Pushing λ to 1.9 raised emotion strength (A: 0.44 pooled) and the floor caught the cost. Containment (C) again costs the most genuineness (0.265) — forcing intensity and restraint stays the least natural combination.

Edge cases & delivery styles (per voice on each voice page)

edge casecoveragespk meanbelow floor
Laughter6/60.5252
Cold shiver6/60.5941
Fear scream6/60.5043
Pain groan6/60.5640
Pain scream6/60.5921
Crying6/60.5990
Tears / crying in pain6/60.6390
Whimpering6/60.5980
delivery stylecoveragespk meanbelow floor
ASMR Whispering6/60.6250
Ranting6/60.5651
Shouting6/60.4743
Very Quiet Whispering6/60.5391
Quiet extremes clone better than loud ones. Crying, whimpering, tears and ASMR whisper keep spk ≈0.60–0.64 with almost no flags, while fear-screams and shouting are the hardest (spk 0.47–0.50, half the cells flagged) — screaming simply leaves little of the speaker's identity to match.

Listen

Each page: the full 40×4 emotion grid + edge cases + delivery styles, with scores (emo/genu/blend/spk/λ) under every player. Red-outlined cells are below the speaker floor.

Model: laion/moss-tts-local-transformer-4.55b-voice-acting-v2 · emotion LoRAs v3 (λ up to 1.9) · VoiceNet dimension LoRAs for styles · selection: reward + ECAPA floor 0.50 · best-of-32 · 1032 takes. Related: VoiceNet dimension manual · conditioning manual · VoiceNet scaling grid.