← emotion LoRAs

Experiment 2 — Can you merge two emotion LoRAs at once?

Report (plain English)

What we did. For eight emotion pairs (e.g. Amusement + Sadness, Fear + Anger) we activate both LoRA adapters at once and compare four settings: each emotion alone (100%), both at 100%, both at 50%. Because a single generation is noisy, for every setting we draw 16 samples with different seeds and keep the best by A_z+B_z. We show the top-2 of 8 and the top-2 of 16 so you can hear how much drawing more seeds helps.

What the numbers mean. A_z / B_z = EmoNet intensities of the two emotions in the same clip; we want both high. blend / genu = naturalness proxies.

What we found. Both emotions co-occur (A_z>0.5 ∧ B_z>0.5 in the best-of-16) in 1/8 pairs. Drawing 16 seeds instead of 8 raises the best combined A_z+B_z by +0.24 on average — i.e. more seeds noticeably help surface a clip where both emotions land. Take-away: two emotion LoRAs are composable, but the co-occurrence is seed-sensitive, so best-of-N sampling is the practical way to get a clip that carries both; high-arousal emotions (Anger) still tend to dominate a quieter partner. Per-pair audio below.

Amusement + Fear

Amusement only (mean A_z -0.35 / B_z -0.13, n=16)

top-2 of 8:
A_z+0.72 B_z+0.13 · bl 0.0 gn 0.2
A_z+0.76 B_z+0.03 · bl 0.1 gn 0.2
top-2 of 16:
A_z+0.72 B_z+0.13 · bl 0.0 gn 0.2
A_z+0.76 B_z+0.03 · bl 0.1 gn 0.2

Fear only (mean A_z -0.45 / B_z -0.53, n=16)

top-2 of 8:
A_z-0.51 B_z+0.31 · bl 0.3 gn 0.1
A_z+0.24 B_z-0.66 · bl 0.0 gn 0.1
top-2 of 16:
A_z-0.51 B_z+0.31 · bl 0.3 gn 0.1
A_z+0.24 B_z-0.66 · bl 0.0 gn 0.1

both 100% (mean A_z -0.00 / B_z -0.48, n=16)

top-2 of 8:
A_z+3.12 B_z-0.53 · bl 0.0 gn 0.1
A_z+0.99 B_z-0.66 · bl 0.0 gn 0.1
top-2 of 16:
A_z+3.12 B_z-0.53 · bl 0.0 gn 0.1
A_z+0.99 B_z-0.66 · bl 0.0 gn 0.1

both 50% (mean A_z -0.49 / B_z -0.27, n=16)

top-2 of 8:
A_z-0.50 B_z+0.35 · bl 0.0 gn 0.1
A_z-0.50 B_z+0.03 · bl 0.2 gn 0.1
top-2 of 16:
A_z-0.50 B_z+0.35 · bl 0.0 gn 0.1
A_z-0.51 B_z+0.36 · bl 0.2 gn 0.2

Amusement + Sadness

Amusement only (mean A_z +0.52 / B_z -0.87, n=16)

top-2 of 8:
A_z+4.00 B_z-0.87 · bl 0.0 gn 0.2
A_z+1.76 B_z-0.87 · bl 0.1 gn 0.1
top-2 of 16:
A_z+4.00 B_z-0.87 · bl 0.0 gn 0.2
A_z+1.76 B_z-0.87 · bl 0.1 gn 0.1

Sadness only (mean A_z -0.29 / B_z -0.61, n=16)

top-2 of 8:
A_z+2.25 B_z-0.72 · bl 0.1 gn 0.2
A_z-0.51 B_z+0.05 · bl 0.1 gn 0.2
top-2 of 16:
A_z+2.25 B_z-0.72 · bl 0.1 gn 0.2
A_z-0.51 B_z+0.41 · bl 0.2 gn 0.2

both 100% (mean A_z +0.24 / B_z -0.73, n=16)

top-2 of 8:
A_z+1.40 B_z+0.16 · bl 0.1 gn 0.2
A_z+1.31 B_z-0.87 · bl 0.0 gn 0.0
top-2 of 16:
A_z+1.40 B_z+0.16 · bl 0.1 gn 0.2
A_z+1.68 B_z-0.71 · bl 0.0 gn 0.1

both 50% (mean A_z +0.08 / B_z -0.85, n=16)

top-2 of 8:
A_z+3.58 B_z-0.87 · bl 0.1 gn 0.2
A_z+0.62 B_z-0.87 · bl 0.1 gn 0.1
top-2 of 16:
A_z+3.58 B_z-0.87 · bl 0.1 gn 0.2
A_z+0.64 B_z-0.87 · bl 0.1 gn 0.1

Astonishment Surprise + Distress

Astonishment_Surprise only (mean A_z -0.57 / B_z -0.66, n=16)

top-2 of 8:
A_z-0.57 B_z-0.43 · bl 0.0 gn 0.0
A_z-0.57 B_z-0.67 · bl 0.0 gn 0.1
top-2 of 16:
A_z-0.57 B_z-0.39 · bl 0.0 gn 0.1
A_z-0.57 B_z-0.40 · bl 0.1 gn 0.2

Distress only (mean A_z -0.57 / B_z -0.41, n=16)

top-2 of 8:
A_z-0.57 B_z+0.24 · bl 0.2 gn 0.2
A_z-0.57 B_z+0.03 · bl 0.1 gn 0.0
top-2 of 16:
A_z-0.57 B_z+0.49 · bl 0.1 gn 0.2
A_z-0.57 B_z+0.24 · bl 0.2 gn 0.2

both 100% (mean A_z -0.22 / B_z -0.32, n=16)

top-2 of 8:
A_z+0.33 B_z-0.03 · bl 0.1 gn 0.3
A_z-0.55 B_z+0.34 · bl 0.0 gn 0.1
top-2 of 16:
A_z+1.73 B_z+0.12 · bl 0.1 gn 0.1
A_z+0.78 B_z+0.17 · bl 0.1 gn 0.1

both 50% (mean A_z -0.56 / B_z -0.57, n=16)

top-2 of 8:
A_z-0.55 B_z-0.08 · bl 0.2 gn 0.2
A_z-0.58 B_z-0.67 · bl 0.1 gn 0.1
top-2 of 16:
A_z-0.57 B_z+0.18 · bl 0.2 gn 0.1
A_z-0.55 B_z-0.08 · bl 0.2 gn 0.2

Fear + Anger

Fear only (mean A_z -0.32 / B_z +0.02, n=16)

top-2 of 8:
A_z+0.39 B_z+1.01 · bl 0.1 gn 0.0
A_z-0.12 B_z+0.56 · bl 0.0 gn 0.0
top-2 of 16:
A_z-0.14 B_z+1.62 · bl 0.1 gn 0.1
A_z+0.39 B_z+1.01 · bl 0.1 gn 0.0

Anger only (mean A_z -0.12 / B_z +0.91, n=16)

top-2 of 8:
A_z-0.40 B_z+2.12 · bl 0.0 gn 0.1
A_z+0.13 B_z+1.43 · bl 0.1 gn 0.1
top-2 of 16:
A_z+0.71 B_z+1.50 · bl 0.3 gn 0.1
A_z-0.40 B_z+2.12 · bl 0.0 gn 0.1

both 100% (mean A_z -0.11 / B_z +1.04, n=16)

top-2 of 8:
A_z+0.54 B_z+1.47 · bl 0.0 gn 0.1
A_z+0.28 B_z+1.39 · bl 0.1 gn 0.1
top-2 of 16:
A_z+0.54 B_z+1.47 · bl 0.0 gn 0.1
A_z+0.28 B_z+1.53 · bl 0.1 gn 0.1

both 50% (mean A_z -0.14 / B_z +0.48, n=16)

top-2 of 8:
A_z+0.17 B_z+1.61 · bl 0.1 gn 0.1
A_z+0.38 B_z+1.32 · bl 0.0 gn 0.0
top-2 of 16:
A_z+0.17 B_z+1.61 · bl 0.1 gn 0.1
A_z+0.38 B_z+1.32 · bl 0.0 gn 0.0

Fear + Sadness

Fear only (mean A_z -0.48 / B_z -0.87, n=16)

top-2 of 8:
A_z-0.33 B_z-0.87 · bl 0.2 gn 0.1
A_z-0.40 B_z-0.87 · bl 0.2 gn 0.1
top-2 of 16:
A_z+0.56 B_z-0.86 · bl 0.1 gn 0.1
A_z+0.10 B_z-0.87 · bl 0.0 gn 0.1

Sadness only (mean A_z -0.41 / B_z -0.85, n=16)

top-2 of 8:
A_z-0.01 B_z-0.52 · bl 0.2 gn 0.1
A_z-0.35 B_z-0.87 · bl 0.2 gn 0.0
top-2 of 16:
A_z-0.01 B_z-0.52 · bl 0.2 gn 0.1
A_z+0.08 B_z-0.87 · bl 0.2 gn 0.2

both 100% (mean A_z -0.35 / B_z -0.84, n=16)

top-2 of 8:
A_z+0.58 B_z-0.37 · bl 0.1 gn 0.1
A_z-0.22 B_z-0.87 · bl 0.0 gn 0.0
top-2 of 16:
A_z+0.58 B_z-0.37 · bl 0.1 gn 0.1
A_z+0.04 B_z-0.87 · bl 0.1 gn 0.1

both 50% (mean A_z -0.19 / B_z -0.82, n=16)

top-2 of 8:
A_z+0.86 B_z-0.03 · bl 0.2 gn 0.2
A_z+0.14 B_z-0.87 · bl 0.1 gn 0.1
top-2 of 16:
A_z+0.86 B_z-0.03 · bl 0.2 gn 0.2
A_z+0.39 B_z-0.87 · bl 0.1 gn 0.0

Longing + Sadness

Longing only (mean A_z -1.00 / B_z -0.85, n=16)

top-2 of 8:
A_z-0.47 B_z-0.50 · bl 0.3 gn 0.2
A_z-0.99 B_z-0.87 · bl 0.2 gn 0.0
top-2 of 16:
A_z-0.47 B_z-0.50 · bl 0.3 gn 0.2
A_z-0.99 B_z-0.86 · bl 0.2 gn 0.1

Sadness only (mean A_z -0.93 / B_z -0.80, n=16)

top-2 of 8:
A_z-0.98 B_z-0.87 · bl 0.3 gn 0.2
A_z-1.02 B_z-0.87 · bl 0.5 gn 0.1
top-2 of 16:
A_z+0.01 B_z-0.40 · bl 0.4 gn 0.2
A_z-0.94 B_z-0.19 · bl 0.4 gn 0.3

both 100% (mean A_z -1.01 / B_z -0.87, n=16)

top-2 of 8:
A_z-1.01 B_z-0.87 · bl 0.0 gn 0.2
A_z-1.03 B_z-0.87 · bl 0.0 gn 0.1
top-2 of 16:
A_z-0.60 B_z-0.87 · bl 1.0 gn 0.4
A_z-1.01 B_z-0.87 · bl 0.0 gn 0.2

both 50% (mean A_z -0.92 / B_z -0.83, n=16)

top-2 of 8:
A_z-1.00 B_z-0.80 · bl 0.1 gn 0.1
A_z-1.03 B_z-0.87 · bl 0.1 gn 0.1
top-2 of 16:
A_z-0.13 B_z-0.83 · bl 0.2 gn 0.1
A_z-0.34 B_z-0.87 · bl 0.4 gn 0.2

Pleasure Ecstasy + Longing

Pleasure_Ecstasy only (mean A_z -0.68 / B_z -1.03, n=16)

top-2 of 8:
A_z+0.17 B_z-1.02 · bl 0.0 gn 0.3
A_z-0.74 B_z-1.02 · bl 0.0 gn 0.2
top-2 of 16:
A_z+0.17 B_z-1.02 · bl 0.0 gn 0.3
A_z-0.74 B_z-0.98 · bl 0.1 gn 0.0

Longing only (mean A_z -0.74 / B_z -1.04, n=16)

top-2 of 8:
A_z-0.74 B_z-1.01 · bl 0.1 gn 0.1
A_z-0.74 B_z-1.03 · bl 0.0 gn 0.1
top-2 of 16:
A_z-0.74 B_z-1.01 · bl 0.1 gn 0.1
A_z-0.74 B_z-1.02 · bl 0.0 gn 0.0

both 100% (mean A_z -0.74 / B_z -1.01, n=16)

top-2 of 8:
A_z-0.74 B_z-0.85 · bl 0.2 gn 0.2
A_z-0.74 B_z-0.88 · bl 0.1 gn 0.1
top-2 of 16:
A_z-0.74 B_z-0.85 · bl 0.2 gn 0.2
A_z-0.74 B_z-0.88 · bl 0.1 gn 0.1

both 50% (mean A_z -0.74 / B_z -1.03, n=16)

top-2 of 8:
A_z-0.74 B_z-1.00 · bl 0.2 gn 0.2
A_z-0.74 B_z-1.02 · bl 0.3 gn 0.1
top-2 of 16:
A_z-0.74 B_z-0.97 · bl 0.2 gn 0.1
A_z-0.74 B_z-1.00 · bl 0.2 gn 0.2

Sadness + Anger

Sadness only (mean A_z -0.84 / B_z -0.40, n=16)

top-2 of 8:
A_z-0.87 B_z+0.01 · bl 0.0 gn 0.0
A_z-0.87 B_z-0.43 · bl 0.1 gn 0.1
top-2 of 16:
A_z-0.87 B_z+1.03 · bl 0.2 gn 0.1
A_z-0.87 B_z+0.01 · bl 0.0 gn 0.0

Anger only (mean A_z -0.87 / B_z +0.26, n=16)

top-2 of 8:
A_z-0.87 B_z+1.05 · bl 0.1 gn 0.1
A_z-0.87 B_z+0.96 · bl 0.4 gn 0.2
top-2 of 16:
A_z-0.87 B_z+1.76 · bl 0.0 gn 0.1
A_z-0.87 B_z+1.05 · bl 0.1 gn 0.1

both 100% (mean A_z -0.87 / B_z +0.42, n=16)

top-2 of 8:
A_z-0.87 B_z+1.78 · bl 0.2 gn 0.1
A_z-0.87 B_z+1.51 · bl 0.1 gn 0.1
top-2 of 16:
A_z-0.87 B_z+1.78 · bl 0.2 gn 0.1
A_z-0.87 B_z+1.51 · bl 0.1 gn 0.1

both 50% (mean A_z -0.82 / B_z -0.30, n=16)

top-2 of 8:
A_z-0.87 B_z+0.01 · bl 0.2 gn 0.1
A_z-0.87 B_z-0.11 · bl 0.0 gn 0.1
top-2 of 16:
A_z-0.34 B_z+0.37 · bl 0.1 gn 0.1
A_z-0.87 B_z+0.40 · bl 0.2 gn 0.1