Abstract.
While existing Singing Voice Synthesis systems achieve high-fidelity solo performances, they are constrained by
global timbre control, failing to address dynamic multi-singer arrangement and vocal texture within a single song.
To address this, we propose Tutti, a unified framework designed for structured multi-singer generation.
Specifically, we introduce a Structure-Aware Singer Prompt to enable flexible singer scheduling evolving with
musical structure, and propose Complementary Texture Learning via Condition-Guided VAE to capture implicit
acoustic textures (e.g., spatial reverberation and spectral fusion) that are complementary to explicit
controls. Experiments demonstrate that Tutti excels in precise multi-singer scheduling and significantly enhances
the acoustic realism of choral generation, offering a novel paradigm for complex multi-singer arrangement.
Single-Singer
The textures which are empty there are all the same as the reference tone.
In Vevo1.5 generated, we use a segmented generation and splicing approach, so the
resulting audio may sound quite choppy.
Lyrics(Generated by AI)
Reference Texture
Reference Voice
Vevo1.5 Generated
Tutti Generated(Ours)
[verse]
Raindrops tap the window pane
Steam rising with coffee scent
Pages turn as time moves slow
Waiting for a familiar face to show
[chorus]
That coffee shop corner holds our yesterdays
Every cup holds memories that sway
When music floats between the air
You walk in like you never left there
[verse]
月光洒在小路上
风儿轻轻吹过窗
啦啦啦 心随云飘荡
[verse]
Raindrops scribble poems on cobblestone
Oil-paper umbrella shatters dusk's glow
Tea steam drifts through wooden window seams
Vinyl hums of yellowed yesteryears
Footsteps freeze at the alley's turn
Waiting for a glance that'll never return
Multi-Singers
The textures which are empty there are all the same as the reference tone.
In Vevo1.5 generated, we use a segmented generation and splicing approach, so the
resulting audio may sound quite choppy.
Lyrics(Generated by AI)
Reference Texture
Reference Voice
Vevo1.5 Generated
Tutti Generated(Ours)
[intro]
[Singer1 verse]
Going out tonight, changes into something red Her mother doesn't like that kind of dress Everything she
never had, she's showing off
[Singer2 verse]
Driving too fast, moon is breaking through her hair She's heading for something that she won't forget
Having no regrets is all that she really wants
[Singer1 & Singer2
chorus_multi]
We're only getting older, baby And I've been thinking about it lately
Does it ever drive you crazy
Just how fast the night changes
Everything that you've ever dreamed of
Disappearing when you wake up
But there's nothing to be afraid of
Even when the night changes
It will never change me and you
Singer1
Singer2
[00:00] verse1
[00:16] verse2
[00:32] chorus
[Singer1 verse]
Yellowed letters folded to boats
Carrying vows from youthful throats
Ink blurs in the rain
Drifting to memories' shore
[Singer2 verse]
Old piano keys hum of longing
Moss on windowsills keeps growing
Time slips through my fingers slow
The summer unopened
[Singer1 & Singer2
chorus_multi]
Wind scatters boats to the sea's edge
Piano chords where we never said goodbye
Moss climbs the door of years
And you're still the love that lingers near
