Style Description based Text-to-Speech with Conditional Prosodic Style Normalization based Diffusion GAN
Style Description based Text-to-Speech with Conditional Prosodic Style Normalization based Diffusion GAN
Prompt Speech Dataset
Gender
Gender-1: Please ask a man with a normal voice to say:So Tom took his father's pipes and walked over the hill to farmer Bowser's house; for you must know that.
Gender-2: Please ask a woman with a normal voice to say: So Tom took his father's pipes and walked over the hill to farmer Bowser's house; for you must know that.
Prosodic Diff-TTS- Gender 1
Prompt TTS - Gender 1
Prosodic Diff-TTS- Gender 2
Prompt TTS - Gender 2
Pitch:
Pitch-1: His voice has a low pitch: What shall we do, he asked his father.
Pitch-2: His voice has a normal pitch: What shall we do, he asked his father.
Pitch-3: His voice has a high pitch: What shall we do, he asked his father.
Prosodic Diff-TTS- Pitch1
Prosodic Diff-TTS- Pitch2
Prosodic Diff-TTS- Pitch3
Prompt TTS - Pitch 1
Prompt TTS - Pitch 2
Prompt TTS - Pitch 3
Speaking Speed:
Speaking Speed-1: Please speak at a slow speed, gentleman: This man Tom, Tom, the piper's son, was hungry when the day begun; he wanted a bun and asked for one, but soon found out that there were none.
Speaking Speed-2: Please speak at a normal speed, gentleman: This man Tom, Tom, the piper's son, was hungry when the day begun; he wanted a bun and asked for one, but soon found out that there were none.
Speaking Speed-3: Please speak at a fast speed, gentleman: This man Tom, Tom, the piper's son, was hungry when the day begun; he wanted a bun and asked for one, but soon found out that there were none.
Prosodic Diff-TTS- Speaking Speed 1
Prosodic Diff-TTS- Speaking Speed 2
Prosodic Diff-TTS- Speaking Speed 3
Prompt TTS - Speaking Speed 1
Prompt TTS - Speaking Speed 2
Prompt TTS - Speaking Speed 3
Volume-1: Generate a boy's voice with a low volume for me: Tom did not like to steal, but he had no one to teach him to be honest, and so, under his father's guidance, he fell into bad ways.
Volume-2: Generate a boy's voice with a normal volume for me: Tom did not like to steal, but he had no one to teach him to be honest, and so, under his father's guidance, he fell into bad ways.
Volume-3: Generate a boy's voice with a high volume for me: Tom did not like to steal, but he had no one to teach him to be honest, and so, under his father's guidance, he fell into bad ways.
Prosodic Diff-TTS- Volume 1
Prosodic Diff-TTS- Volume 2
Prosodic Diff-TTS- Volume 3
Prompt TTS - Volume 1
Prompt TTS - Volume2
Prompt TTS - Volume3
Emotion
Emotion-1: Look, that man shouts to his friend: Tom, Tom, the piper's son, stole a pig and away he run; the pig was eat and Tom was beat and Tom ran crying down the street.
Emotion-2: Look, that man says sadly to his friend: Tom, Tom, the piper's son, stole a pig and away he run; the pig was eat and Tom was beat and Tom ran crying down the street.
Prosodic Diff-TTS- Emotion 1
Prompt TTS - Emotion 1
Prosodic Diff-TTS- Emotion 2
Prompt TTS - Emotion 2
LibriTTS Daatsets
Prosodic Diff-TTS results
Style= He turns up his volume ,pitch and says quickly
Content - I saw the fascination of the locality.
Style = Speaking of girls with a treble
Content - I\'m up here, Saunders.
Style = A man's voice is very low and quiet
Text = "Yes," said Mrs. Peterkin, "only put on your india-rubber boots." And they hurried out of the house.
Style - She turns down her volume and turn up her pitch and uses a fast speed to say.
Content - During the day she sat in the grand-stand with a young man, one of the instructors from the college, who was a guest of her mother's.
Prompt TTS results :
Style - Please let a lady speak for me and she has a very deep voice
Content - He never did any work except to play the pipes, and he played so badly that few pennies ever found their way into his pouch.
Style - I want to hear that girl talk quickly:
Content - Tom, the piper's son