Here are some resources that you can refer to train your TTS models -
Code Implementations -
espnet - https://github.com/espnet/espnet/tree/master/egs2/ljspeech/tts1
coqui-ai - https://github.com/coqui-ai/TTS
speechbrain - https://github.com/speechbrain/speechbrain/tree/develop/recipes/LJSpeech/TTS
NVIDIA - https://github.com/NVIDIA/tacotron2
glow-tts - https://github.com/jaywalnut310/glow-tts
Reference Papers -
Vall E - https://arxiv.org/pdf/2301.02111
NaturalSpeech 3 - https://arxiv.org/abs/2403.03100