add FastSpeech2 with internal alignment - #2119
Conversation
…g/speechbrain into fs2_internal_alignment
|
Thank you, @BenoitWang , for your PR contribution! t's great to see this valuable feature being added to the FastSpeech model.
python -c 'from tests.utils.recipe_tests import run_recipe_tests; print("TEST FAILED!") if not(run_recipe_tests(filters_fields=["Dataset"], filters=[["LJSpeech"]], do_checks=False, run_opts="--device=cuda")) else print("TEST PASSED")'I encountered this error:
|
|
Hi @mravanelli , thanks for the comments! I've fixed the recipe test and added the necessary docstrings and examples. |
|
Thank you @BenoitWang. I did the last tests and everything seems to work properly. Thank you for this new model that improves SpeechBrain's TTS systems currently available. |
Contribution in a nutshell
This recipe allows training FastSpeech2 without forced aligner referring to One TTS Alignment To Rule Them All. The alignment can be learned by an internal alignment network that is added to FastSpeech2.
This PR aims to:
As for the phonemes, they are automatically obtained with the speechbrain g2p model during preparation.
Scope