Input text or speech is processed through its specific encoder.
A decoder creates text tokens in the desired language.
If speech generation is required, the second seq2seq model, generates unit tokens in an non auto-regressive way.
These unit tokens are then passed through the final vocoder to produce the actual speech.