Traditional GAN:s have problems when the data is in discrete format since there are no derivata between true and false values. So how can GAN:s be able to generate text? Some sources claim that the text should be preprocessed in a transformer model, but are the values not still discrete?
user
{"evolved_from": null, "kind": "human", "source": "OpenAssistant/oasst2"}
Traditional GAN:s have problems when the data is in discrete format since there are no derivata between true and false values. So how can GAN:s be able to generate text? Some sources claim that the text should be preprocessed in a transformer model, but are the values not still discrete?
user
DUMMY RESPONSE
assistant