Tiiuae/falcon-7b generating wrong response
Why am I not getting a correct response, your help will be highly appreciatedScreenshot 2023-08-14 1127441920×1009 115 KB
2023-08-14T15:32:15Z
Hi,You need to increase themax_lengthargument, which determines the number of tokens to generate. This argument is actually deprecated and now calledmax_new_tokens.