Blank Responses
Screenshot 2023-10-02 193356860×368 6.74 KBI am having problems especially withTheBloke_Wizard-Vicuna-13B-Uncensored-SuperHOT-8K-GGMLI have some good conversations and then the responses disappear and a blank response occurs. I have looked through many of these forums and can’t find anything where something similar is occurring.It doesn’t seem to matter what my tokens amount is nor the pre-set I choose that this will happen. I have also played around with GPU offloading but my PC isn’t running hard and wasn’t running hard when this occurs mostly. Possibly a few times but in this instance, my fans were running at normal speed with the pic.Anyone have any suggestions to try?Thanks,
2023-10-05T13:08:11Z
Hi!What does your prompt look like? It’s possible that you are sending some tokens that lead to this behavior for example a \n at the end.If you are using a stop token try to remove it and see what happens.Another thing to check is if maybe you are filtering the response in your production app.Hope that helps.