How to turn off text streamer to repeat prompt in the output?
Hi,I successfully use TextIteratorStreamer to stream output using AutoGPTQ transformer. However, the response will always start by repeating the prompt that was input an follow by the answer. Is there an option to turn off?