Compatible Steamer with Beam Search
Currently, Streamer cannot work with Beam search as you will get an error: “ValueError:streamercannot be used with Beam search (yet!). Make sure thatnum_beamsis set to 1.”Any workaround? I can build my own streamer if necessary. Thanks for your help!
2024-07-29T12:28:22Z
I am also searching for a solution to stream with beam search, is there any work around?