What parameter settings (if any) do the "Sample" and "Greedy" options correspond to when using the BLOOM api?
Hello all, sorry if this is a newbie question. On thebloom demo pagethere is an option to select “Sample” or “Greedy” as a text generation parameter/option.When I look at what I think is the list of parameters available for BLOOM (just looking atthe list for text generation) I don’t see anything that literally corresponds to ‘sample’ or ‘greedy’.I thought this might reflect temperature; eg., perhaps a high temperature setting corresponds to greedy, and vice versa. Is this correct?Thanks
2022-08-21T17:23:19Z
Sorry this was a silly question. I dont see a way to delete the topic entirely, so in case anyone is wondering the answer is:do_sample (Optional:True). Bool. Whether or not to use sampling, use greedy decoding otherwise.
2022-12-18T09:26:12Z
Not a silly question at all it help me so thanks