text
Working through the Reddit dataset, one thing that occurs to me is we pretty much always train LLMs to be a conversation between 2 parties like Bot/Human or Instruction/Response. 
Working through the Reddit dataset, one thing that occurs to me is we pretty much always train LLMs to be a conversation between 2 parties like Bot/Human or Instruction/Response. 
new_line
new_line
text
It seems far more common with internet data that we have multi-speaker/group discussions with a dynamic number of speakers. This also seems to be more realistic to the real world too and requires a bit more understanding to model. 
It seems far more common with internet data that we have multi-speaker/group discussions with a dynamic number of speakers. This also seems to be more realistic to the real world too and requires a bit more understanding to model. 
new_line
new_line
text
Is there some research into this? I have some ideas of how I'd like to implement it, but I wonder if some work has already been done here?
Is there some research into this? I have some ideas of how I'd like to implement it, but I wonder if some work has already been done here?
Working through the Reddit dataset, one thing that occurs to me is we pretty much always train LLMs to be a conversation between 2 parties like Bot/Human or Instruction/Response. 

It seems far more common with internet data that we have multi-speaker/group discussions with a dynamic number of speakers. This also seems to be more realistic to the real world too and requires a bit more understanding to model. 

Is there some research into this? I have some ideas of how I'd like to implement it, but I wonder if some work has already been done here?
👍
yungwarlock Moooritz krutarth53 pranav-deshpande ClaudioItaly Stephenmcgurrin sthakur2 poetofgrindset Noomam Luxter77
https://cdn-avatars.huggingface.co/v1/production/uploads/63357cfe8adfa81faf2ac69b/vexRhlok-GqtPUvgXrIK-.jpeg
DEWA SAHU
Dewa
user
https://cdn-avatars.huggingface.co/v1/production/uploads/642ceee93a6a3fa1ebb1d1a8/u2i07Nreg8SrPv_Q8C3ph.jpeg
Pranav Deshpande
pranav-deshpande
user
/avatars/8e94be223946391de3f876dcab300f16.svg
eliot zubkoff
eliotz
user
/avatars/75583bdb84b38d4584415d283f12b26c.svg
David
D4ve-R
user
https://cdn-avatars.huggingface.co/v1/production/uploads/62a3bb1cd0d8c2c2169f0b88/eT2TS0IlQbZtz-F_zHLz9.jpeg
Joseph [open/acc] Pollack
Tonic
user