text
Large models are surprisingly bad storytellers.
Large models are surprisingly bad storytellers.
new_line
new_line
text
I asked 8 LLMs to "Tell me a bedtime story about bears and waffles."
I asked 8 LLMs to "Tell me a bedtime story about bears and waffles."
new_line
new_line
text
Claude 3.5 Sonnet and GPT-4o gave me the worst stories: no conflict, no moral, zero creativity.
Claude 3.5 Sonnet and GPT-4o gave me the worst stories: no conflict, no moral, zero creativity.
new_line
new_line
text
In contrast, smaller models were quite creative and wrote stories involving talking waffle trees and bears ostracized for their love of waffles.
In contrast, smaller models were quite creative and wrote stories involving talking waffle trees and bears ostracized for their love of waffles.
new_line
new_line
text
Here you can see a comparison between Claude 3.5 Sonnet and NeuralDaredevil-8B-abliterated. They both start with a family of bears but quickly diverge in terms of personality, conflict, etc.
Here you can see a comparison between Claude 3.5 Sonnet and NeuralDaredevil-8B-abliterated. They both start with a family of bears but quickly diverge in terms of personality, conflict, etc.
new_line
new_line
text
I mapped it to the hero's journey to have some kind of framework. Prompt engineering can definitely help here, but it's still disappointing that the larger models don't create better stories right off the bat.
I mapped it to the hero's journey to have some kind of framework. Prompt engineering can definitely help here, but it's still disappointing that the larger models don't create better stories right off the bat.
new_line
new_line
text
Do you know why smaller models outperform the frontier models here?
Do you know why smaller models outperform the frontier models here?
Large models are surprisingly bad storytellers.

I asked 8 LLMs to "Tell me a bedtime story about bears and waffles."

Claude 3.5 Sonnet and GPT-4o gave me the worst stories: no conflict, no moral, zero creativity.

In contrast, smaller models were quite creative and wrote stories involving talking waffle trees and bears ostracized for their love of waffles.

Here you can see a comparison between Claude 3.5 Sonnet and NeuralDaredevil-8B-abliterated. They both start with a family of bears but quickly diverge in terms of personality, conflict, etc.

I mapped it to the hero's journey to have some kind of framework. Prompt engineering can definitely help here, but it's still disappointing that the larger models don't create better stories right off the bat.

Do you know why smaller models outperform the frontier models here?
👍
ijohn07 pabloce AtAndDev GPT007 KingNish ThatOneCoder takeraparterer alexb02 kirada Dihelson sosoai lordvader31 notimetosleep SicariusSicariiStuff VictorNanka PrimeD omarei ruben-wleon AIismine LyAA Wauplin Tonic DIvAndrey roccotool tgup mufeed eldogbbhed giovanibarcelos thanhkt
🧠
FlareRebellion AtAndDev prithivMLmods GPT007 ThatOneCoder takeraparterer alexb02 adamelliotfields den0620 Dihelson danielus Tonic
👀
AtAndDev GPT007 ThatOneCoder takeraparterer alexb02 Tonic giovanibarcelos
🤗
MrOvkill AtAndDev Tonic
🔥
giovanibarcelos
/avatars/54483699273ac58a4a6fe1fa4aab65fe.svg
Robert Sinclair
ZeroWw
user
https://cdn-avatars.huggingface.co/v1/production/uploads/630f3e4002ce39336c411048/FXJON7b-aRUiH0_V2uRsi.jpeg
alkinun
AtAndDev
user
/avatars/53f98572ab1a15550474a56f26f32337.svg
Steinzer Narayan
steinzer-narayan
user
https://cdn-avatars.huggingface.co/v1/production/uploads/65d883893a52cd9bcd8ab7cf/tRsCJlHNZo1D02kBTmfy9.jpeg
leroy Samuel Dyer
LeroyDyer
user
https://cdn-avatars.huggingface.co/v1/production/uploads/652ff5ee7aab9cfb619400bf/cIdrUic40uXoRbAylFiM8.png
Samuel L Meyers
MrOvkill
user
https://cdn-avatars.huggingface.co/v1/production/uploads/61b8e2ba285851687028d395/JtUGAwVh_4cDEsjNcfpye.png
Maxime Labonne
mlabonne
user
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/AXnwP_G2WkJ0gkBepd_t7.png
Marc Kovka
GPT007
user
https://cdn-avatars.huggingface.co/v1/production/uploads/6612aedf09f16e7347dfa7e1/bPYjBXCedY_1fSIPjoBTY.jpeg
Nishith Jain
KingNish
user
/avatars/57422077e4117f3ff4309461a38a576b.svg
Anton
cuzmich
user
https://cdn-avatars.huggingface.co/v1/production/uploads/6527e89a8808d80ccff88b7a/CuGNmF1Et8KMQ0mCd1NEJ.jpeg
Lain
not-lain
user
https://cdn-avatars.huggingface.co/v1/production/uploads/6569216f9c96f1a47bf45788/mCLqmAs4dOjKdxNQVAp1w.png
Sica Rius
SicariusSicariiStuff
user
/avatars/c73c63918e1680bdf576df91981afaf7.svg
sdhai
bjhi
user
https://cdn-avatars.huggingface.co/v1/production/uploads/6535601a5f5e918bdc08d0d2/ElWiwLfKV_qL_uHP82L2t.jpeg
ME 1
AIGUYCONTENT
user