text
Fantastic Beasts (*Hallucinations*) and Where to Find Them 🔎🧌
Fantastic Beasts (*Hallucinations*) and Where to Find Them 🔎🧌
new_line
new_line
text
This paper breaks down LLM hallucinations into six different types:
This paper breaks down LLM hallucinations into six different types:
new_line
new_line
text
1️⃣ Entity: Involves errors in nouns. Changing that single entity can make the sentence correct.
1️⃣ Entity: Involves errors in nouns. Changing that single entity can make the sentence correct.
new_line
new_line
text
2️⃣ Relation: Involves errors in verbs, prepositions, or adjectives. They can be fixed by correcting the relation.
2️⃣ Relation: Involves errors in verbs, prepositions, or adjectives. They can be fixed by correcting the relation.
new_line
new_line
text
3️⃣ Contradictory: Sentences that contradict factually correct information.
3️⃣ Contradictory: Sentences that contradict factually correct information.
new_line
new_line
text
4️⃣ Invented: When the LLM generates sentences with concepts that don't exist in the real world.
4️⃣ Invented: When the LLM generates sentences with concepts that don't exist in the real world.
new_line
new_line
text
5️⃣ Subjective: When the LLM generates sentences influenced by personal beliefs, feelings, biases, etc.
5️⃣ Subjective: When the LLM generates sentences influenced by personal beliefs, feelings, biases, etc.
new_line
new_line
text
6️⃣ Unverifiable: When the LLM comes up with sentences containing information that can't be verified. E.g., Personal or private matters.
6️⃣ Unverifiable: When the LLM comes up with sentences containing information that can't be verified. E.g., Personal or private matters.
new_line
new_line
text
The first two types of hallucinations are relatively easy to correct, given that we can rewrite them by changing the entity or relation. However, the other four would mostly need to be removed to make the sentence factually correct.
The first two types of hallucinations are relatively easy to correct, given that we can rewrite them by changing the entity or relation. However, the other four would mostly need to be removed to make the sentence factually correct.
new_line
new_line
text
Paper:  
Paper:  
resource
https://huggingface.co/papers/2401.06855
paper
2401.06855
https://huggingface.co/papers/2401.06855
Fine-grained Hallucination Detection and Editing for Language Models (2401.06855)
Fantastic Beasts (*Hallucinations*) and Where to Find Them 🔎🧌

This paper breaks down LLM hallucinations into six different types:

1️⃣ Entity: Involves errors in nouns. Changing that single entity can make the sentence correct.

2️⃣ Relation: Involves errors in verbs, prepositions, or adjectives. They can be fixed by correcting the relation.

3️⃣ Contradictory: Sentences that contradict factually correct information.

4️⃣ Invented: When the LLM generates sentences with concepts that don't exist in the real world.

5️⃣ Subjective: When the LLM generates sentences influenced by personal beliefs, feelings, biases, etc.

6️⃣ Unverifiable: When the LLM comes up with sentences containing information that can't be verified. E.g., Personal or private matters.

The first two types of hallucinations are relatively easy to correct, given that we can rewrite them by changing the entity or relation. However, the other four would mostly need to be removed to make the sentence factually correct.

Paper:  https://huggingface.co/papers/2401.06855
🤗
Kukedlc vladbogo bisnotforbella osanseviero jeffboudier andrewrreed EpsilonPhoenix7 loudog2323 Hanyu66
🤯
bisnotforbella Hanyu66