text
🔍 Today's pick in Interpretability & Analysis of LMs: 
🔍 Today's pick in Interpretability & Analysis of LMs: 
resource
https://huggingface.co/papers/2404.07004
paper
2404.07004
https://huggingface.co/papers/2404.07004
LM Transparency Tool: Interactive Tool for Analyzing Transformer
  Language Models (2404.07004)
text
 by 
 by 
mention
@igortufanov
igortufanov
text
mention
@mahnerak
mahnerak
text
mention
@javifer
javifer
text
mention
@lena-voita
lena-voita
new_line
new_line
text
The LLM transparency toolkit is an open source toolkit and visual interface to efficiently identify component circuits in LMs responsible for their predictions, using the Information Flow Routes approach (
The LLM transparency toolkit is an open source toolkit and visual interface to efficiently identify component circuits in LMs responsible for their predictions, using the Information Flow Routes approach (
resource
https://huggingface.co/papers/2403.00824
paper
2403.00824
https://huggingface.co/papers/2403.00824
Information Flow Routes: Automatically Interpreting Language Models at
  Scale (2403.00824)
text
).
).
new_line
new_line
text
The tool enables fine-grained customization, highlighting the importance of individual FFN neurons and attention heads. Moreover, vocabulary projections computed using the logit lens approach are provided to examine intermediate predictions of the residual stream, and tokens promoted by specific component updates.
The tool enables fine-grained customization, highlighting the importance of individual FFN neurons and attention heads. Moreover, vocabulary projections computed using the logit lens approach are provided to examine intermediate predictions of the residual stream, and tokens promoted by specific component updates.
new_line
new_line
text
💻 Code: 
💻 Code: 
link
https://github.com/facebookresearch/llm-transparency-tool
https://github.com/facebookresearch/llm-transparency-tool
new_line
new_line
text
🚀 Demo: 
🚀 Demo: 
resource
https://huggingface.co/spaces/facebook/llm-transparency-tool-demo
space
facebook/llm-transparency-tool-demo
https://huggingface.co/spaces/facebook/llm-transparency-tool-demo
text
new_line
new_line
text
🔍 All daily picks: 
🔍 All daily picks: 
link
https://huggingface.co/collections/gsarti/daily-picks-in-interpretability-and-analysis-ofc-lms-65ae3339949c5675d25de2f9
https://huggingface.co/collections/gsarti/daily-picks-in-interpretability-and-analysis-ofc-lms-65ae3339949c5675d25de2f9
🔍 Today's pick in Interpretability & Analysis of LMs: https://huggingface.co/papers/2404.07004 by @igortufanov @mahnerak @javifer @lena-voita

The LLM transparency toolkit is an open source toolkit and visual interface to efficiently identify component circuits in LMs responsible for their predictions, using the Information Flow Routes approach (https://huggingface.co/papers/2403.00824).

The tool enables fine-grained customization, highlighting the importance of individual FFN neurons and attention heads. Moreover, vocabulary projections computed using the logit lens approach are provided to examine intermediate predictions of the residual stream, and tokens promoted by specific component updates.

💻 Code: https://github.com/facebookresearch/llm-transparency-tool

🚀 Demo: https://huggingface.co/spaces/facebook/llm-transparency-tool-demo 

🔍 All daily picks: https://huggingface.co/collections/gsarti/daily-picks-in-interpretability-and-analysis-ofc-lms-65ae3339949c5675d25de2f9
🔥
radames osanseviero lunarflu Yunorga
➕
samusenps lunarflu