1 14 90

Kostis Gourgoulias

kgourgou

http://kgourgou.me

AI & ML interests

Language modeling, few-shot learning, bayesian inference, information theory, uncertainty quantification.

Recent Activity

liked a Space 18 days ago

HuggingFaceH4/blogpost-scaling-test-time-compute

liked a model 29 days ago

ruliad/deepthought-8b-llama-v0.01-alpha

liked a model about 1 month ago

nomic-ai/nomic-embed-text-v1.5

View all activity

Articles

A brief analysis of automerger data, feat. SLERP and DARE-TIES LLM merging

Mar 24, 2024

• 1

Organizations

kgourgou's activity

upvoted a paper 5 months ago

Can Large Language Models Infer Causation from Correlation?

Paper • 2306.05836 • Published Jun 9, 2023 • 6

upvoted a paper 7 months ago

TextGrad: Automatic "Differentiation" via Text

Paper • 2406.07496 • Published Jun 11, 2024 • 27

upvoted a collection 7 months ago

Models and Linearity

Collection

2 items • Updated Jun 14, 2024 • 1

upvoted 2 papers 7 months ago

Your Transformer is Secretly Linear

Paper • 2405.12250 • Published May 19, 2024 • 149

Not All Language Model Features Are Linear

Paper • 2405.14860 • Published May 23, 2024 • 39

upvoted 2 articles 8 months ago

Article

Let's talk about LLM evaluation

•

May 23, 2024

• 143

Article

Jack of All Trades, Master of Some, a Multi-Purpose Transformer Agent

Apr 22, 2024

• 80

upvoted 2 papers 9 months ago

Low-rank Adaptation of Large Language Model Rescoring for Parameter-Efficient Speech Recognition

Paper • 2309.15223 • Published Sep 26, 2023 • 19

Resolving Interference When Merging Models

Paper • 2306.01708 • Published Jun 2, 2023 • 13

upvoted a collection 12 months ago

Model Merging

Collection

Model Merging is a very popular technique nowadays in LLM. Here is a chronological list of papers on the space that will help you get started with it! • 30 items • Updated Jun 12, 2024 • 221

upvoted a paper 12 months ago

Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time

Paper • 2203.05482 • Published Mar 10, 2022 • 6

upvoted a collection 12 months ago

Papers about model merging

Collection

referenced in the mergekit repo: https://github.com/cg123/mergekit • 4 items • Updated Feb 13, 2024 • 14

upvoted a paper about 1 year ago

LLM in a flash: Efficient Large Language Model Inference with Limited Memory

Paper • 2312.11514 • Published Dec 12, 2023 • 257

upvoted a paper over 1 year ago

Textbooks Are All You Need

Paper • 2306.11644 • Published Jun 20, 2023 • 142