Hugging Face's logo
Kyle's picture
1 50 656

Kyle PRO

iky1e
21world's profile picture fibrosis's profile picture shtefcs's profile picture
·
https://ikyle.me

AI & ML interests

None yet

Recent Activity

updated a collection about 8 hours ago
Text to Speech
liked a model about 8 hours ago
NeuML/vctk-vits-onnx
reacted to grimjim's post with 🔥 1 day ago
I'm (finally) releasing a Python script that trims excess weights in Gemma2 full-weight models that bloated by ~1B parameters due to an early mergekit bug. https://github.com/jim-plus/Gemma2-mergekit-remediation I'd noticed something was off when merges of Gemma2 9B models ended up having ~10B parameters. The current mergekit package is fine, but there are still bloated models on HF that could stand to be fixed. The script assumes that it will be run from the same directory as the model weights, and will trim the unnecessary lm_head.weight tensor and corresponding index entry.
View all activity

Organizations

None yet

iky1e's activity

commented a paper 19 days ago