Hugging Face's logo

Spaces:
Dovakiins
/
qwerrwe
Build error

App Files Community
qwerrwe / src /axolotl /utils /models.py

Commit History

split up llama model loading so config can be loaded from base config and models can be loaded from a path
2520ecd

winglian commited on

Fix incorrect rebase
594e72b

Nanobit commited on

fix relative path for fixtures
cfcc549

winglian commited on

Apply isort then black
37293dc

Nanobit commited on

Fix mypy typing
e9650d3

Nanobit commited on

Lint models.py
f4e5d86

Nanobit commited on

fix relative path for fixtures
e65aeed

winglian commited on

refactor: fix previous refactors
56f9ca5

Nanobit commited on

Refactor to use DictDefault instead
8bd7a49

Nanobit commited on

Convert attrdict to addict
bdfe7c9

Nanobit commited on

Merge pull request #67 from OpenAccess-AI-Collective/refactor-tokenizer-load
0d4a7f4
unverified

winglian commited on

Merge branch 'main' into refactor/rename-4b-to-gptq
147241c
unverified

winglian commited on

fix auto linear modules for lora w/o any set already
4c90633

winglian commited on

refactor(param): rename load_4bit config param by gptq
dd00657

Thytu commited on

Update src/axolotl/utils/models.py
ca1bb92
unverified

winglian Nanobit commited on

Update src/axolotl/utils/models.py
933e970
unverified

winglian Nanobit commited on

load the tokenizer seperately from the model
32e6fe9

winglian commited on

Add cfg.lora_target_linear
9196237

Nanobit commited on

qlora and 4bit check so we are able to merge and unload
1987e5c

winglian commited on

fix merge conflict failure, black format
7b5e762

winglian commited on

fixes to make qlora actually work
34c99f9

winglian commited on

fix tokenizer loading, got openllama 3b working
e396654

winglian commited on

stray s
f523a08

winglian commited on

cfg.cfg fix, also de-dupe lora module list
676d7da

winglian commited on

fix tuple add to list
a8771b0

winglian commited on

Update src/axolotl/utils/models.py
1cf21da
unverified

winglian Nanobit commited on

attempt to find linear modules for qlora
ffd1043

winglian commited on

apply black formatting
ce34d64

winglian commited on

Merge branch 'main' of github.com:OpenAccess-AI-Collective/axolotl into dev
ce694e2

winglian commited on

remove un-needed code, add validation
1f5d83e

winglian commited on

fix: handles AutoTokenizer from untrusted source
88ad05d
unverified

Valentin De Matos commited on

more qlora support
e8aacfb

winglian commited on

prepare does all this already for qlora?
b9d07aa

winglian commited on

integrate qlora? maybe?
3b4d055

winglian commited on

Update src/axolotl/utils/models.py for info msg
1b3e401
unverified

winglian Nanobit commited on

tokenization fixes
4ea9a66

winglian commited on

optionally be able to specify alpaca or chat style prompts
1d5ab84

winglian commited on

Set `half` using `cfg.fp16` for 4bit
641f801
unverified

Nanobit commited on

support for replit lm
8c2f3cb

winglian commited on

Add `lora_modules_to_save`
2c73c81
unverified

Nanobit commited on

more fixes
bdbca8f

winglian commited on

more fixes
42410c7

winglian commited on

fix torch_dtype for model load
aef00b6

winglian commited on

optimize dataloading to use cache, fix model token embedding sizes
aa3c3f9

winglian commited on

black formatting
2bc1a5b

winglian commited on

various fixes
7a490a4

winglian commited on

testing mpt triton
e2e68c3

winglian commited on

add support for trust_remote_code for mpt models
a125693

winglian commited on

refactor inference, warn if model is frozen
247825b

winglian commited on

fix adam bnb optimizer grouped parameters, fix peft model 8bit conversion logic, black formatting
7748f3d

winglian commited on