Spaces:
Sleeping
Sleeping
Hugo Flores Garcia
commited on
Commit
Β·
6fcf6a4
1
Parent(s):
e3ca5f7
update readme
Browse files
README.md
CHANGED
@@ -31,17 +31,59 @@ pip install -e ./vampnet2
|
|
31 |
This repository relies on [argbind](https://github.com/pseeth/argbind) to manage CLIs and config files.
|
32 |
Config files are stored in the `conf/` folder.
|
33 |
|
|
|
|
|
|
|
|
|
34 |
# How the code is structured
|
35 |
|
36 |
This code was written fast to meet a publication deadline, so it can be messy and redundant at times. Currently working on cleaning it up.
|
37 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
38 |
# Usage
|
39 |
|
|
|
|
|
|
|
|
|
|
|
40 |
## Staging a Run
|
41 |
|
42 |
Staging a run makes a copy of all the git-tracked files in the codebase and saves them to a folder for reproducibility. You can then run the training script from the staged folder.
|
43 |
|
44 |
-
|
|
|
|
|
45 |
|
46 |
## Training a model
|
47 |
|
@@ -56,8 +98,6 @@ You just need to provide a list of audio files // folders to fine-tune on, then
|
|
56 |
python scripts/exp/train.py --args.load conf/lora/birds.yml --save_path /path/to/checkpoints
|
57 |
```
|
58 |
|
59 |
-
## Getting the Pretrained Models
|
60 |
-
|
61 |
|
62 |
|
63 |
## Launching the Gradio Interface
|
|
|
31 |
This repository relies on [argbind](https://github.com/pseeth/argbind) to manage CLIs and config files.
|
32 |
Config files are stored in the `conf/` folder.
|
33 |
|
34 |
+
## Getting the Pretrained Models
|
35 |
+
|
36 |
+
Download the pretrained models from [this link](). Then, extract the models to the `models/` folder.
|
37 |
+
|
38 |
# How the code is structured
|
39 |
|
40 |
This code was written fast to meet a publication deadline, so it can be messy and redundant at times. Currently working on cleaning it up.
|
41 |
|
42 |
+
```
|
43 |
+
βββ conf <- (conf files for training, finetuning, etc)
|
44 |
+
βββ demo.py <- (gradio UI for playing with vampnet)
|
45 |
+
βββ env <- (environment variables)
|
46 |
+
βΒ Β βββ env.sh
|
47 |
+
βββ models <- (extract pretrained models)
|
48 |
+
βΒ Β βββ spotdl
|
49 |
+
βΒ Β βΒ Β βββ c2f.pth <- (coarse2fine checkpoint)
|
50 |
+
βΒ Β βΒ Β βββ coarse.pth <- (coarse checkpoint)
|
51 |
+
βΒ Β βΒ Β βββ codec.pth <- (codec checkpoint)
|
52 |
+
βΒ Β βββ wavebeat.pth
|
53 |
+
βββ README.md
|
54 |
+
βββ scripts
|
55 |
+
βΒ Β βββ exp
|
56 |
+
βΒ Β βΒ Β βββ eval.py <- (eval script)
|
57 |
+
βΒ Β βΒ Β βββ train.py <- (training/finetuning script)
|
58 |
+
βΒ Β βββ utils
|
59 |
+
βββ vampnet
|
60 |
+
βΒ Β βββ beats.py <- (beat tracking logic)
|
61 |
+
βΒ Β βββ __init__.py
|
62 |
+
βΒ Β βββ interface.py <- (high-level programmatic interface)
|
63 |
+
βΒ Β βββ mask.py
|
64 |
+
βΒ Β βββ modules
|
65 |
+
βΒ Β βΒ Β βββ activations.py
|
66 |
+
βΒ Β βΒ Β βββ __init__.py
|
67 |
+
βΒ Β βΒ Β βββ layers.py
|
68 |
+
βΒ Β βΒ Β βββ transformer.py <- (architecture + sampling code)
|
69 |
+
βΒ Β βββ scheduler.py
|
70 |
+
βΒ Β βββ util.py
|
71 |
+
```
|
72 |
+
|
73 |
# Usage
|
74 |
|
75 |
+
First, you'll want to set up your environment
|
76 |
+
```bash
|
77 |
+
source ./env/env.sh
|
78 |
+
```
|
79 |
+
|
80 |
## Staging a Run
|
81 |
|
82 |
Staging a run makes a copy of all the git-tracked files in the codebase and saves them to a folder for reproducibility. You can then run the training script from the staged folder.
|
83 |
|
84 |
+
```
|
85 |
+
stage --name my_run --run_dir /path/to/staging/folder
|
86 |
+
```
|
87 |
|
88 |
## Training a model
|
89 |
|
|
|
98 |
python scripts/exp/train.py --args.load conf/lora/birds.yml --save_path /path/to/checkpoints
|
99 |
```
|
100 |
|
|
|
|
|
101 |
|
102 |
|
103 |
## Launching the Gradio Interface
|