After downloading the original checkpoints from here , you can convert them using the conversion script available at
src/transformers/models/musicgen/convert_musicgen_transformers.py with the following command: