FasterTransformer implementation
#9
by
Meital
- opened
Hi!
Thanks for your hard work.
I saw that you wrote that the model is compatible with fastertransformer inference.
Do you have a conversion script?
I couldn't see the model implementation in fastertransformer and it would be very beneficial for me :)
I am also intrested in this one
Has anyone had luck here?
Thanks !
Lets move this discussion here https://github.com/mosaicml/llm-foundry/issues/67 please :)
daking
changed discussion status to
closed