Converting NeMo megatron model to Huggingface bert model in pytorch
I am looking to convert this model which was trained in Megatron to be able to load in huggingface BERT model directly. Any quick ideas are welcome!NVIDIA NGC CatalogGatorTron-OG | NVIDIA NGCGatorTron-OG is a Megatron BERT model trained on pre-trained on de-identified clinical notes from the University of Florida Health System.