Error with GPTQ for distilbert/distilbert-base-cased
Hi,I tried to quantize distilbert/distilbert-base-cased using the following code (instructions taken from Huggingface):from transformers import AutoModelForCausalLM, AutoTokenizer, GPTQConfigmodel_id = “distilbert/distilbert-base-cased”tokenizer = AutoTokenizer.from_pretrained(model_id)gptq_config = GPTQConfig(bits=4, dataset=“c4”, tokenizer=tokenizer)quantized_model = AutoModelForCausalLM.from_pretrained(model_id, device_map=“auto”, quantization_config=gptq_config)I got the following error. How can I quantize this distilbert model using GPTQ?Thanks.ValueError                                Traceback (most recent call last)in <cell line: 1>()----> 1 quantized_model = AutoModelForCausalLM.from_pretrained(model_id, device_map=“auto”, quantization_config=gptq_config)/usr/local/lib/python3.10/dist-packages/transformers/models/auto/auto_factory.py in from_pretrained(cls, pretrained_model_name_or_path, *model_args, **kwargs)565                 pretrained_model_name_or_path, *model_args, config=config, **hub_kwargs, **kwargs566             )→ 567         raise ValueError(568             f"Unrecognized configuration class {config.class} for this kind of AutoModel: {cls.name}.\n"569             f"Model type should be one of {', '.join(c.namefor c in cls._model_mapping.keys())}."ValueError: Unrecognized configuration class <class ‘transformers.models.distilbert.configuration_distilbert.DistilBertConfig’> for this kind of AutoModel: AutoModelForCausalLM.Model type should be one of BartConfig, BertConfig, BertGenerationConfig, BigBirdConfig, BigBirdPegasusConfig, BioGptConfig, BlenderbotConfig, BlenderbotSmallConfig, BloomConfig, CamembertConfig, LlamaConfig, CodeGenConfig, CohereConfig, CpmAntConfig, CTRLConfig, Data2VecTextConfig, DbrxConfig, ElectraConfig, ErnieConfig, FalconConfig, FuyuConfig, GemmaConfig, Gemma2Config, GitConfig, GPT2Config, GPT2Config, GPTBigCodeConfig, GPTNeoConfig, GPTNeoXConfig, GPTNeoXJapaneseConfig, GPTJConfig, JambaConfig, JetMoeConfig, LlamaConfig, MambaConfig, Mamba2Config, MarianConfig, MBartConfig, MegaConfig, MegatronBertConfig, MistralConfig, MixtralConfig, MptConfig, MusicgenConfig, MusicgenMelodyConfig, MvpConfig, NemotronConfig, OlmoConfig, OpenLlamaConfig, OpenAIGPTConfig, OPTConfig, PegasusConfig, PersimmonConfig, PhiConfig, Phi3Config, PLBartConfig, ProphetNetConfig, QDQBertConfig, Qwen2Config, Qwen2MoeConfig, RecurrentGemmaConfig, ReformerConfig, RemBertConfig, RobertaConfig, RobertaPreLayerNormConfig, RoCBertConfig, RoFormerConfig, RwkvConfig, Speech2Text2Config, StableLmConfig, Starcoder2Config, TransfoXLConfig, TrOCRConfig, WhisperConfig, XGLMConfig, XLMConfig, XLMProphetNetConfig, XLMRobertaConfig, XLMRobertaXLConfig, XLNetConfig, XmodConfig.