Pass input_embed to WhisperDecoder
In modeling_whisper.py, the WhisperDecoder can takeinput_idsorinput_embedsas its input. When I try passinginput_embedsof dimension(1, 1500, 384)it faces an error insideWhisperPositionalEmbeddingas the max_context_length is448and I get an error ofRuntimeError}. The size of tensor a (1500) must match the size of tensor b (448) at non-singleton dimension 1. How to resolve this issue?