ValueError: You have to specify either decoder_input_ids or decoder_inputs_embeds
I have used many ways to create the dataset and feed it to the model but everytime I am getting the same error , I am new to hugging face , Can anyone please help me how to train a TFAutoModelForSeq2SeqLM model pleaseIn my dataset both Input and Output are sentencesI want a model that mimic a person.from tensorflow.keras.optimizers import Adam
from tensorflow.keras.losses import SparseCategoricalCrossentropy

import tensorflow as tf
# Load model directly
from transformers import AutoTokenizer, TFAutoModelForSeq2SeqLM

tokenizer = AutoTokenizer.from_pretrained("facebook/blenderbot-400M-distill")
model = TFAutoModelForSeq2SeqLM.from_pretrained("facebook/blenderbot-400M-distill")
from datasets import load_dataset

dataset = load_dataset("csv", data_files="/content/conversation_data.csv", sep=",",split='train')
max_input_length = 1024
max_target_length = 128

def preprocess_function(examples):
    model_inputs = tokenizer(examples["Input"], max_length=max_input_length, truncation=True)

    # Setup the tokenizer for targets
    with tokenizer.as_target_tokenizer():
        labels = tokenizer(examples["Output"], max_length=max_target_length, truncation=True)

    model_inputs["labels"] = labels["input_ids"]
    return model_inputs

tokenized_datasets = dataset.map(
    preprocess_function, batched=True, remove_columns=["Input", "Output"]
)

# Dataset({
 #   features: ['input_ids', 'attention_mask', 'labels'],
  #  num_rows: 2304
#})
from transformers import AutoTokenizer, DataCollatorWithPadding
data_collator = DataCollatorWithPadding(tokenizer=tokenizer, return_tensors="tf")

tf_train_dataset = tokenized_datasets.to_tf_dataset(
    columns=["attention_mask", "input_ids"],
    label_cols=["labels"],
    shuffle=True,
    collate_fn=data_collator,
    batch_size=8,
)

# Compile and train the model
model.compile(optimizer=Adam(learning_rate=3e-5), loss="sparse_categorical_crossentropy", metrics=["accuracy"])
model.fit(tf_train_dataset)ValueError: Exception encountered when calling layer 'model' (type TFBlenderbotMainLayer).ValueError: You have to specify either decoder_input_ids or decoder_inputs_embedsCall arguments received by layer 'decoder' (type TFBlenderbotDecoder):
          • input_ids=None
          • inputs_embeds=None
          • attention_mask=None
          • position_ids=None
          • encoder_hidden_states=tf.Tensor(shape=(None, None, 1280), dtype=float32)
          • encoder_attention_mask=tf.Tensor(shape=(None, None), dtype=int32)
          • head_mask=None
          • cross_attn_head_mask=None
          • past_key_values=None
          • use_cache=True
          • output_attentions=False
          • output_hidden_states=False
          • return_dict=True
          • training=True
    
    
    Call arguments received by layer 'model' (type TFBlenderbotMainLayer):
      • input_ids=tf.Tensor(shape=(None, None), dtype=int32)
      • attention_mask=tf.Tensor(shape=(None, None), dtype=int32)
      • decoder_input_ids=None
      • decoder_attention_mask=None
      • decoder_position_ids=None
      • head_mask=None
      • decoder_head_mask=None
      • cross_attn_head_mask=None
      • encoder_outputs=None
      • past_key_values=None
      • inputs_embeds=None
      • decoder_inputs_embeds=None
      • use_cache=True
      • output_attentions=False
      • output_hidden_states=False
      • return_dict=True
      • training=True
      • kwargs=<class 'inspect._empty'>


Call arguments received by layer 'tf_blenderbot_for_conditional_generation' (type TFBlenderbotForConditionalGeneration):
  • input_ids={'input_ids': 'tf.Tensor(shape=(None, None), dtype=int64)', 'attention_mask': 'tf.Tensor(shape=(None, None), dtype=int64)'}
  • attention_mask=None
  • decoder_input_ids=None
  • decoder_attention_mask=None
  • decoder_position_ids=None
  • head_mask=None
  • decoder_head_mask=None
  • cross_attn_head_mask=None
  • encoder_outputs=None
  • past_key_values=None
  • inputs_embeds=None
  • decoder_inputs_embeds=None
  • use_cache=None
  • output_attentions=None
  • output_hidden_states=None
  • return_dict=None
  • labels=None
  • training=True
2023-11-14T04:27:24Z
See@Rocketknight1's response in thisthread.Pass in the labels to yourto_tf_datasetcallcolumns=["attention_mask", "input_ids", "labels"],Also consider using themodel.prepare_tf_datasetmethod which is supposed to shape the dataset appropriately - but I have not tried that out.Also
2023-11-14T07:57:33Z
I did this and It removed the error but got the following error →  ValueError: Unable to create tensor, you should probably activate truncation and/or padding with ‘padding=True’ ‘truncation=True’ to have batched tensors with the same length. Perhaps your features (decoder_input_idsin this case) have excessive nesting (inputs typelistwhere typeintis expected).Although padding=True{‘input_ids’: [[3274, 312, 1610, 473, 107, 40, 4472, 3568, 671, 353, 418, 82, 305, 295, 440, 362, 2854, 515, 90, 286, 1817, 84, 2022, 1661, 265, 588, 2038, 1345, 480
2023-11-14T09:25:29Z
update yourpreprocessormethod to pad the tokens.tokenizer(examples["Input"],  padding="max_length".... or set it tolongest.