code: def attention_lm_moe_base_long_seq():
    
    hparams = attention_lm_moe_base()
  
    hparams.max_length = 0  # max_length == batch_size
    hparams.eval_drop_long_sequences = True
    hparams.min_length_bucket = 256  # Avoid cyclic problems for big batches
    hparams.use_sepconv = True
  
    return hparams
docs: Hyper parameters specifics for long sequence generation.