code: def attention_lm_moe_unscramble_base():
    
    hparams = attention_lm_no_moe_small()
    hparams.use_inputs = True
    hparams.min_length_bucket = 1024
    hparams.max_length = 1024
    hparams.batch_size = 5000
    hparams.layer_prepostprocess_dropout = 0.0
    hparams.layer_preprocess_sequence = "n"
    hparams.layer_postprocess_sequence = "da"
    return hparams
docs: Version to use with languagemodel_wiki_scramble1k50.