code: def mtf_image_transformer_base_imagenet():
    
    hparams = mtf_image_transformer_base_cifar()
    hparams.mesh_shape = "batch:32"
    hparams.layout = "batch:batch"
    hparams.batch_size = 128
    hparams.d_ff = 2048
    hparams.hidden_size = 512
    hparams.num_decoder_layers = 12
    hparams.learning_rate = 0.5
    hparams.learning_rate_warmup_steps = 31250
    hparams.layer_preprocess_sequence = "none"
    hparams.layer_postprocess_sequence = "dan"
    hparams.layer_prepostprocess_dropout = 0.1
    hparams.unconditional = True
    return hparams
docs: Data parallel CIFAR parameters.