code: def mtf_image_transformer_base_imagenet_mp_sp():
    
    hparams = mtf_image_transformer_base_imagenet_mp128()
    hparams.mesh_shape = "model:8;batch:4"
    hparams.layout = "batch:batch;d_ff:model;num_wblocks:model"
    hparams.batch_size = 8
    hparams.img_len = 128
    hparams.block_length = 128
    hparams.attention_type = "local1d_spatial"
    return hparams
docs: Model parallel ImageNet parameters.