code: def mtf_image_transformer_cifar_mp_4x():
    
    hparams = mtf_image_transformer_base_cifar()
    hparams.mesh_shape = "model:4;batch:8"
    hparams.layout = "batch:batch;d_ff:model;heads:model"
    hparams.batch_size = 32
    hparams.num_heads = 8
    hparams.d_ff = 8192
    return hparams
docs: Data parallel CIFAR parameters.