code: def transformer_sketch():
    
    hparams = transformer.transformer_small()
    hparams.num_compress_steps = 4
    hparams.batch_size = 32
    hparams.clip_grad_norm = 2.
    hparams.sampling_method = "random"
    return hparams
docs: Basic transformer_sketch hparams.