code: def evolved_transformer_base_tpu():
    
    hparams = add_evolved_transformer_hparams(transformer.transformer_tpu())
    hparams.learning_rate_constant = 1 / hparams.learning_rate_warmup_steps ** 0.5
    hparams.learning_rate_schedule = (
        "constant*single_cycle_cos_decay")
    return hparams
docs: Base parameters for Evolved Transformer model on TPU.