code: def vqa_attention_base_range(rhp):
    
    # After starting from base, set intervals for some parameters.
    rhp.set_float("learning_rate", 0.1, 1.0, scale=rhp.LOG_SCALE)
    rhp.set_float("clip_grad_norm", 0.1, 10, scale=rhp.LOG_SCALE)
    rhp.set_discrete("batch_size", [128, 256, 512, 1024])
    rhp.set_float("weight_decay", 0.0, 1e-4)
    rhp.set_categorical("rnn_type", ["lstm", "lstm_layernorm"])
docs: Small range of hyperparameters.