code: def lmx_relative():
    
    hparams = lmx_base()
    hparams.self_attention_type = "dot_product_relative_v2"
    hparams.activation_dtype = "float32"
    hparams.weight_dtype = "float32"
    return hparams
docs: Language model using relative attention.