code: def transformer_base_vq1_16_nb1_packed_nda_b01_scales():
    
    hparams = transformer_base_vq_ada_32ex_packed()
    hparams.use_scales = int(True)
    hparams.moe_num_experts = 16
    hparams.moe_k = 1
    hparams.beta = 0.1
    hparams.layer_preprocess_sequence = "n"
    hparams.layer_postprocess_sequence = "da"
    hparams.ema = False
    return hparams
docs: Set of hyperparameters.