code: def brelu(x):
    
    x_shape = shape_list(x)
    x1, x2 = tf.split(tf.reshape(x, x_shape[:-1] + [-1, 2]), 2, axis=-1)
    y1 = tf.nn.relu(x1)
    y2 = -tf.nn.relu(-x2)
    return tf.reshape(tf.concat([y1, y2], axis=-1), x_shape)
docs: Bipolar ReLU as in https://arxiv.org/abs/1709.04054.