(x)
return 0.5 * x * (
      1.0 + K.tanh(math.sqrt(2.0 / math.pi) * (x + 0.044715 * K.pow(x, 3))))
An approximation of gelu.
     See: https://arxiv.org/pdf/1606.08415.pdf
An approximation of gelu.
     See: https://arxiv.org/pdf/1606.08415.pdf
An approximation of gelu . See : https : // arxiv . org / pdf / 1606 . 08415 . pdf
def gelu(x):
  """An approximation of gelu.
     See: https://arxiv.org/pdf/1606.08415.pdf
  """
  return 0.5 * x * (
      1.0 + K.tanh(math.sqrt(2.0 / math.pi) * (x + 0.044715 * K.pow(x, 3))))
def gelu ( x ) : return 0.5 * x * ( 1.0 + K . tanh ( math . sqrt ( 2.0 / math . pi ) * ( x + 0.044715 * K . pow ( x , 3 ) ) ) )