Thats a unique idea.You should consider the following idea to enhance your idea so that it would impact uniquely: Copyright © 2015 ISCA.The form of hidden activation functions has been always an important issue in deep neural network (DNN) design. The most common choices for acoustic modelling are the standard Sigmoid and rectified linear unit (ReLU), which are normally used with fixed function shapes and no adaptive parameters. Recently, there have been several papers that have studied the use of parameterised activation functions for both computer vision and speaker adaptation tasks. ,  investigate generalised forms of both Sigmoid and ReLU with learnable parameters, as ll as their integration with the standard DNN acoustic model training process. Experiments using conversational telephone speech (CTS) Mandarin data, result in an average of 3.4% and 2.0% relative word error rate (WER) reduction with Sigmoid and ReLU parameterisations.
['Chao Zhang', 'Philip C. Woodland']
I am writing a research paper on a idea Parameterised Sigmoid and ReLU Hidden Activation Functions for DNN Acoustic Modelling
[{"from": "human", "value": "I am writing a research paper on a idea Parameterised Sigmoid and ReLU Hidden Activation Functions for DNN Acoustic Modelling"}, {"from": "gpt", "value": "Thats a unique idea.You should consider the following idea to enhance your idea so that it would impact uniquely: Copyright \u00a9 2015 ISCA.The form of hidden activation functions has been always an important issue in deep neural network (DNN) design. The most common choices for acoustic modelling are the standard Sigmoid and rectified linear unit (ReLU), which are normally used with fixed function shapes and no adaptive parameters. Recently, there have been several papers that have studied the use of parameterised activation functions for both computer vision and speaker adaptation tasks. ,  investigate generalised forms of both Sigmoid and ReLU with learnable parameters, as ll as their integration with the standard DNN acoustic model training process. Experiments using conversational telephone speech (CTS) Mandarin data, result in an average of 3.4% and 2.0% relative word error rate (WER) reduction with Sigmoid and ReLU parameterisations."}]