Thats a unique idea.You should consider the following idea to enhance your idea so that it would impact uniquely:  propose sparsemax, a new activation function similar to the traditional softmax, but able to output sparse probabilities. After deriving its properties,  show how its Jacobian can be efficiently computed, enabling its use in a network trained with backpropagation. Then,  propose a new smooth and convex loss function which is the sparsemax analogue of the logistic loss.  reveal an unexpected connection beten this new loss and the Huber classification loss.  obtain promising empirical results in multi-label classification problems and in attention-based neural networks for natural language inference. For the latter,  achieve a similar performance as the traditional softmax, but with a selective, more compact, attention focus.
['André F. T. Martins', 'Ramón Fernández Astudillo']
I am writing a research paper on a idea From Softmax to Sparsemax: A Sparse Model of Attention and Multi-Label Classification
[{"from": "human", "value": "I am writing a research paper on a idea From Softmax to Sparsemax: A Sparse Model of Attention and Multi-Label Classification"}, {"from": "gpt", "value": "Thats a unique idea.You should consider the following idea to enhance your idea so that it would impact uniquely:  propose sparsemax, a new activation function similar to the traditional softmax, but able to output sparse probabilities. After deriving its properties,  show how its Jacobian can be efficiently computed, enabling its use in a network trained with backpropagation. Then,  propose a new smooth and convex loss function which is the sparsemax analogue of the logistic loss.  reveal an unexpected connection beten this new loss and the Huber classification loss.  obtain promising empirical results in multi-label classification problems and in attention-based neural networks for natural language inference. For the latter,  achieve a similar performance as the traditional softmax, but with a selective, more compact, attention focus."}]