Thats a unique idea.You should consider the following idea to enhance your idea so that it would impact uniquely: Existing methods for understanding the inner workings of convolutional neural networks have relied on visualizations, which do not describe the connections beten the layers and units of the network.  introduce the prediction gradient as a measure of a neuron's relevance to prediction. Using this quantity,  study a relatively small convolutional neural network and make three observations. First, there exists a small number of high prediction-gradient units, which upon removal, severely impact the ability of the network to classify correctly. Second, this performance loss generalizes spans multiple classes, and is not mirrored by removing low-gradient units. Third, the distributed representation of the neural network prevents performance from being impacted until a critical number of units are destroyed, the number depending highly on the prediction gradient of the units removed. These three observations validate the utility of the prediction gradient in identifying important units in a neural network.  finally use the prediction gradient in order to generate and study adversarial examples.
['Henry Z. Lo', 'Wei Ding']
I am writing a research paper on a idea Understanding Deep Networks with Gradients
[{"from": "human", "value": "I am writing a research paper on a idea Understanding Deep Networks with Gradients"}, {"from": "gpt", "value": "Thats a unique idea.You should consider the following idea to enhance your idea so that it would impact uniquely: Existing methods for understanding the inner workings of convolutional neural networks have relied on visualizations, which do not describe the connections beten the layers and units of the network.  introduce the prediction gradient as a measure of a neuron's relevance to prediction. Using this quantity,  study a relatively small convolutional neural network and make three observations. First, there exists a small number of high prediction-gradient units, which upon removal, severely impact the ability of the network to classify correctly. Second, this performance loss generalizes spans multiple classes, and is not mirrored by removing low-gradient units. Third, the distributed representation of the neural network prevents performance from being impacted until a critical number of units are destroyed, the number depending highly on the prediction gradient of the units removed. These three observations validate the utility of the prediction gradient in identifying important units in a neural network.  finally use the prediction gradient in order to generate and study adversarial examples."}]