L^2-SP Regularization
Has anyone by chance implementedL^2-SPregularizationfor the Adam optimizer?I want to avoid reinventing the wheel, but I believe this would require a custom version of theAdamWclass.