Then they asked him, "Who is the man who said to you, 'Take up your mat, and walk'?"
And this was something that the Jews never forgave Jesus for. This is what eventually brought Jesus to the cross. His violation of their traditional interpretation of the Sabbath day.