"When the Whip Comes Down" is seen by some Rolling Stones fans as the closest the Stones came to outright punk music on the album that many call the Stones' "punk album".
Nummeret "When the Whip Comes Down" blev betragtet af de fleste Stones fans som det tætteste The Stones kom til punk musikken på albummet, som mange kaldte The Stones "punk album".