The Rolling Stones’ ‘Bye Bye Johnny’: Their Raw Chuck Berry Cover (1964) ROLLING STONES DATA Before the Stones became the Stones, they were tearing into Chuck Berry. 'Bye Bye Johnny' captures a young band finding its swagger—and making plenty of glorious studio noise.