 Jimmy Rogers was born on September 8, 1897, in Meridian, Mississippi. The son of a railroad hand named Aaron Rogers, his mother Eliza passed away when he was around five or six years old. He grew up traveling the rails with his father, and from ages 14 to 28, he worked as a brakeman himself through much of the South and Southwest.