Bannerman started playing rugby union while at school, and between 1919–20, he was captain of Glasgow High School's 1st XV.
Bannerman begann bereits während seiner Schulzeit, in der Rugby Union zu spielen, und 1919–20 war er Captain der ersten XV der Glasgow High School.