This is a pun on the word "flag. "Flag it away" means to get rid of it or give up on it. This phrase has the word "flag" in it. Vexillology is the study of flags. 
I tried hard to get into vexillology , but , in the end , had to flag it away .