He also suggested that, for his cause, it was a bad time for Fisher to leave Westminster, and wrote that "if the King desired to treat of the affair of the Queen, the absence of the said Bishop and of the Bishop of Durham would be unfortunate".