	When fit again, Carlisle found it difficult to break into the first team as his place in the centre of defence had been taken by Matthew Kilgallon. His return came on 28 December 2004, when he was brought on as an 80th-minute substitute for Frazer Richardson in the 2–1 win against Plymouth Argyle. He started the next league match, against Coventry City, but was shown a red card late on in the 2–1 victory at Highfield Road. After his return from suspension, he was dropped from the team, making just a handful of substitute appearances in the following two months. Carlisle regained his place in the team towards the end of the season, starting in each of the final four matches of the campaign. He left Leeds in the summer of 2005, having spent one season at the club, playing 38 matches and scoring four times for the team as they reached the third round of the League Cup and attained a 14th-placed finish in the league. At the end of the 2004–05 campaign it was revealed that two clubs, Watford and Stoke City, were both competing to sign Carlisle. Leeds United accepted bids of £100,000 from both clubs but Carlisle chose to sign for Watford, and he agreed a three-year contract with the club on 5 August 2005. The deal taking him to Vicarage Road included a clause in his contract stipulating that he would not be played against Leeds in the following season.