In 1935 Gogarty published his first prose work, "As I Was Going Down Sackville Street" (subtitled "A Phantasy in Fact"), a semi-fictional novel-memoir that tells, in reverse chronological order, the story of Gogarty's Dublin through a series of interconnected anecdotes and lively characters sketches.