 Because, well, he didn't know Jesus in the flesh. That's why he says things in the letters to the Corinthians, it doesn't matter who we knew according to the flesh, that that's not important. It's who we know in the Spirit.