Just because he could have been illegitimate, doesn't mean his mother was Jewish.  The similarity between Manzer (an inhabitant name in German, or descriptive name based on Latin Mansus) and Mamzer (a Yiddish name), does not really hold up to history and culture.  Please provide proof, not speculations.