I agree.  It is entirely logical that a person who enjoys the company of homosexuals is a homophile.  A group of supporters and friends of homosexuals - who are not themselves homosexuals - can (should) be called homophile.  But an Anglophile is someone who likes England, but isn't English.  A group made up predominantly of homosexuals cannot be called homophile, applying the same logic.  It can only be called homosexual.