Make this sound more formal: You will have a difficult time with letting go of your romantic feelings toward the man if you remain friends with him.
it will be very hard to get over the guy when you are still friends with him.