Tell him that if he does not like what is after all a normal smell used by nature to attract males then he should move on,there are plenty more males I am sure will find you attractive in all aspects,if he still protests then tell him it's "holding hands only then" see how that alters him.
