Clearly if his attraction is "magical" than he must be employing a wizard or voodoo priest to create love potions which he is slipping you unawares. This sort of thing is nothing short of rape via necromancy.
The next your unattractive alchemist comes calling be sure that you scream 'RAPE' at the top of your lungs and kick him swiftly and repeatedly in the testicles. Because if somebody is unattractive and you feel attracted to them then they are evil grave-robbing pedophile terrorists and will kill you without a moments thought. Please, before he knows that you can see through his facade end his reign of sorcerous terror and ball-kick him to death. Be sure to do it in public so that he will not be able to defend himself against your attack..... pedophiles can only turn into bats to escape if no-one over the age of 11 is looking.