I always thought of "yeolmae" as not just a name, If you like him and pay attention to him, you can be called yeolmae, but if you only do that, you are not a true yeolmae.
If you really like him, you must first respect everything about him, including his personal wishes.