A true friend is accepting. They will love you for you.
I am sure that if you talk to him about it, he will understand. Tell him that you feel like people are walking away.
I bet you are AMAZING. And suffering for another, well you shouldnt do that. Yes he is your best friend, and he should understand what you go through.
Dont be scared. Talk things out, and if he wont be understanding, well thats his problem, that he cant handle it.
If you ever need anyone to talk to, I'm Always here.