Have you tried taking on-line classes at home? There you can do schooling on your time, you don't have to worry about other people.
I'm taking on-line classes for my college, and I love it being on-line it's so simple.
Not going to college doesn't make you dumb or stupid, you can still get a job and everything.
Look into an on-line college, that might save the stress on you.
to you!