[Always *]

It totally sucks that you don't really get to spend a lot of time with him, but shutting him out isn't going to fix that. He probably isn't intentionally spending less time with you. Like Estelle mentioned, he might have more responsibilities at home that make the demands on his time even heavier when he is home for a limited amount of time and he might not be able to do anything about that.

Have you considered going to spend time at his families house when he is home and offering to go out for lunch with him and his brother or helping out with his household chores? I know that is probably kind of lame, but then at least you're going to get to spend time with him, and if his family really does present more of a demand on his time, you won't create a conflict in his family by "taking him away when they need him" - it might cause a conflict for him and cause his family to resent you, even if that seems totally unfair to you.