history: A few years back my brother left for college and I had one year of high school left. It was weird having the house be so empty. My senior year wasn't nearly as good since my brother left for college that same year. That's tough. I have two older brothers_comma_ so I know how that is. We're separated by four and eight years_comma_ respectively_comma_ so we weren't as close as you two seem to be_comma_ but I always liked having them around.
current: I feel you, me and my brother are really close so it was pretty sad not having him around.
next: Well, absence always does make the heart grow fonder. It will make your relationship a little strained, but the time you guys do get to spend together maybe will mean more and you can enjoy it more. Hopefully his college work doesn't stress him out too much for him to be able to enjoy hanging out.