College Craziness? Please help!

Okay so, I recently finished my first semester of college and towards the last 3 weeks or so I met a guy who instantly struck me. I told him I had a little crush on him during maybe the second week of knowing him to which he told me he was interested in me as well. We started flirting and one day he was joking around with a friend when I heard him mention he wasn't looking for a relationship. I asked him if he was serious to which he told me it was almost the end of the semester so starting a relationship wasn't right at the moment. He said we should begin as friends and see where it goes.......long story short over break I found out I can't go back to the college (have to take a semester off because it's to expensive) and he told me long distance scares him....I think I love this guy as weird as it may sound and I'm unsure what to do....I'm going back to campus to get my stuff and staying for a few days but thats it until next fall. I could use advice.