It's hard to say. He could be just teasing you. Or he might not be interested about your story at the time. I know us men can be confusing to women. You just need to learn his expressions to know when he's serious and when he's kidding.
My suggestion, if it bothers you, explain to him how it makes you feel. Try to do it in a calm manner.
Most men are not stupid, but we do not get hints very well.
Good Luck!!!