A guy freaked out because we had ?

Give him some space. You didn't do anything wrong, so don't feel guilty about it. It sounds as though he may just not understand if what he did with you was okay. If you want to pursue him, let him know that you like him and you'd like to see him again. You could suggest that you and he go and get some food together, like at lunchtime, so he doesn't feel pressured by anything.