Believe it or not. I would ignore him most of the time. Be nice, talk, but do not fear. Boy life is too short and do not let anyone scare you, because only God seals your faith. No person can, so no worries.
Sometimes when people appear to be like that is because they have a strong wall, because their heart is broken from wrong people.
When he lets you in the doors, he might be a really nice person.
So yeah slow down and think before you judge