Collision problems

I am hoping someone can help me with this. My player character takes damage from just about everything he runs into. I do want him to be able to take damage if he where hit by a moving vehicle, but what is happening now is way too much. Does anyone have a better method?