I believe that is one of the signs that God has chosen the person. They don't feel worthy. Remember what Moses said when God approached him?
Evil spirits usually choose the arrogant and egotistical to work through. People who like to draw attention to themselves. God chooses the humble and they usually try to fight it because they don't want the attention.They DO want God to be glorified. God chooses those souls precisely because He trusts them with the gift.

If you know of anyone who God has gifted with discerning these matters, I would tell them about the different things that you're experienced that seem supernatural.
Don't worry about being the weirdo in the family! I don't have any of these gifts and I'm still the weirdo!! We are but fools to the world - but we are not of this world, right?