Towns make me wary in the day, never mind at night.
Out camping doesnt bother me much, not usually in popular spots or near other people.
Wild animal noises can spook you, but not too bad once you learn what they are.
One thing i dont do, since i started camping, is watch horror movies...