I were ear plugs or muffs depending on how hot or cold it is outside (muffs keep my ears warm in tthe winter). I wear them anytime I use the anvil, power tools, mower or anything loud.
I would think people with hearing loss would be more apt to wear them to protect what they have left, then again, I guess if the loud noise is not loud to you then it is not damaging your hearing?