You can repack the stem with the water on ... That crud can jam the gate and damage the valve. Gently close the valve first. Don't force it shut; you don't want to cause more damage.