So it just gathers on them

that's very true. Water won't work. Brush smoothly removes stuff. Use a old but clean makeup brush. They softly remove dust