powdery

I have been having a problem with dusty brown powdery silt at the bottom of my perfectly clear and maintained above ground Intex 16x48 above ground pool with an aftermarket Hayward skimmer and a 1/2 hp Glass media filter. No matter how much I vacuumed it kept coming back, I vacuumed to waste...