Certainly focus on getting the chemistry under control as well, but it does sound like your filter is probably returning material that has just entered it based on this description.
I'm a new pool owner this year, so I don't have a lot of experience, but the story of my pool opening earlier...