When they were adjusting my waterfall I was getting their leftover dirt washed into the pool when the waterfall started.
Other than being dirty, which I vacuumed up, I didn't notice any additional chemical stress,
I guess a lot is inorganic (sand and rock dust) so as long as you vacuum after it settles out, you shouldn't have anything out of the norm to worry about.
Now if you left that stuff in the pool for a week, I'm sure it would provide a great nucleus for algae to build upon.