due to your oak tree .
this small things "acorn"have a acid inside and when they got broken leave a brown spots....
U can try one in drive way, you can see that. Worst thing is, not easy to remove even from concrete.
looks like they got broken in the pool and pool got this color