Start as low as you can with the hose hooked up. If it mostly goes out the hose, ramp it up 100 rpms at a time until vacuuming speed. I think I used 1750 if it helps all pools being different and whatnot. The first time is just a test to see if it will work how you want it to. After that you can just go right to the vac speed and get to it.
You have to be pretty quick because you'll lose water. You can delay being too low to vac a little bit by having a hose adding at the same time, but you'll outpace the hose by alot.
You can cheat by using the broom to sweep the bulk of the pool to one general area and then only have to vac that area. With some trial and error, you'll find the intensity to move any dirt/ pollen without just stirring it up. You never get all of it but it settles quick. Come back in 5 mins and brush it again. Not too hard either or the cloud will keep going well past your target area and all up the far wall. But with a couple of passes and really not much time, you can have it down to just a small area and then vac that to waste. I did this many times and it kept the filter clean and the pool brushed.