Getting the crud off the bottom should very high priority... If you give the algae a place to live, you can slam until you are blue in the face... Clean the slate for the best results...
Leaf vacuum, brush, get in and scoop it out... what ever you need to do