I've done both; removed them and left them. Leaving them, you have to either remove the handrail from them, or it will stick through your cover (been there, had it happen). Also, you have the build up of gunk on them when you're ready to open. Last year, we removed ours and that is what I'd recommend. We just sat them at the side of the pool on the deck and dropped them in when we opened in the spring. No problem.