From a chemical perspective, although salt crystals may closely resemble what you are observing my hypothesis is that the white powder build-up is aluminum chloride.
copied from:
http://www.chemeddl.org/alfresco/servic ... guest=true
"Aluminum and chlorine do not react rapidly at room temperature, but if the aluminum is heated, the reaction is vigorous. The product is aluminum chloride, a white powder that fumes in air, reacting with water to form HCl gas and aluminum oxide."
That being said I would venture to suspect this build-up is observed more greatly in times when the sun heats the aluminum of your ladder.
Without even emphasizing the harmful effects of the aluminum on the body (such as its direct correlation with Alzheimer's) since most water treatment processes include aluminum use anyway (not to mention any of the other plethora of products and methods exposing us to aluminum...) Considering the HCl mentioned in said quote would probably exceed in urgency.
copied from:
http://www.cdc.gov/niosh/docs/81-123/pdfs/0332.pdf "Occupational Health Guideline for HCl, Centers for Disease Control"
(please note this is a PDF file so yes I did hand copy this passage and re-type it bc I believe it is important to share with you)
"-Effects of overexposure
1.Short-term exposure: when hydrogen chloride gas is inhaled, it may cause eye irritation, severe burns and permanent damage with loss of sight. Solutions of hydrogen chloride may cause severe burns of the skin unless the acid is washed off immediatly. Exposure of the skin to hydrogen chloride gas may cause skin inflammation or burns, swallowing hydrogen chloride solutions may cause burns of the mouth, throat, and stomach.
2.Long-term exposure: Repeated or prolonged exposure to hydrogen chloride may cause erosion of the teeth. Repeated exposure of the skin to dilute solutions of hydrogen chloride may cause skin rash."
To reiterate: aluminum chloride (white powder) reacts with water to form HCl gas... I hope this has been helpful to you, and I hope your pool is not in a sun room trapping any HCl gas. Please do consider taking precautions. Wishing you good tidings from your real estate agent, take care.