Steel brush and plaster are not recommended. Are you sure you are not damaging the surface?
I use nylon only in my pool.
Did you measure your TAP water before you started the fill up?
(It would be great to measure this anyways today, in your case).
The scaling is the consequence of water being...