I think part of the concern is that with plaster there can end up being a lot of clouding and stuff suspended in the water as the surface is brushed down. Or it could be the method of startup ... could be very acidic or highly alkaline.
For a vinyl, fiberglass, or maybe even pebble pool ... once it is filled ... jump on in!!!