Well, like anything else, I guess it's a matter of opinion. Vermiculite is used a lot. It's pretty easy to do and goes down fairly quick. I think in general it does wear faster since it's softer. It's only a few hundred PSI, if that. So..if you have weight on it, over time it will get bumps in it. It actually wont hurt anything, really. Unless it gets too bad, its not that noticable in the day time.
"Pool crete" is basically a mix of porland, sand, and some times either a bit of vermiculite or fly ash. It's more expensive to do that way, but it wont get lumpy and bumpy like straight vermiculite will. It's ~3000 psi so its really durable. On a liner change, the potential to have to re-do or repair a vermiculite floor is higher than pool crete, for sure.
I wouldnt get too worked up over the use of vermiculite over pool crete, really. Both are good options. That being said, ifa builder offered pool crete over vermiculite, I'd opt for the pool crete. But, if i liked a particular builder for price, service, etc and he only used vermiculite, I wouldnt turn him down over it.