I am setting up my pool this week, finally the weather is going to co-operate

the pool is a metal frame pool (similar to the intex metal frame pools).

the ground is leveled and 2 inches of sand was added leveled/compacted, laid the pavers for each pool leg.

becasue I had to dig down about a 1.5' on the highside. I now have a 1.5 foot drop, now for the sake of safety for the kids. I am fencing around the pool with 32" wire garden fence.

I was wondering if I could fill the drop off with the remainder of the brick sand. Or will this damage the liner. I would only need to fill at the most 1/3 of the way around the pool as the low side is pretty much level with the grass.

Thanks in advance