Did you use a gasket sort of like the one shown below? I did the same and it works fine. Also did you use the Cantex 1-1/2" box adapter that many people use? That is also what I used.
Did you use Magic Lube or similar lube on the gasket? That prevents it from binding and getting pinched when you tighten up the nut.