Yes, you should definitely test the salt level one way or another. Most pool stores will test the salt level for you. The vast majority of the time, the high salt light only goes on when the salt level is actually high. It is possible for the main unit to break such that the high salt light goes on, but you almost never see that happen.