With CYA <=20, the minimum FC is 2, with CYA 40 the minimum FC is 3. You should target slightly higher so that you never drop below the minimum FC fro your CYA level.
Do you have any pictures of the stains on the liner?
If you've backwashed since you added DE, then you could try adding DE again.