Alright one more thing before I search, I ran it on recirculate today and doing that had the same effect as backwashing the filter, the filter ran great (full basket) after like an hour of recirculating the water.
Basically, when the pump basket became half full of air I put it on recirculate...