Yes, that is normal, it's part of the design that allows the flow direction changes. You might consider replacing your valve. It looks pretty worn, and the replacement parts to get everything refurbished is almost half the cost of a new one.
Good luck!
Take care,
Mo