Yes, as long as you're sure CYA is the other ingredient in your tabs, otherwise you'll be raising CH instead of your CYA level. Not all tabs contain CYA. Keep an eye on your pH as you raise your CYA, it can drop down as you do.
It's always a good idea to post your latest test results when you ask questions about your pool's chemistry. That way we can all have a look at your pool's current state.