If you're lowering pH to the point where you're causing your TA to get too low, then, as the kids these days say, "you're doing it wrong...". Not all pools will have stable, unchanging pH. I have to add acid regularly to my pool but do so in a way that tends to not change the TA much over time so, on average, I don't have to add any baking soda to the water just small regular doses of acid to keep the pH in check. But it all depends on a lot of factors.
The best way for TFP to help you is if you post a full set of water test results for your pool water. Then, if you could also test the water you use to fill the pool with, that would help too. For the fill water, only pH, TA and CH matter, you can ignore any chlorine and there's no CYA in it.
Also, how do you chlorinate your swimming pool?