Don't worry about the alkalinity too much, yet. The two best ways I can think of to raise your PH is to:
1. aerate: run waterfalls or some kind of water that drops into the water to create bubbles. This will aerate your pool, raise your PH over time (check every 12 hours), and not really change anything else.
2. Add 20 mule team borax. This will definately raise your PH, add a little borax (good for preventing algae), and increase your TA by just a little bit.
If you post specific test values from a reliable test kit, like Taylor K 2006, you can get some additional help.