I love freaking people out by sticking my finger in the sodium bicarbonate and then licking it, looking at them and say "yep, it's pure."
Yep, it is the safest chemical you add to your pool. Most everything else you want to be a bit more careful to not overshoot, things like acid or chlorine especially, but baking soda is baking soda.
And welcome to TFP!