Yes!

Definitely remove them if you can. You don't need the copper in the water. Hopefully by removing them this quickly they didn't add too much. Switch to liquid chlorine or regular bleach to increase and maintain the proper FC level based on your current CYA. Always go back to the
FC/CYA Levels to make sure. At this point, most important is keeping the FC higher and letting the pH rise a bit. Feel free to let the pH float up to anywhere between 7.5-7.8. You'll be in a good place there.