Replacing the niche would be a big deal. It's embedded in the concrete. So, you would need to jackhammer out the whole thing and run new conduit at least part way.
Another option is to replace the conduit with metal conduit as that satisfies the requirements because it is the bonding jumper.
You wouldn't want to drill through the niche where the old connector was because that's where the external bond wire is.
Trying to install a new lug wouldn't be easy. Drilling is likely to leak and probably wouldn't be strong unless you could get a nut on the outside.
Even then, it's a modified connection that might not be considered acceptable.
Another option is to replace the conduit with metal conduit as that satisfies the requirements because it is the bonding jumper.
You wouldn't want to drill through the niche where the old connector was because that's where the external bond wire is.
Trying to install a new lug wouldn't be easy. Drilling is likely to leak and probably wouldn't be strong unless you could get a nut on the outside.
Even then, it's a modified connection that might not be considered acceptable.