You can saw the elbow off with a small manual hand saw or hacksaw, I use one like this for it:

you can also cut it off with a hot knife, either way it's really easy to cut pvc. Once you have it cut off you can just remove the bulkhead yourself and replace it with a new one, I've had to do just that several times with tanks and overflows that came with funky glued angular pvc setups.