All of you who suggested the left turn for removing stuff was exactly right. In fact, I didn't even have to drill all the way through the whole bolt. Don't know if it collapsed the part that was rusted or what but it works.

If you know of a superior brand - then let me know. I used the Celine ones or some name like that.