My re-edit caption used and needed the apostrophe as a possessive, and quotation marks would not been grammatical.
I'm not sure if you had a chance to try my suggestion, but if my educated guess based on the symptoms was correct, entering two consecutive single quotes would have resulted in one single quote being entered into the database and no error message being generated.
It's a moot point now since the problem has been fixed.