Currently when I press "C-c '", and immediately exit with "C-c '", the
org buffer's modified flag is set, even though I didn't change
anything.

Code changes with testcases included.  I'm not sure if this can be
made generic for other types of special edit.

-- 
Le