Bug: ODT export incorrect when org file contains a Byte Order Mark [9.4 (9.4-29-g20374f-elpaplus @ /home/br/.emacs.d/elpa/org-plus-contrib-20201102/)]

Bug: ODT export incorrect when org file contains a Byte Order Mark [9.4 (9.4-29-g20374f-elpaplus @ /home/br/.emacs.d/elpa/org-plus-contrib-20201102/)]

[Bruno Raoult]

[-- Attachment #1: Type: text/plain, Size: 9092 bytes --]


When an org buffer coding system is "utf-8-with-signature-unix" (the first 3 bytes in file are 0xEF 0xBB 0xBF), export to ODT gives following LibreOffice error when opening the exported file :
"The file 'test.odt' is corrupt and therefore cannot be opened. LibreOffice can try to repair the file. [etc...]".

If we set the encoding to "utf-8-unix" (no BOM), export is correct, and LibreOffice does not complain.

To reproduce: Create a minimal org buffer, change the coding system (set-buffer-file-coding-system) to "utf-8-with-signature-unix", then export to ODT (C-c C-e o o), and open the generated odt file with LibreOffice.

Note: Export to different formats (html, PDF, LaTeX) look correct.

Versions:
  System:      Xubuntu 20.04.1 LTS (focal)
  Emacs:       27.1
  Org:         9.4
  LibreOffice: 6.4

Regards,

br.

Attachement: test.org, a faulty org file (with Byte Order Mark).

$ file test.org
test.org: UTF-8 Unicode (with BOM) text


------------------------------------------------------------------------
Emacs  : GNU Emacs 27.1 (build 1, x86_64-pc-linux-gnu, GTK+ Version 2.24.32)
 of 2020-10-29
Package: Org mode version 9.4 (9.4-29-g20374f-elpaplus @ /home/br/.emacs.d/elpa/org-plus-contrib-20201102/)

current state:
==============
(setq
 org-src-mode-hook '(org-src-babel-configure-edit-buffer
                     org-src-mode-configure-edit-buffer)
 org-link-shell-confirm-function 'yes-or-no-p
 org-babel-after-execute-hook '(org-redisplay-inline-images)
 org-metadown-hook '(org-babel-pop-to-session-maybe)
 org-clock-out-hook '(org-clock-remove-empty-clock-drawer)
 org-html-format-inlinetask-function 'org-html-format-inlinetask-default-function
 org-odt-format-headline-function 'org-odt-format-headline-default-function
 org-ascii-format-inlinetask-function 'org-ascii-format-inlinetask-default
 org-startup-folded 'content
 org-mode-hook '(my/org-mode-hook org-tempo-setup
                 #[0 "\300\301\302\303\304$\207"
                   [add-hook change-major-mode-hook org-show-all append local] 5]
                 #[0 "\300\301\302\303\304$\207"
                   [add-hook change-major-mode-hook org-babel-show-result-all append
                    local]
                   5]
                 org-babel-result-hide-spec org-babel-hide-all-hashes
                 #[0 "\301\211.\207" [imenu-create-index-function org-imenu-get-tree]
                   2]
                 org-eldoc-load)
 org-odt-format-drawer-function #[514 "\207" [] 3 "\n\n(fn NAME CONTENTS)"]
 org-archive-hook '(org-attach-archive-delete-maybe)
 org-confirm-elisp-link-function 'yes-or-no-p
 org-agenda-before-write-hook '(org-agenda-add-entry-text)
 org-metaup-hook '(org-babel-load-in-session-maybe)
 org-bibtex-headline-format-function #[257 "\300.\236A\207" [:title] 3 "\n\n(fn ENTRY)"]
 org-latex-format-drawer-function #[514 "\207" [] 3 "\n\n(fn _ CONTENTS)"]
 org-babel-pre-tangle-hook '(save-buffer)
 org-tab-first-hook '(org-babel-hide-result-toggle-maybe org-babel-header-arg-expand)
 org-babel-load-languages '((calc . t) (emacs-lisp . t) (sql . t) (perl . t)
                            (shell . t))
 org-html-text-markup-alist '((verbatim . "<code class='verbatim'>%s</code>")
                              (verbatim . "<code class='verbatim'>%s</code>")
                              (verbatim . "<code class='verbatim'>%s</code>")
                              (verbatim . "<code class='verbatim'>%s</code>")
                              (verbatim . "<code class='verbatim'>%s</code>")
                              (verbatim . "<code class='verbatim'>%s</code>")
                              (bold . "<b>%s</b>") (code . "<code>%s</code>")
                              (italic . "<i>%s</i>")
                              (strike-through . "<del>%s</del>")
                              (underline . "<span class=\"underline\">%s</span>")
                              (verbatim . "<code>%s</code>"))
 org-ascii-format-drawer-function #[771 ".\207" [] 4 "\n\n(fn NAME CONTENTS WIDTH)"]
 org-agenda-loop-over-headlines-in-active-region nil
 org-src-lang-modes '(("arduino" . arduino) ("browser" . html) ("redis" . redis)
                      ("php" . php) ("C" . c) ("C++" . c++) ("asymptote" . asy)
                      ("bash" . sh) ("beamer" . latex) ("calc" . fundamental)
                      ("cpp" . c++) ("ditaa" . artist) ("dot" . fundamental)
                      ("elisp" . emacs-lisp) ("ocaml" . tuareg)
                      ("screen" . shell-script) ("shell" . sh) ("sqlite" . sql))
 org-src-preserve-indentation t
 org-occur-hook '(org-first-headline-recenter)
 org-cycle-hook '(org-cycle-hide-archived-subtrees org-cycle-hide-drawers
                  org-cycle-show-empty-lines
                  org-optimize-window-after-visibility-change)
 org-todo-keywords '((sequence "TODO" "STARTED" "WAITING" "|" "DONE" "CANCELED"))
 org-support-shift-select t
 org-speed-command-hook '(org-speed-command-activate org-babel-speed-command-activate)
 org-odt-format-inlinetask-function 'org-odt-format-inlinetask-default-function
 org-babel-tangle-lang-exts '(("perl" . "pl") ("emacs-lisp" . "el") ("elisp" . "el"))
 org-export-before-parsing-hook '(org-attach-expand-links)
 org-confirm-shell-link-function 'yes-or-no-p
 org-link-parameters '(("attachment" :follow org-attach-follow :complete
                        org-attach-complete-link)
                       ("id" :follow org-id-open)
                       ("eww" :follow org-eww-open :store org-eww-store-link)
                       ("rmail" :follow org-rmail-open :store org-rmail-store-link)
                       ("mhe" :follow org-mhe-open :store org-mhe-store-link)
                       ("irc" :follow org-irc-visit :store org-irc-store-link :export
                        org-irc-export)
                       ("info" :follow org-info-open :export org-info-export :store
                        org-info-store-link)
                       ("gnus" :follow org-gnus-open :store org-gnus-store-link)
                       ("docview" :follow org-docview-open :export org-docview-export
                        :store org-docview-store-link)
                       ("bibtex" :follow org-bibtex-open :store org-bibtex-store-link)
                       ("bbdb" :follow org-bbdb-open :export org-bbdb-export :complete
                        org-bbdb-complete-link :store org-bbdb-store-link)
                       ("w3m" :store org-w3m-store-link) ("file+sys") ("file+emacs")
                       ("shell" :follow org-link--open-shell)
                       ("news" :follow
                        #[514 "\301\300\302.Q.\"\207" ["news" browse-url ":"] 6
                          "\n\n(fn URL ARG)"]
                        )
                       ("mailto" :follow
                        #[514 "\301\300\302.Q.\"\207" ["mailto" browse-url ":"] 6
                          "\n\n(fn URL ARG)"]
                        )
                       ("https" :follow
                        #[514 "\301\300\302.Q.\"\207" ["https" browse-url ":"] 6
                          "\n\n(fn URL ARG)"]
                        )
                       ("http" :follow
                        #[514 "\301\300\302.Q.\"\207" ["http" browse-url ":"] 6
                          "\n\n(fn URL ARG)"]
                        )
                       ("ftp" :follow
                        #[514 "\301\300\302.Q.\"\207" ["ftp" browse-url ":"] 6
                          "\n\n(fn URL ARG)"]
                        )
                       ("help" :follow org-link--open-help)
                       ("file" :complete org-link-complete-file)
                       ("elisp" :follow org-link--open-elisp)
                       ("doi" :follow org-link--open-doi))
 org-latex-format-headline-function 'org-latex-format-headline-default-function
 org-export-allow-bind-keywords t
 org-link-elisp-confirm-function 'yes-or-no-p
 org-latex-format-inlinetask-function 'org-latex-format-inlinetask-default-function
 org-tab-before-tab-emulation-hook '(org-tempo-complete-tag)
 org-html-format-drawer-function #[514 "\207" [] 3 "\n\n(fn NAME CONTENTS)"]
 org-html-format-headline-function 'org-html-format-headline-default-function
 org-src-window-setup 'current-window
 org-indent-mode-turns-on-hiding-stars nil
 org-link-from-user-regexp "\\<br@lorien\\>\\|\\<Bruno\\>"
 org-publish-project-alist '(("org" :base-directory "~/org" :base-extension "org"
                              :publishing-directory "~/dev/www/cf.bodi/org" :recursive
                              t :publishing-function org-html-publish-to-html
                              :html-head-include-default-style nil
                              :html-head-include-scripts nil)
                             ("static" :base-directory "~/org/" :base-extension
                              "css\\|js\\|png\\|jpg\\|gif\\|pdf\\|mp3\\|ogg\\|swf"
                              :publishing-directory "~/dev/www/cf.bodi/org/"
                              :recursive t :publishing-function org-publish-attachment)
                             )
 )


[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #2: test.org --]
[-- Type: text/x-org, Size: 288 bytes --]

#+TITLE: Lorem.org
#+AUTHOR: Lorem Ipsum

* Lorem Ipsum
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat.