Unable to install OnlyOffice from script

aquatic7

Linux cryptpad 6.8.4-2-pve #1 SMP PREEMPT_DYNAMIC PMX 6.8.4-2 (2024-04-10T17:36Z) x86_64

I try to install OnlyOffice in CryptPad using the script.
But I get an error. Anyone able to guide me on how to fix it?

I get the following error:

root@cryptpad:~/cryptpad# ls

CHANGELOG.md LICENSES config datastore install-onlyoffice.sh package-lock.json screenshot.png

CODE_OF_CONDUCT.md SECURITY.md cryptpad.service docker-compose.yml lib package.json scripts

Dockerfile blob customize.dist docker-entrypoint.sh node_modules readme.md server.js

LICENSE block data docs onlyoffice-conf screenshot-suite.png www

root@cryptpad:~/cryptpad# ./install-onlyoffice.sh

v1 was up to date

v2b was up to date

v4 was up to date

v5 was up to date

v6 was up to date

fatal: invalid reference: e1267803

root@cryptpad:~/cryptpad#

Wolfgang

Hello @aquatic7, what version of CryptPad are you using?

Fineness9996

I try to update from v2004.6.0 and it happens whether I go to v2004.6.1 or v2004.9.0
all instructions go well and then when running ./install-onlyoffice.sh I get

v1 was up to date
v2b was up to date
v4 was up to date
v5 was up to date
v6 was up to date
fatal: invalid reference: e1267803

as a result onlyoffice won't get updated and I am locked out from my documents

Mathilde

Fineness9996 duplicate new thread, merged into the older one. 🙂

Fineness9996

anyone?

Wolfgang

Hmm, I can not reproduce this on my side.

@aquatic7, @Fineness9996, can you give me the output of these commands?

git --version
lsb_release -a

Fineness9996

I just tried again with the same result
maybe this will help

cryptpad@cryptpad:~/cryptpad$ git fetch origin --tags
remote: Enumerating objects: 2279, done.
remote: Counting objects: 100% (1516/1516), done.
remote: Compressing objects: 100% (77/77), done.
remote: Total 2279 (delta 1457), reused 1485 (delta 1439), pack-reused 763 (from 1)
Receiving objects: 100% (2279/2279), 1.05 MiB | 9.26 MiB/s, done.
Resolving deltas: 100% (1793/1793), completed with 212 local objects.
From https://github.com/cryptpad/cryptpad
   81f70c6a6..4d1d4852c  1099-performance-table-not-responsive-for-mobile            -> origin/1099-performance-table-not-responsive-for-mobile
   072dba254..caf8af3e3  1406-password-confirmation-button-badly-formatted-on-mobile -> origin/1406-password-confirmation-button-badly-formatted-on-mobile
   9c032931d..e4da9285d  1541-modal-before-enabling-mandatory-2fa                    -> origin/1541-modal-before-enabling-mandatory-2fa
 * [new branch]          2024.9-rc                                                   -> origin/2024.9-rc
 * [new branch]          2024.9-test                                                 -> origin/2024.9-test
 * [new branch]          Misaligned-file-menu-items                                  -> origin/Misaligned-file-menu-items
 * [new branch]          better-metadata                                             -> origin/better-metadata
 * [new branch]          block                                                       -> origin/block
 * [new branch]          calendar-dropdown-fixes                                     -> origin/calendar-dropdown-fixes
 * [new branch]          calendar-modal-ui-fixes                                     -> origin/calendar-modal-ui-fixes
 * [new branch]          checkup-support                                             -> origin/checkup-support
 * [new branch]          choice-and-checkbox-grids-overflow                          -> origin/choice-and-checkbox-grids-overflow
 * [new branch]          code-on-mobile-no-preview                                   -> origin/code-on-mobile-no-preview
 * [new branch]          contact-request-notification-fixes                          -> origin/contact-request-notification-fixes
 * [new branch]          contacts                                                    -> origin/contacts
 * [new branch]          ctrl+e-modal-navigation-fixes                               -> origin/ctrl+e-modal-navigation-fixes
 * [new branch]          dependabot/npm_and_yarn/npm_and_yarn-90067d527a             -> origin/dependabot/npm_and_yarn/npm_and_yarn-90067d527a
 * [new branch]          form-description-keyboard-fixes                             -> origin/form-description-keyboard-fixes
 * [new branch]          form-ui-fixes                                               -> origin/form-ui-fixes
 * [new branch]          form_settingsmodal_accessibility                            -> origin/form_settingsmodal_accessibility
 * [new branch]          formmodal_accessibility                                     -> origin/formmodal_accessibility
 * [new branch]          formpassword_warning                                        -> origin/formpassword_warning
 * [new branch]          game                                                        -> origin/game
 * [new branch]          generated-avatars-display-on-two-lines                      -> origin/generated-avatars-display-on-two-lines
 * [new branch]          history-limit                                               -> origin/history-limit
 * [new branch]          history-viewbuttons-overlap                                 -> origin/history-viewbuttons-overlap
 * [new branch]          kanban-seminar                                              -> origin/kanban-seminar
   3863888fd..fe481eda2  main                                                        -> origin/main
   5383f9ef1..965af5d1d  memory                                                      -> origin/memory
 * [new branch]          missing-padding-on-form-questions                           -> origin/missing-padding-on-form-questions
 * [new branch]          missing-padding-on-form-settings                            -> origin/missing-padding-on-form-settings
   3722d0902..980f93217  monitoring                                                  -> origin/monitoring
 * [new branch]          multiple-calendars-inout-of-view                            -> origin/multiple-calendars-inout-of-view
 * [new branch]          new-event-calendar-modal-out-of-view                        -> origin/new-event-calendar-modal-out-of-view
 * [new branch]          notifications-padding-issue                                 -> origin/notifications-padding-issue
   97a806353..66047fed0  ooapi                                                       -> origin/ooapi
 * [new branch]          ooapi-dl                                                    -> origin/ooapi-dl
 * [new branch]          remove-bootstrap                                            -> origin/remove-bootstrap
 * [new branch]          requestedit_button                                          -> origin/requestedit_button
 * [new branch]          roster                                                      -> origin/roster
 * [new branch]          rt-buttons-fix                                              -> origin/rt-buttons-fix
   8c11b8c4c..5d887b53a  sodium                                                      -> origin/sodium
   072dba254..e40410eec  staging                                                     -> origin/staging
 * [new branch]          tiptap                                                      -> origin/tiptap
 * [new branch]          trashrestore_elementselection                               -> origin/trashrestore_elementselection
 * [new branch]          upload-diagram-images-on-import                             -> origin/upload-diagram-images-on-import
   5e83049c8..027d786cf  weblate                                                     -> origin/weblate
 * [new branch]          worker-issues                                               -> origin/worker-issues
 * [new tag]             2024.6.1                                                    -> 2024.6.1
 * [new tag]             2024.9.0                                                    -> 2024.9.0

cryptpad@cryptpad:~/cryptpad$ git checkout 2024.9.0
error: Your local changes to the following files would be overwritten by checkout:
        package-lock.json
        package.json
Please commit your changes or stash them before you switch branches.
Aborting

cryptpad@cryptpad:~/cryptpad$ git stash
Saved working directory and index state WIP on (no branch): febafddc2 Merge 2024.6-rc branch for release

cryptpad@cryptpad:~/cryptpad$ git checkout 2024.9.0
Previous HEAD position was febafddc2 Merge 2024.6-rc branch for release
HEAD is now at 0d872af27 Update changelog

cryptpad@cryptpad:~/cryptpad$ npm ci
npm WARN EBADENGINE Unsupported engine {
npm WARN EBADENGINE   package: 'json.sortify@2.2.2',
npm WARN EBADENGINE   required: { node: '>=4.0.0', npm: '~1.0.20' },
npm WARN EBADENGINE   current: { node: 'v18.19.0', npm: '9.2.0' }
npm WARN EBADENGINE }
npm WARN deprecated debuglog@0.0.2: Package no longer supported. Contact Support at https://www.npmjs.com/support for more info.
npm WARN deprecated lex@1.7.9: Package no longer supported. Contact Support at https://www.npmjs.com/support for more info.
npm WARN deprecated popper.js@1.16.1: You can find the new Popper v2 at @popperjs/core, this package is dedicated to the legacy v1

added 553 packages, and audited 554 packages in 32s

70 packages are looking for funding
  run `npm fund` for details

5 vulnerabilities (3 low, 2 moderate)

To address issues that do not require attention, run:
  npm audit fix

To address all issues (including breaking changes), run:
  npm audit fix --force

Run `npm audit` for details.

cryptpad@cryptpad:~/cryptpad$ npm run install:components

> cryptpad@2024.9.0 install:components
> node scripts/copy-components.js

cryptpad@cryptpad:~/cryptpad$ ./install-onlyoffice.sh
v1 was up to date
v2b was up to date
v4 was up to date
v5 was up to date
v6 was up to date
fatal: invalid reference: e1267803

cryptpad@cryptpad:~/cryptpad$ git --version
git version 2.39.5

cryptpad@cryptpad:~/cryptpad$ lsb_release -a
No LSB modules are available.
Distributor ID: Debian
Description:    Debian GNU/Linux 12 (bookworm)
Release:        12
Codename:       bookworm

Fineness9996

@Wolfgang any ideas?

AlexQ

@aquatic7 @Fineness9996

I suggest we isolate the problem. It is git related, the error message is a git one. I think it's either a temporary problem or something that is done before. That's why it is hard to reproduce.

So let's debug the OnlyOffice download, the rest (CryptPad install / update) is irrelveant and in this special case distracting.

Please let's try soley the download by copying the script and modifying it (the copy of course):

copy install-onlyoffice.sh to a new empty directory, e.g. /root/ootest/
disable the (for the test) unnecessary downloads by commenting them out
(so add # before lines 31-35 and line 37 to disable downloads of v1 - v6 and the x2t install)
change line 152 to GIT_TRACE=1 git worktree add "$FULL_DIR" "$COMMIT" so that we get more verbose git output
start the modified script in the new directory and post the output here in the forum / thread

If everything would work normally you would get a sub directory www with about 450 MB (command df -h) and about 11k files (command find www -type f | wc -l).

If you want to experiment with the git verbose output you'll fidn the possible arguments here:
https://git-scm.com/book/en/v2/Git-Internals-Environment-Variables#Debugging

Good luck. I'm curious if we can advance or solve this thread.

Wolfgang

AlexQ @aquatic7 @Fineness9996

Thanks AlexQ for your response. This is indeed a good way, to narrow down the issue!

AlexQ

Remark / addition:
GIT_TRACE_SETUP=true is worth a try.

Fineness9996

Downloading OnlyOffice...
Cloning into bare repository '/home/cryptpad/ootest/onlyoffice-conf/onlyoffice-builds.git'...
remote: Enumerating objects: 21994, done.
remote: Counting objects: 100% (149/149), done.
remote: Compressing objects: 100% (102/102), done.
remote: Total 21994 (delta 56), reused 131 (delta 40), pack-reused 21845 (from 1)
Receiving objects: 100% (21994/21994), 287.18 MiB | 6.99 MiB/s, done.
Resolving deltas: 100% (9314/9314), done.
21:04:09.267286 trace.c:311             setup: git_dir: .
21:04:09.271003 trace.c:312             setup: git_common_dir: .
21:04:09.271006 trace.c:313             setup: worktree: (null)
21:04:09.271009 trace.c:314             setup: cwd: /home/cryptpad/ootest/onlyoffice-conf/onlyoffice-builds.git
21:04:09.271011 trace.c:315             setup: prefix: (null)
21:04:09.271015 git.c:460               trace: built-in: git worktree add /home/cryptpad/ootest/www/common/onlyoffice/dist/v7 e1267803
Preparing worktree (detached HEAD e1267803)
21:04:09.272699 run-command.c:655       trace: run_command: GIT_DIR=/home/cryptpad/ootest/www/common/onlyoffice/dist/v7/.git GIT_WORK_TREE=/home/cryptpad/ootest/www/common/onlyoffice/dist/v7 git update-ref HEAD e1267803ea749cd93e9d5f81438011ea620d04af
21:04:09.275563 trace.c:311             setup: git_dir: /home/cryptpad/ootest/onlyoffice-conf/onlyoffice-builds.git/worktrees/v7
21:04:09.275620 trace.c:312             setup: git_common_dir: /home/cryptpad/ootest/onlyoffice-conf/onlyoffice-builds.git
21:04:09.275624 trace.c:313             setup: worktree: /home/cryptpad/ootest/www/common/onlyoffice/dist/v7
21:04:09.282720 trace.c:314             setup: cwd: /home/cryptpad/ootest/onlyoffice-conf/onlyoffice-builds.git
21:04:09.282760 trace.c:315             setup: prefix: (null)
21:04:09.282785 git.c:460               trace: built-in: git update-ref HEAD e1267803ea749cd93e9d5f81438011ea620d04af
21:04:09.286756 run-command.c:655       trace: run_command: GIT_DIR=/home/cryptpad/ootest/www/common/onlyoffice/dist/v7/.git GIT_WORK_TREE=/home/cryptpad/ootest/www/common/onlyoffice/dist/v7 git reset --hard --no-recurse-submodules
21:04:09.289404 trace.c:311             setup: git_dir: /home/cryptpad/ootest/onlyoffice-conf/onlyoffice-builds.git/worktrees/v7
21:04:09.289461 trace.c:312             setup: git_common_dir: /home/cryptpad/ootest/onlyoffice-conf/onlyoffice-builds.git
21:04:09.289491 trace.c:313             setup: worktree: /home/cryptpad/ootest/www/common/onlyoffice/dist/v7
21:04:09.289511 trace.c:314             setup: cwd: /home/cryptpad/ootest/onlyoffice-conf/onlyoffice-builds.git
21:04:09.289531 trace.c:315             setup: prefix: (null)
21:04:09.289552 git.c:460               trace: built-in: git reset --hard --no-recurse-submodules
21:04:09.290287 chdir-notify.c:65       setup: chdir from '/home/cryptpad/ootest/onlyoffice-conf/onlyoffice-builds.git' to '/home/cryptpad/ootest/www/common/onlyoffice/dist/v7'
21:04:09.290316 chdir-notify.c:40       setup: reparent packed-refs to '/home/cryptpad/ootest/onlyoffice-conf/onlyoffice-builds.git/packed-refs'
21:04:09.290339 chdir-notify.c:40       setup: reparent files-backend $GIT_DIR to '/home/cryptpad/ootest/onlyoffice-conf/onlyoffice-builds.git/worktrees/v7'
21:04:09.290360 chdir-notify.c:40       setup: reparent files-backend $GIT_COMMONDIR to '/home/cryptpad/ootest/onlyoffice-conf/onlyoffice-builds.git'
Updating files: 100% (11330/11330), done.
HEAD is now at e1267803 Add null check
v7 updated

Fineness9996

basically - no error encountered
what is going on?

Fineness9996

I also run modified install-onlyoffice.sh
in the cryptpad directory

v1 was up to date
v2b was up to date
v4 was up to date
v5 was up to date
v6 was up to date
21:16:32.450190 trace.c:311             setup: git_dir: .
21:16:32.450801 trace.c:312             setup: git_common_dir: .
21:16:32.450804 trace.c:313             setup: worktree: (null)
21:16:32.450807 trace.c:314             setup: cwd: /home/cryptpad/cryptpad/onlyoffice-conf/onlyoffice-builds.git
21:16:32.450813 trace.c:315             setup: prefix: (null)
21:16:32.450816 git.c:460               trace: built-in: git worktree add /home/cryptpad/cryptpad/www/common/onlyoffice/dist/v7 e1267803
fatal: invalid reference: e1267803

Fineness9996

oh, nice
I removed directories onlyoffice-confand www/common/onlyoffice
and run the unmodified script again
here is the result

Downloading OnlyOffice...
Cloning into bare repository '/home/cryptpad/cryptpad/onlyoffice-conf/onlyoffice-builds.git'...
remote: Enumerating objects: 21994, done.
remote: Counting objects: 100% (149/149), done.
remote: Compressing objects: 100% (102/102), done.
remote: Total 21994 (delta 56), reused 131 (delta 40), pack-reused 21845 (from 1)
Receiving objects: 100% (21994/21994), 287.18 MiB | 8.20 MiB/s, done.
Resolving deltas: 100% (9314/9314), done.
Preparing worktree (detached HEAD 4f370beb)
Updating files: 100% (3682/3682), done.
HEAD is now at 4f370beb v1
v1 updated
Preparing worktree (detached HEAD d9da72fd)
Updating files: 100% (10468/10468), done.
HEAD is now at d9da72fd v2b
v2b updated
Preparing worktree (detached HEAD 6ebc6938)
Updating files: 100% (20274/20274), done.
HEAD is now at 6ebc6938 v4
v4 updated
Preparing worktree (detached HEAD 88a356f0)
Updating files: 100% (21081/21081), done.
HEAD is now at 88a356f0 v5
v5 updated
Preparing worktree (detached HEAD abd8a309)
Updating files: 100% (21764/21764), done.
HEAD is now at abd8a309 v6
v6 updated
Preparing worktree (detached HEAD e1267803)
Updating files: 100% (11330/11330), done.
HEAD is now at e1267803 Add null check
v7 updated
unzip needs to be installed to run this script

Fineness9996

after installing unzip

v1 was up to date
v2b was up to date
v4 was up to date
v5 was up to date
v6 was up to date
v7 was up to date
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100 11.5M  100 11.5M    0     0  7166k      0  0:00:01  0:00:01 --:--:-- 18.6M
x2t.zip: OK
Archive:  x2t.zip
  inflating: x2t.wasm                
  inflating: x2t.js                  
x2t updated

but returning to original folders - the same

v1 was up to date
v2b was up to date
v4 was up to date
v5 was up to date
v6 was up to date
fatal: invalid reference: e1267803

I wonder if to get around the problem I should simply remove
onlyoffice-conf and www/common/onlyoffice

Fineness9996

well.. I've done it
the whole upgrade procedure ended with success - except
the page now returns an error
Failed to load https://pad.dld.com/common/onlyoffice/current-version.js?ver=2024.9.0-1729722080651.

AlexQ

@Fineness9996 this is a tough one for me since I have only limited git knowledge. But we get closer!

Please give feedback if I understand your new results right:

Observation

The Onlyoffice download script (no matter if modified or unmodifed) works without problems if run in another directory, right?

Conlusion

So this would mean that the cause of the problem is somewhere in your "grown" CryptPad installation, specifically in the git files / environment. Please don't misunderstand me, the cause is not your fault, it just only happens with the specific cicumstances of your instance, that's why the developers can't reproduce and fix it. :-/

Workaround

If the theory is correct you should be able to work around the problem by downloading Onlyoffice and copying it manually into your CryptPad installation. Please try the following (of course make backups before or rename the old directories!):

again download Onlyoffice via another directory like you have done before successfully with the ootest directory
replace your directory /home/cryptpad/cryptpad/www/common/onlyoffice/dist/v7/ with the contents of the successfull Onlyoffice download from {path}/ootest/www/common/onlyoffice/dist/v7/ (of course all the content, so all files and all sub directories)

Outlook

I think this should do the trick. Please give feedback. If it's not the solution then it will be like 90% of it and we will solve the rest. What bugs me is that I think you will get this problem again with every update of the CryptPad OnlyOffice part. Especially since one can expect CryptPad to use Onyloffice version 8 with one of the following CryptPad updates. So unless someone with git knowledge hels to solve the git cause better be prepared for your next CryptPad updates.