Paperless-ngx Paperless-ngx: Migration Postgresql zu MariaDB

Dog6574 · 04. Feb 2024

So habe ich das erst mal gemacht:

MariaDB [(none)]> create database paperless;
Query OK, 1 row affected (0.001 sec)

MariaDB [(none)]> create user 'paperless'@'localhost' identified by 'Passwort';
Query OK, 0 rows affected (0.302 sec)

MariaDB [(none)]> grant all privileges on paperless.* to 'paperless'@'%' identified by 'Passwort';
Query OK, 0 rows affected (0.154 sec)

Ist das bis dahin OK?

Adama · 04. Feb 2024

Das klingt soweit ok.

Du kannst dich z.B. mal mit HeidiSQL o.ä. and der MariaDB anmelden, dann müsstest du die Datenbank sehen können. HeidiSQL musst du nicht installieren, gibt es auch als Portable-Version...

Adama · 04. Feb 2024

ctrlaltdelete schrieb:
Macht es Sinn die MariaDB im Docker zu installieren, wenn dieser auf dem NVME-Volume liegt?

Mal abgesehen von der neueren Version werden wohl die Zugriffe schneller sein. Ob sich das wirklich bemerkbar macht, vermag ich nicht zu sagen.

deltapapa · 15. Feb 2024

Moin Moin,
ich versuche auch gerade, Paperless-ngx mit MariaDB zum laufen zu bringen. Leider klappt das nicht.
Das Script von Marius ohne Office läuft problemlos. Danach habe ich versucht mithilfe des Stack direkt von der Paperless-NGX Seite die DB einzubauen. Leider startet der Paperless Container ständig neu mit folgender Fehlermeldung:

Was mich auch wundert, das die Übersicht mit den Images das Redis und MariaDB Image als frei anzeigt:

Hier ist mein jetziger Stack:

Code:

version: "3.6"
services:
  broker:
    image: docker.io/library/redis:7
    container_name: Paperless-NGX-REDIS
    restart: unless-stopped
    volumes:
      - /volume1/docker/paperlessngx/redis:/data
      
  db:
    image: docker.io/library/mariadb:10
    container_name: Paperless-NGX-DB
    restart: unless-stopped
    volumes:
      - /volume1/docker/paperlessngx/db:/var/lib/mysql
    environment:
      MARIADB_HOST: paperless
      MARIADB_DATABASE: paperless
      MARIADB_USER: paperless
      MARIADB_PASSWORD: paperless
      MARIADB_ROOT_PASSWORD: paperless
      
  webserver:
    image: ghcr.io/paperless-ngx/paperless-ngx:latest
    container_name: Paperless-NGX
    restart: unless-stopped
    depends_on:
      - db
      - broker
    ports:
      - 8777:8000
    volumes:
      - /volume1/docker/paperlessngx/data:/usr/src/paperless/data
      - /volume1/docker/paperlessngx/media:/usr/src/paperless/media
      - /volume1/docker/paperlessngx/export:/usr/src/paperless/export
      - /volume1/docker/paperlessngx/consume:/usr/src/paperless/consume
    environment:
      PAPERLESS_REDIS: redis://broker:6379
      PAPERLESS_SECRET_KEY: mega13geheim
      PAPERLESS_DBENGINE: mariadb
      PAPERLESS_DBHOST: db
      PAPERLESS_DBUSER: paperless
      PAPERLESS_DBPASS: paperless
      PAPERLESS_DBPORT: 3306
      USERMAP_UID: 1026
      USERMAP_GID: 100
      PAPERLESS_TIME_ZONE: Europe/Berlin
      PAPERLESS_CONSUMER_DELETE_DUPLICATES: true
      PAPERLESS_ADMIN_USER: admin
      PAPERLESS_ADMIN_PASSWORD: admin
      PAPERLESS_OCR_LANGUAGE: deu+eng

volumes:
  data:
  media:
  db:
  redis:

Vielleicht hat jemand eine Idee, es scheint ja so das über den Port 3306 keine Verbindung zu stande kommt. Ich habe nur Portainer und Adguard als Container am laufen...

alexhell · 15. Feb 2024

Was sagt denn das Log vom MariaDB Container? Das wäre ja relevant wenn da was nicht startet.

deltapapa · 15. Feb 2024

2024/02/15 09:33:55	stderr
2024/02/15 09:33:55	stderr	2024-02-15 8:33:55 0 [Note] mariadbd: Shutdown complete
2024/02/15 09:33:54	stderr	2024-02-15 8:33:54 0 [Note] InnoDB: Shutdown completed; log sequence number 1017303; transaction id 1260
2024/02/15 09:33:54	stderr	2024-02-15 8:33:54 0 [Note] InnoDB: Removed temporary tablespace data file: "./ibtmp1"
2024/02/15 09:33:51	stderr	2024-02-15 8:33:51 0 [Note] InnoDB: Buffer pool(s) dump completed at 240215 8:33:51
2024/02/15 09:33:51	stderr	2024-02-15 8:33:51 0 [Note] InnoDB: Dumping buffer pool(s) to /var/lib/mysql/ib_buffer_pool
2024/02/15 09:33:51	stderr	2024-02-15 8:33:51 0 [Note] InnoDB: Starting shutdown...
2024/02/15 09:33:51	stderr	2024-02-15 8:33:51 0 [Note] InnoDB: FTS optimize thread exiting.
2024/02/15 09:33:51	stderr	2024-02-15 8:33:51 0 [Note] mariadbd (initiated by: unknown): Normal shutdown
2024/02/15 09:33:43	stderr	2024-02-15 8:33:43 4 [Warning] Aborted connection 4 to db: 'paperless' user: 'paperless' host: '172.21.0.4' (Got an error reading communication packets)
2024/02/15 09:26:58	stderr	2024-02-15 8:26:58 3 [Warning] Aborted connection 3 to db: 'unconnected' user: 'unauthenticated' host: '172.21.0.4' (This connection closed normally without authentication)
2024/02/15 09:26:57	stderr	Version: '10.11.7-MariaDB-1:10.11.7+maria~ubu2204' socket: '/run/mysqld/mysqld.sock' port: 3306 mariadb.org binary distribution
2024/02/15 09:26:57	stderr	2024-02-15 8:26:57 0 [Note] mariadbd: ready for connections.
2024/02/15 09:26:56	stderr	2024-02-15 8:26:56 0 [Note] Server socket created on IP: '::'.
2024/02/15 09:26:56	stderr	2024-02-15 8:26:56 0 [Note] Server socket created on IP: '0.0.0.0'.
2024/02/15 09:26:56	stderr	2024-02-15 8:26:56 0 [Note] InnoDB: Buffer pool(s) load completed at 240215 8:26:56
2024/02/15 09:26:56	stderr	2024-02-15 8:26:56 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool
2024/02/15 09:26:56	stderr	2024-02-15 8:26:56 0 [Warning] You need to use --log-bin to make --expire-logs-days or --binlog-expire-logs-seconds work.
2024/02/15 09:26:56	stderr	2024-02-15 8:26:56 0 [Note] Plugin 'FEEDBACK' is disabled.
2024/02/15 09:26:56	stderr	2024-02-15 8:26:56 0 [Note] InnoDB: log sequence number 46878; transaction id 14
2024/02/15 09:26:56	stderr	2024-02-15 8:26:56 0 [Note] InnoDB: File './ibtmp1' size is now 12.000MiB.
2024/02/15 09:26:56	stderr	2024-02-15 8:26:56 0 [Note] InnoDB: Setting file './ibtmp1' size to 12.000MiB. Physically writing the file full; Please wait ...
2024/02/15 09:26:56	stderr	2024-02-15 8:26:56 0 [Note] InnoDB: 128 rollback segments are active.
2024/02/15 09:26:56	stderr	2024-02-15 8:26:56 0 [Note] InnoDB: End of log at LSN=46878
2024/02/15 09:26:56	stderr	2024-02-15 8:26:56 0 [Note] InnoDB: Buffered log writes (block size=512 bytes)
2024/02/15 09:26:56	stderr	2024-02-15 8:26:56 0 [Note] InnoDB: Completed initialization of buffer pool
2024/02/15 09:26:56	stderr	2024-02-15 8:26:56 0 [Note] InnoDB: Initializing buffer pool, total size = 128.000MiB, chunk size = 2.000MiB
2024/02/15 09:26:56	stderr	2024-02-15 8:26:56 0 [Warning] InnoDB: liburing disabled: falling back to innodb_use_native_aio=OFF
2024/02/15 09:26:56	stderr	2024-02-15 8:26:56 0 [Warning] mariadbd: io_uring_queue_init() failed with ENOSYS: check seccomp filters, and the kernel version (newer than 5.1 required)
2024/02/15 09:26:56	stderr	2024-02-15 8:26:56 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions
2024/02/15 09:26:56	stderr	2024-02-15 8:26:56 0 [Note] InnoDB: Number of transaction pools: 1
2024/02/15 09:26:56	stderr	2024-02-15 8:26:56 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
2024/02/15 09:26:56	stderr	2024-02-15 8:26:56 0 [Note] Starting MariaDB 10.11.7-MariaDB-1:10.11.7+maria~ubu2204 source revision 87e13722a95af5d9378d990caf48cb6874439347 as process 1
2024/02/15 09:26:56	stdout
2024/02/15 09:26:56	stdout	2024-02-15 08:26:56+00:00 [Note] [Entrypoint]: MariaDB init process done. Ready for start up.
2024/02/15 09:26:56	stdout
2024/02/15 09:26:56	stdout	2024-02-15 08:26:56+00:00 [Note] [Entrypoint]: Temporary server stopped
2024/02/15 09:26:56	stderr
2024/02/15 09:26:56	stderr	2024-02-15 8:26:56 0 [Note] mariadbd: Shutdown complete
2024/02/15 09:26:56	stderr	2024-02-15 8:26:56 0 [Note] InnoDB: Shutdown completed; log sequence number 46878; transaction id 15
2024/02/15 09:26:56	stderr	2024-02-15 8:26:56 0 [Note] InnoDB: Removed temporary tablespace data file: "./ibtmp1"
2024/02/15 09:26:56	stderr	2024-02-15 8:26:56 0 [Note] InnoDB: Buffer pool(s) dump completed at 240215 8:26:56
2024/02/15 09:26:56	stderr	2024-02-15 8:26:56 0 [Note] InnoDB: Dumping buffer pool(s) to /var/lib/mysql/ib_buffer_pool
2024/02/15 09:26:56	stderr	2024-02-15 8:26:56 0 [Note] InnoDB: Starting shutdown...
2024/02/15 09:26:54	stderr	2024-02-15 8:26:54 0 [Note] InnoDB: FTS optimize thread exiting.
2024/02/15 09:26:54	stderr	2024-02-15 8:26:54 0 [Note] mariadbd (initiated by: unknown): Normal shutdown
2024/02/15 09:26:54	stdout	2024-02-15 08:26:54+00:00 [Note] [Entrypoint]: Stopping temporary server
2024/02/15 09:26:54	stdout
2024/02/15 09:26:51	stdout	2024-02-15 08:26:51+00:00 [Note] [Entrypoint]: Securing system users (equivalent to running mysql_secure_installation)
2024/02/15 09:26:51	stdout	2024-02-15 08:26:51+00:00 [Note] [Entrypoint]: Giving user paperless access to schema paperless
2024/02/15 09:26:51	stdout	2024-02-15 08:26:51+00:00 [Note] [Entrypoint]: Creating user paperless
2024/02/15 09:26:51	stdout	2024-02-15 08:26:51+00:00 [Note] [Entrypoint]: Creating database paperless
2024/02/15 09:26:34	stdout	2024-02-15 08:26:34+00:00 [Note] [Entrypoint]: Temporary server started.
2024/02/15 09:26:34	stderr	Version: '10.11.7-MariaDB-1:10.11.7+maria~ubu2204' socket: '/run/mysqld/mysqld.sock' port: 0 mariadb.org binary distribution
2024/02/15 09:26:34	stderr	2024-02-15 8:26:34 0 [Note] mariadbd: ready for connections.
2024/02/15 09:26:33	stderr	2024-02-15 8:26:33 0 [Warning] 'proxies_priv' entry '@% root@00420152ec44' ignored in --skip-name-resolve mode.
2024/02/15 09:26:33	stderr	2024-02-15 8:26:33 0 [Warning] 'user' entry 'root@00420152ec44' ignored in --skip-name-resolve mode.
2024/02/15 09:26:33	stderr	2024-02-15 8:26:33 0 [Note] Plugin 'FEEDBACK' is disabled.
2024/02/15 09:26:33	stderr	2024-02-15 8:26:33 0 [Note] InnoDB: log sequence number 46878; transaction id 14
2024/02/15 09:26:33	stderr	2024-02-15 8:26:33 0 [Note] InnoDB: File './ibtmp1' size is now 12.000MiB.
2024/02/15 09:26:33	stderr	2024-02-15 8:26:33 0 [Note] InnoDB: Setting file './ibtmp1' size to 12.000MiB. Physically writing the file full; Please wait ...
2024/02/15 09:26:33	stderr	2024-02-15 8:26:33 0 [Note] InnoDB: 128 rollback segments are active.
2024/02/15 09:26:32	stderr	2024-02-15 8:26:32 0 [Note] InnoDB: End of log at LSN=46878
2024/02/15 09:26:32	stderr	2024-02-15 8:26:32 0 [Note] InnoDB: Buffered log writes (block size=512 bytes)
2024/02/15 09:26:32	stderr	2024-02-15 8:26:32 0 [Note] InnoDB: Completed initialization of buffer pool
2024/02/15 09:26:32	stderr	2024-02-15 8:26:32 0 [Note] InnoDB: Initializing buffer pool, total size = 128.000MiB, chunk size = 2.000MiB
2024/02/15 09:26:32	stderr	2024-02-15 8:26:32 0 [Warning] InnoDB: liburing disabled: falling back to innodb_use_native_aio=OFF
2024/02/15 09:26:32	stderr	2024-02-15 8:26:32 0 [Warning] mariadbd: io_uring_queue_init() failed with ENOSYS: check seccomp filters, and the kernel version (newer than 5.1 required)
2024/02/15 09:26:32	stderr	2024-02-15 8:26:32 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions
2024/02/15 09:26:32	stderr	2024-02-15 8:26:32 0 [Note] InnoDB: Number of transaction pools: 1
2024/02/15 09:26:32	stderr	2024-02-15 8:26:32 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
2024/02/15 09:26:32	stderr	2024-02-15 8:26:32 0 [Note] Starting MariaDB 10.11.7-MariaDB-1:10.11.7+maria~ubu2204 source revision 87e13722a95af5d9378d990caf48cb6874439347 as process 108
2024/02/15 09:26:32	stdout	2024-02-15 08:26:32+00:00 [Note] [Entrypoint]: Waiting for server startup
2024/02/15 09:26:32	stdout	2024-02-15 08:26:32+00:00 [Note] [Entrypoint]: Starting temporary server
2024/02/15 09:26:32	stdout	2024-02-15 08:26:32+00:00 [Note] [Entrypoint]: Database files initialized
2024/02/15 09:26:32	stdout
2024/02/15 09:26:32	stdout	https://mariadb.org/get-involved/
2024/02/15 09:26:32	stdout	Consider joining MariaDB's strong and vibrant community:
2024/02/15 09:26:32	stdout
2024/02/15 09:26:32	stdout	The latest information about MariaDB is available at https://mariadb.org/.
2024/02/15 09:26:32	stdout
2024/02/15 09:26:32	stdout	Please report any problems at https://mariadb.org/jira
2024/02/15 09:26:32	stdout
2024/02/15 09:26:32	stdout	See the MariaDB Knowledgebase at https://mariadb.com/kb
2024/02/15 09:26:32	stdout
2024/02/15 09:26:32	stdout	strongly recommended for production servers.
2024/02/15 09:26:32	stdout	databases and anonymous user created by default. This is
2024/02/15 09:26:32	stdout	which will also give you the option of removing the test
2024/02/15 09:26:32	stdout
2024/02/15 09:26:32	stdout	'/usr/bin/mariadb-secure-installation'
2024/02/15 09:26:32	stdout
2024/02/15 09:26:32	stdout	To do so, start the server, then issue the following command:
2024/02/15 09:26:32	stdout	PLEASE REMEMBER TO SET A PASSWORD FOR THE MariaDB root USER !
2024/02/15 09:26:32	stdout
2024/02/15 09:26:32	stdout
2024/02/15 09:23:52	stderr	2024-02-15 8:23:52 0 [Warning] InnoDB: liburing disabled: falling back to innodb_use_native_aio=OFF
2024/02/15 09:23:52	stderr	2024-02-15 8:23:52 0 [Warning] mariadbd: io_uring_queue_init() failed with ENOSYS: check seccomp filters, and the kernel version (newer than 5.1 required)
2024/02/15 09:23:51	stdout	2024-02-15 08:23:51+00:00 [Note] [Entrypoint]: Initializing database files
2024/02/15 09:23:50	stdout	2024-02-15 08:23:50+00:00 [Note] [Entrypoint]: Entrypoint script for MariaDB Server 1:10.11.7+maria~ubu2204 started.
2024/02/15 09:23:50	stdout	2024-02-15 08:23:50+00:00 [Note] [Entrypoint]: Switching to dedicated user 'mysql'
2024/02/15 09:23:50	stderr	1:name=systemd:/docker/00420152ec44af500f4470d9029d8e262eaae8f46f32517f05bdb93194e3d1e4/memory.pressure not writable, functionality unavailable to MariaDB
2024/02/15 09:23:50	stderr	2:name=synomonitor:/system.slice/pkg-ContainerManager-dockerd.service
2024/02/15 09:23:50	stderr	3:cpuacct:/docker/00420152ec44af500f4470d9029d8e262eaae8f46f32517f05bdb93194e3d1e4
2024/02/15 09:23:50	stderr	4:blkio:/docker/00420152ec44af500f4470d9029d8e262eaae8f46f32517f05bdb93194e3d1e4
2024/02/15 09:23:50	stderr	5:devices:/docker/00420152ec44af500f4470d9029d8e262eaae8f46f32517f05bdb93194e3d1e4
2024/02/15 09:23:50	stderr	6:cpu:/docker/00420152ec44af500f4470d9029d8e262eaae8f46f32517f05bdb93194e3d1e4
2024/02/15 09:23:50	stderr	7:memory:/docker/00420152ec44af500f4470d9029d8e262eaae8f46f32517f05bdb93194e3d1e4
2024/02/15 09:23:50	stderr	8:freezer:/docker/00420152ec44af500f4470d9029d8e262eaae8f46f32517f05bdb93194e3d1e4
2024/02/15 09:23:50	stderr	2024-02-15 08:23:50+00:00 [Warn] [Entrypoint]: /sys/fs/cgroup/puset:/docker/00420152ec44af500f4470d9029d8e262eaae8f46f32517f05bdb93194e3d1e4
2024/02/15 09:23:48	stdout	2024-02-15 08:23:48+00:00 [Note] [Entrypoint]: Entrypoint script for MariaDB Server 1:10.11.7+maria~ubu2204 started.

Da werde ich nicht schlau draus...

boxi360 · 24. Feb 2024

Nordlicht01 schrieb:
Das Thema hat mir keine Ruhe gelassen. Ich habe einen Versuch mit einem MariaDB Container gestartet. Im Portainer habe ich für die Datenbank folgende Einträge berücksichtigt (User und Kennwörter zum Testen erstmal Standard):

db:
image: docker.io/library/mariadb:10
restart: unless-stopped
volumes:
- /volume1/docker/paperless/db:/var/lib/mysql
environment:
MARIADB_HOST: paperless
MARIADB_DATABASE: paperless
MARIADB_USER: paperless
MARIADB_PASSWORD: paperless
MARIADB_ROOT_PASSWORD: paperless

PAPERLESS_DBENGINE: mariadb
PAPERLESS_DBUSER: paperless
PAPERLESS_DBHOST: paperless
PAPERLESS_DBPASS: paperless
Der Container für die DB und Paperless befinden sich in einem Netzwerk (Paperless_default)

Die Verbindung zur Datenbank kann der Container Paperless offenbar nicht herstellen. Da ich FileRun als Container mit MariaDB (und dem Port 3306) nutze, habe ich die Container für FileRun gestoppt und den Start von Paperless erneut versucht. Das bringt kein anderes Ergebnis.

Im Logfile erhalte ich folgende Fehlermeldung:

/sbin/docker-prepare.sh: line 41: /dev/tcp/paperless/3306: Connection refused

Habe fast das Gefühl, dass ich den Wald vor lauter Bäumen nicht sehe.

Ich weiß nicht, ob es dir weiterhilft aber bei mir war das Problem das der User "paperless" zweimal angelegt werden musste 1. aus dem Docker Netz + 1. meinem eigenem und danach ging es.