annotate TODO @ 445:cec6a0cd399f pg-transactions

now logging DatabaseCannotSerialize as a warning only with the details (Orthanc will log it as an error after all retries)
author Alain Mazy <am@osimis.io>
date Wed, 10 Jan 2024 15:25:03 +0100
parents d700c8f9fc24
children f4244c7e2725 15e609c439d1
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
196
Sebastien Jodogne <s.jodogne@gmail.com>
parents:
diff changeset
1
Sebastien Jodogne <s.jodogne@gmail.com>
parents:
diff changeset
2 ==============================
Sebastien Jodogne <s.jodogne@gmail.com>
parents:
diff changeset
3 == Orthanc database plugins ==
Sebastien Jodogne <s.jodogne@gmail.com>
parents:
diff changeset
4 ==============================
Sebastien Jodogne <s.jodogne@gmail.com>
parents:
diff changeset
5
Sebastien Jodogne <s.jodogne@gmail.com>
parents:
diff changeset
6 -----------------------
Sebastien Jodogne <s.jodogne@gmail.com>
parents:
diff changeset
7 Common - Database index
Sebastien Jodogne <s.jodogne@gmail.com>
parents:
diff changeset
8 -----------------------
Sebastien Jodogne <s.jodogne@gmail.com>
parents:
diff changeset
9
258
Sebastien Jodogne <s.jodogne@gmail.com>
parents: 257
diff changeset
10 * Performance of joins in LookupResources: Create cached statement for
Sebastien Jodogne <s.jodogne@gmail.com>
parents: 257
diff changeset
11 LookupResources, that are grouped to search up to, say, 10 tags,
Sebastien Jodogne <s.jodogne@gmail.com>
parents: 257
diff changeset
12 instead of recompiling for each request
196
Sebastien Jodogne <s.jodogne@gmail.com>
parents:
diff changeset
13
Sebastien Jodogne <s.jodogne@gmail.com>
parents:
diff changeset
14 ---------------------
Sebastien Jodogne <s.jodogne@gmail.com>
parents:
diff changeset
15 Common - Storage area
Sebastien Jodogne <s.jodogne@gmail.com>
parents:
diff changeset
16 ---------------------
Sebastien Jodogne <s.jodogne@gmail.com>
parents:
diff changeset
17
Sebastien Jodogne <s.jodogne@gmail.com>
parents:
diff changeset
18 * Implement the "StoreDicom" option from the default filesystem
Sebastien Jodogne <s.jodogne@gmail.com>
parents:
diff changeset
19 storage area to run MySQL/PostgreSQL storage in index-only mode:
426
d700c8f9fc24 migration to UCLouvain servers
Sebastien Jodogne <s.jodogne@gmail.com>
parents: 371
diff changeset
20 https://orthanc.uclouvain.be/book/contributing.html
196
Sebastien Jodogne <s.jodogne@gmail.com>
parents:
diff changeset
21
259
Sebastien Jodogne <s.jodogne@gmail.com>
parents: 258
diff changeset
22 * Performance: Add a pool of connections to PostgreSQL/MySQL, as
Sebastien Jodogne <s.jodogne@gmail.com>
parents: 258
diff changeset
23 already done in the database index plugins
Sebastien Jodogne <s.jodogne@gmail.com>
parents: 258
diff changeset
24
360
Alain Mazy <am@osimis.io>
parents: 266
diff changeset
25 ----------
Alain Mazy <am@osimis.io>
parents: 266
diff changeset
26 PostgreSQL
Alain Mazy <am@osimis.io>
parents: 266
diff changeset
27 ----------
Alain Mazy <am@osimis.io>
parents: 266
diff changeset
28
Alain Mazy <am@osimis.io>
parents: 266
diff changeset
29 * reported issue to validate: uploading lots of files through HTTP with:
Alain Mazy <am@osimis.io>
parents: 266
diff changeset
30 - 1 client and IndexConnectionsCount==1 took 100s
Alain Mazy <am@osimis.io>
parents: 266
diff changeset
31 - 2 client and IndexConnectionsCount==2 took 600s (lots of transaction replayed)
Alain Mazy <am@osimis.io>
parents: 266
diff changeset
32
365
Alain Mazy <am@osimis.io>
parents: 364
diff changeset
33 * Seems Orthanc might deadlock when there are plenty of conflicting transactions:
Alain Mazy <am@osimis.io>
parents: 364
diff changeset
34 https://groups.google.com/g/orthanc-users/c/xQelEcKqL9U/m/HsvxwlkvAQAJ
Alain Mazy <am@osimis.io>
parents: 364
diff changeset
35 https://groups.google.com/g/orthanc-users/c/1bkClfZ0KBA/m/s4AlwVh3CQAJ
196
Sebastien Jodogne <s.jodogne@gmail.com>
parents:
diff changeset
36
Sebastien Jodogne <s.jodogne@gmail.com>
parents:
diff changeset
37 -----
Sebastien Jodogne <s.jodogne@gmail.com>
parents:
diff changeset
38 MySQL
Sebastien Jodogne <s.jodogne@gmail.com>
parents:
diff changeset
39 -----
Sebastien Jodogne <s.jodogne@gmail.com>
parents:
diff changeset
40
266
cc7af42d4f23 Store revisions for metadata and attachments in PostgreSQL
Sebastien Jodogne <s.jodogne@gmail.com>
parents: 259
diff changeset
41 * Store revisions for metadata and attachments in MySQL (this is
cc7af42d4f23 Store revisions for metadata and attachments in PostgreSQL
Sebastien Jodogne <s.jodogne@gmail.com>
parents: 259
diff changeset
42 already implemented in PostgreSQL)
cc7af42d4f23 Store revisions for metadata and attachments in PostgreSQL
Sebastien Jodogne <s.jodogne@gmail.com>
parents: 259
diff changeset
43
196
Sebastien Jodogne <s.jodogne@gmail.com>
parents:
diff changeset
44 * MySQL performance => implement GlobalProperty_GetTotalSizeIsFast:
Sebastien Jodogne <s.jodogne@gmail.com>
parents:
diff changeset
45 https://groups.google.com/d/msg/orthanc-users/kSR4a110zDo/D7e4ITR8BwAJ
258
Sebastien Jodogne <s.jodogne@gmail.com>
parents: 257
diff changeset
46
Sebastien Jodogne <s.jodogne@gmail.com>
parents: 257
diff changeset
47 * Add index to speed up wildcard search, as already done in PostgreSQL:
Sebastien Jodogne <s.jodogne@gmail.com>
parents: 257
diff changeset
48
Sebastien Jodogne <s.jodogne@gmail.com>
parents: 257
diff changeset
49 - https://dev.mysql.com/doc/refman/5.5/en/fulltext-search.html +
Sebastien Jodogne <s.jodogne@gmail.com>
parents: 257
diff changeset
50 ALTER TABLE table ADD FULLTEXT index_name(column1);
Sebastien Jodogne <s.jodogne@gmail.com>
parents: 257
diff changeset
51
Sebastien Jodogne <s.jodogne@gmail.com>
parents: 257
diff changeset
52 - https://dev.mysql.com/doc/refman/8.0/en/index-btree-hash.html