Mercurial > hg > orthanc-tests
view PerfsDb/README.md @ 612:575aa420f866
fix worklist tests for python2
author | Alain Mazy <am@osimis.io> |
---|---|
date | Thu, 01 Feb 2024 09:41:57 +0100 |
parents | 705fa4447154 |
children |
line wrap: on
line source
Performance Db tests ==================== Introduction ------------ This project performs benchmark tests of Orthanc with its various DB servers. It can be used to: - compare DB servers performance - compare performance between small and big DB - test the effectiveness of some code refactoring In a first step, the project creates a set of DB servers and populates them. Then, it will perform a set of basic operations on Orthanc with each of these servers and measure the time required for each operation. Timings are measured at the API level. Since we want to measure mainly the DB performance, we'll mainly use very small DICOM files (without pixels data). Prerequisites ------------- - install standard tools ```bash sudo apt-get install -y mercurial wget curl ``` - install python3, pip3 and pipenv ```bash sudo apt-get install -y python3 python3-pip python3-venv ``` - [install Docker-CE](https://docs.docker.com/install/linux/docker-ce/ubuntu/#set-up-the-repository) - have access to docker without typing `sudo`. This is done by typing: `sudo groupadd docker` and `sudo usermod -aG docker $USER` - have Orthanc and its DB plugins natively installed or compiled on your host system Once all prerequisites are installed, you should always execute all commands from a python virtual-env. To initialize the virtual env the first time: ```bash python3 -m venv .env source .env/bin/activate pip install -r requirements.txt ``` To enter the virtual-env the next times (on benchmark VM): ```bash cd /data-hdd-3g/orthanc-tests/PerfsDb source .env/bin/activate ``` Initializing a DB before tests ----------------- ```bash on amazy PC: python Run.py --orthanc-path=/home/amazy/builds/orthanc-build-release/ --plugins-path=/home/amazy/builds/mysql-release/ --init --mysql-tiny on benchmark VM: python Run.py --orthanc-path=/data-hdd-3g/orthanc-binaries/ --plugins-path=/data-hdd-3g/orthanc-binaries/ --init --pg9bis-small ``` Clearing a DB ----------------- ```bash on amazy PC: python Run.py --orthanc-path=/home/amazy/builds/orthanc-build-release/ --plugins-path=/home/amazy/builds/mysql-release/ --clear --mysql-tiny on benchmark VM: python Run.py --orthanc-path=/data-hdd-3g/orthanc-binaries/ --plugins-path=/data-hdd-3g/orthanc-binaries/ --clear --pg9bis-small ``` Runing tests on multiple DBs ----------------- ```bash on amazy PC: python Run.py --orthanc-path=/home/amazy/builds/orthanc-build-release/ --plugins-path=/home/amazy/builds/orthanc-build-release/ --run --pg9-tiny --pg10-tiny --pg11-tiny --mysql-tiny --sqlite-tiny --mssql-tiny on benchmark VM: python Run.py --orthanc-path=/data-hdd-3g/orthanc-binaries/ --plugins-path=/data-hdd-3g/orthanc-binaries/ --run --pg9-tiny --pg10-tiny --pg11-tiny --mysql-tiny --sqlite-tiny --mssql-tiny ``` Command line options -------------------- ```bash --clear to clear the DB --init to initialize the DB --run to run the tests --config to include the config in the test run/init/clear --orthanc-path path to the folder where the Orthanc execuble lies --plugins-path path to the folder where the Orthanc plugins lie --test-filter=*ByPatient* to filter the tests to execute --repeat=20 to repeate each test N times (default is 20) ```