Harvester

Example data

If you'd like a large dataset for performance testing and benchmarking, note that dumps of public metacatalog are available in Data Export documentation.

Tests

To run the tests, install the [dev] requirements in your virtualenv (cf the installation section), then run pytest:

pip install -e .[dev]
pytest

Note

By default, the tests use a Docker Compose environment (using ./docker-compose.yml and ./harvester/tests/docker-compose-geovisio.yml) to set-up a temporary stack. You can also spawn the docker compose on you own, then run the tests using the external docker compose used. This can speed up greatly the tests:

docker compose -f docker-compose.yml -f harvester/tests/docker-compose-geovisio.yml up -d --wait

# run pytest telling it where to find all services
pytest \
    --external-geovisio-instance-1-url=http://localhost:5101 \
    --external-geovisio-instance-2-url=http://localhost:5102 \
    --external-api-url http://localhost:9000 \
    --external-db-url postgresql://username:password@localhost:5439/panoramax \
    --external-geovisio-instance-1-token-url http://localhost:5111 \
    --external-geovisio-instance-2-token-url http://localhost:5112 \
    -vv -s

Format

All files should be formated using ruff:

ruff format