UK EO Data Hub Platform: ResourceCatalogue-FastApi Component

This component is the initial implementation of an API to allow interaction with Stac-FastAPI within the EO Data Hub. This repository provides a FastApi application manages items within a user's workspace and sends Pulsar messages to ingest STAC items into the platform. It also contains middleware which authenticates the incoming requests using an OPA client. Access to a workspace is only provided if the username of the requesting user is authorised to access a workspace.

Note swagger static files are available in the swagger-ui repo.

Development of this component

Run the server locally

This application uses a uvicorn server to run the FastApi application, you can initiate this server locally using the below command:

uvicorn resource_catalogue_fastapi:app --reload

This application also requires access to an OPA client via URL, which can be provided using the following environment variable:

OPA_SERVICE_ENDPOINT

Other environment variables which should be set in order to run the server correctly include:

WORKSPACES_DOMAIN
WORKSPACE_DATA_BUCKET
AIRBUS_DATA_BUCKET
PULSAR_URL

Getting started

Prerequisites

Install the uv package manager by following the official documentation.

Install via makefile

make setup

This will create a Python virtual environment, install the Python and Node dependencies and install pre-commit.

It's safe and fast to run make setup repeatedly.

After make setup you can run pre-commit to run pre-commit checks on staged changes and pre-commit run --all-files to run them on all files. This replicates the linter checks that run from GitHub actions.

Building and testing

This component uses pytest tests and the ruff and black linters. black will reformat your code in an opinionated way.
When testing this module, you need to ensure you have unset the environment variable ENABLE_OPA_POLICY_CHECK, or set it to true: export ENABLE_OPA_POLICY_CHECK=true, so ensure the policy is checked when testing.

A number of make targets are defined:

• make test: run tests continuously
• make testonce: run tests once
• make lint: lint and reformat
• make dockerbuild: build a latest Docker image (use make dockerbuild VERSION=1.2.3` for a release image)
• make dockerpush: push a latest Docker image (again, you can add VERSION=1.2.3) - normally this should be done only via the build system and its GitHub actions.

Backend subprocess exited when trying to invoke get_requires_for_build_wheel
Failed to parse /.../template-python/pyproject.toml

then install and run validate-pyproject pyproject.toml and/or pip3 install . to check its syntax.

To check for vulnerable dependencies, run pip-audit.

Releasing

Ensure that make lint and make test work correctly and produce no further changes to code formatting before continuing.

Releases tagged latest and targeted at development environments can be created from the main branch. Releases for installation in non-development environments should be created from a Git tag named using semantic versioning. For example, using

• git tag 1.2.3
• git push --tags