Helm Chart

Helm chart installation instructions

The Helm chart option separates the infrastructure and permission provisioning process from the dbnl platform deployment process, allowing you to manage the infrastructure, permissions and Helm chart using their existing processes.

For access to the Helm chart and to get registry credentials, please reach out to our team.

Prerequisites

The following prerequisite steps are required before starting the Helm chart installation.

Infrastructure

To successfully deploy the dbnl Helm chart, you will need the following infrastructure:

• A Kubernetes cluster (e.g. EKS, GKE).

  • An Ingress or Gateway controller (e.g. aws-load-balancer-controller, ingress-gce)

• A PostgreSQL database (e.g. RDS, CloudSQL).

• An object store bucket (e.g. S3, GCS) to store raw data.

• A Redis database (e.g. ElasticCache, Memorystore) to act as a messaging queue.

Configuration

To configure the dbnl Helm chart, you will need:

• A hostname to host the dbnl platform (e.g. dbnl.example.com).

• A set of dbnl registry credentials to pull the dbnl artifacts (e.g. Docker images, Helm chart).

• An RSA key pair to sign the personal access tokens.

An RSA key pair can be generated with:

openssl genrsa -out dbnl_dev_token_key.pem 2048

Requirements

To install the dbnl Helm chart, you will need:

• Install kubectl and set the Kubernetes cluster context.

• Install helm.

Permissions

For the services deployed by the Helm chart to work as expected, they will need the following permissions and network accesses:

• api-srv

  • Network access to the database.

  • Network access to the Redis database.

  • Permission to read, write and generate pre-signed URLs on the object store bucket.

• worker-srv

  • Network access to the database.

  • Network access to the Redis database.

  • Permission to read and write to the object store bucket.

Installation

The Helm chart can be installed directly using helm install or using your chart release management tool of choice such as ArgoCD or FluxCD.

Steps

The steps to install the Helm chart using the Helm CLI are as follows:

1. Create an image pull secret with the your dbnl registry credentials.

kubectl create secret docker-registry dbnl-docker-cfg \
    --docker-server="us-docker.pkg.dev/dbnlai/images" \
    --docker-username="${DBNL_REGISTRY_USERNAME}" \
    --docker-password="${DBNL_REGISTRY_PASSWORD}"

1. Create a minimal values.yaml file.

imagePullSecrets:
  - name: dbnl-docker-cfg
  
auth:
  # For more details on OIDC options, see OIDC Authentication section.
  oidc:
    enabled:   true
    issuer:    oidc.example.com
    audience:  xxxxxxxx
    clientId:  xxxxxxxx
    scopes:    "openid email profile"

db:
  host: db.example.com
  port: 5432
  username: user
  password: password
  database: database

redis:
  host: redis.example.com
  port: 6379
  username: user
  password: password

ingress:
  enabled: true
  api:
    host: dbnl.example.com
  ui:
    host: dbnl.example.com

storage:
  s3:
    enabled: true
    region: us-east-1
    bucket: example-bucket

1. Log into the dbnl Helm registry.

helm login \
    --username ${DBNL_REGISTRY_USERNAME} \
    --password ${DBNL_REGISTRY_PASSWORD} \
    us-docker.pkg.dev/dbnlai/charts

1. Install the Helm chart.

helm upgrade \
    --install \
    -f values.yaml \
    dbnl oci://us-docker.pkg.dev/dbnlai/charts/dbnl

Options

For more details on all the installation options, see the Helm chart README and values.yaml files. The chart can be inspected with:

helm show all oci://us-docker.pkg.dev/dbnlai/charts