Skip to main content
Version: Next

Sinks

Sinks are destinations for metadata.

In general, the sink will be defined in the recipe after the source like below.

source: ...

sink:
  type: <sink_type>
  config: ...

Types of Sink​

When configuring ingestion for DataHub, you're likely to be sending the metadata to DataHub over either one of the following.

Default Sink​

Since acryl-datahub version >=0.8.33.2, the default sink is assumed to be a datahub-rest endpoint.

  • Hosted at "http://localhost:8080" or the environment variable ${DATAHUB_GMS_URL} if present
  • With an empty auth token or the environment variable ${DATAHUB_GMS_TOKEN} if present.

If you want to override the default endpoints, you can provide the environment variables as part of the command like below:

DATAHUB_GMS_URL="https://my-datahub-server:8080" DATAHUB_GMS_TOKEN="my-datahub-token" datahub ingest -c recipe.dhub.yaml