Skip to main content

Documentation Index

Fetch the complete documentation index at: https://openmetadata-feat-feat-2mbfixdeploy.mintlify.app/llms.txt

Use this file to discover all available pages before exploring further.

In this section, we provide guides and references to use the Flink connector. Configure and schedule Flink metadata and profiler workflows from the OpenMetadata UI:

​
Requirements

​
Python Requirements

We have support for Python versions 3.9-3.11
To run the Flink ingestion, you will need to install: 
pip3 install "openmetadata-ingestion[flink]"

​
Metadata Ingestion

​
1. Define the YAML Config

This is a sample config for Flink:

​
2. Run with the CLI

First, we will need to save the YAML file. Afterward, and with all requirements installed, we can run: 
metadata ingest -c <path-to-yaml>
Note that from connector to connector, this recipe will always be the same. By updating the YAML configuration, you will be able to extract metadata from different sources.