Skip to main content

PostgreSQL

This section explains how to create, configure, and test a PostgreSQL data source in DataDios.

Steps to Create and Test a PostgreSQL Data Source​

Step 1: Create a Data Source​

  1. Navigate to the Data Sources tab in DataDios

  2. Click + CREATE DS

  3. From the list of available data source types, select PostgreSQL

    Choose PostgreSQL

Step 2: Fill Connection Details​

In the Connection Details form, provide the required parameters:

  • Group: (Optional) Grouping for data sources

  • Host: PostgreSQL host or IP address

  • Port: PostgreSQL port (default: 5432)

  • Username: PostgreSQL login username

  • Password: PostgreSQL login password

  • Database Name: Database to connect to

  • Schema: Target schema (leave blank to use the default schema)

  • Object Types: Choose whether to fetch tables, views, or both

  • Schedule Sync: Configure for metadata timeline synchronization (see Metadata Sync)

  • Secret Name: (Optional) Reference to secret stores (e.g., AWS Secrets Manager, Azure Key Vault)

    • JSON Structure
          {
             "group": "",
             "host": "198.168.1.1",
             "port": "1433",
             "service_type": "",
             "username": "sql-admin",
             "database": "QuickStart",
             "schema": "diff_test",
             "object_types": "",
             "password": "Admin@123"
          }

    PostgreSQL Connection Form

Step 3: Test Connection​

  1. After entering details, click Test Connection

  2. Ensure the connection is validated successfully

    Validate Connection

Step 4: Save Data Source​

  1. If the test succeeds, click Create to save the data source
  2. You will be redirected to the Datasource Listing Page, where the PostgreSQL data source will appear

Step 5: Explore Data Source Items​

  1. Expand the PostgreSQL data source to view all items (tables, views, etc.)

    List Items PostgreSQL

  2. To view metadata about any item:

    • Click the item name
    • Click the three stacked lines icon to open the Object Metadata pop-up

    PostgreSQL Metadata

  3. You can also explore additional features in the Metadata Explorer:

    • Object Data

      • View the actual data present in the selected resource (e.g., table rows or file details)

    • Graphs

      • Visualize dependencies and relationships across schemas
      • See how the item is connected to databases or other schema objects

    • Data Quality Rules

Best Practices​

  1. Use Secret Store for passwords to avoid hardcoding credentials
  2. Always Test Connection before saving to ensure configuration is correct
  3. Organize with Groups for easier management of multiple PostgreSQL data sources
  4. Leverage Schedule Sync to keep metadata timelines updated

For more details on configuring PostgreSQL with metadata sync, see the Metadata Timeline.