Spice Catalog Connectors

Catalog connectors expose external data catalogs for federated SQL queries, preserving the source schema hierarchy.

Basic Configuration

catalogs:

• from: <connector> name: <catalog_name> params:

  connector-specific parameters

  include:
  • 'schema.*' # optional: filter tables

Supported Catalogs

Connector From Format Description

unity_catalog

unity_catalog

Databricks Unity Catalog

databricks

databricks

Databricks with Spark Connect

iceberg

iceberg

Apache Iceberg catalogs

spice.ai

spice.ai

Spice.ai Cloud Platform

glue

glue

AWS Glue Data Catalog

Examples

Unity Catalog

catalogs:

• from: unity_catalog name: unity params: unity_catalog_endpoint: https://my-workspace.cloud.databricks.com databricks_token: ${ secrets:DATABRICKS_TOKEN } include:
  • 'my_schema.*'

Iceberg with S3

catalogs:

• from: iceberg name: iceberg_catalog params: iceberg_catalog_type: rest iceberg_rest_uri: https://my-iceberg-catalog.com

Spice.ai Platform

catalogs:

• from: spice.ai name: spiceai include:
  • 'tpch.*'

Querying Catalog Tables

Tables are accessed using the full path: <catalog>.<schema>.<table>

SELECT * FROM unity.my_schema.customers LIMIT 10;

Include Patterns

Filter which tables to expose using glob patterns:

include:

• 'prod_schema.*' # all tables in prod_schema
• '*.customers' # customers table in any schema
• 'analytics.sales_*' # tables starting with sales_ in analytics

Documentation

• Catalog Connectors Overview

• Catalogs Reference