Skip to content

Parity — v0.1.0

How the emulator’s surface maps to Databricks’ public REST (Workspace, Jobs, Unity Catalog), and — the point of this table — whether real work happens or just the API shape.

A row is 🟢 Real only when an unmodified client drove the call and the attached engine or store actually did the work. Status without a witness is not support. See 00-doctrine.md.

Witnessed claims: 17. See witnesses.json.

SurfaceWhat would make it realStatus
Identity — PATSeeded/minted PAT; unknown / dev is 401🟢 Real
Identity — emulator OIDCClient-credentials → Me with no entra process🟢 Real
Identity — federated JWTOpt-in issuer list; unconfigured / wrong aud / expired is 401🟢 Real
Jobs 2.2 — notebook / PythonAttached Spark engine executes the file🟢 Real (engine attached)
Jobs 2.2 — JAR / dbt / DLT / sql_task.queryRefused at create🔴 refuse
Workspace files / notebooksFile-backed store, SDK / workspace-files round-trip🟢 Real
DBFS / Files APIReal bytes on a blob store🟢 Real
Secrets — Databricks-backedPersist under data/secrets/; GET rejected; {{secrets}} in job env and spark_conf; missing fails the run🟢 Real
Secrets — Azure Key Vault-backedLive read-through at use time; put/delete refused; rotate the vault secret and the next run sees it🟢 Real (vault attached)
Secrets — vault-audience tokenEntra client-credentials at https://vault.azure.net/.default sent on the vault GET🟢 Real (entra attached)
SQL warehousesSpark SQL, dialect named in the output🟢 Real (engine attached)
Clusters as VMs🔴 refuse
Clusters as session handleCreate starts a Sail session🟢 Real (engine attached)
Unity Catalog CRUDUC OSS sidecar🟢 Real (sidecar attached)
Unity Catalog grantsEnforcement, not allow-all CRUD🔴 refuse (not shipped until they deny)
Databricks ConnectSpark Connect🟢 Real (engine attached)
MCP — Databricks SQLSame SQL warehouse handler, behind PAT/OIDC🟢 Real (engine attached)
Terraform / DAB pairUnmodified databricks/databricks: current_user + notebook + workspace_file + job; token=dev refused🟢 Real
MCP — Genie / AI Search / UC functions🔴 refuse
Photon / DBR compatibility🔴 refuse
Lakeflow / DLT🔴 refuse
Model Serving / Vector Search / Dashboards🔴 refuse