Skip to content

Dw lineage tool#43

Open
eri-adepoju wants to merge 3 commits intomainfrom
dw-lineage-tool
Open

Dw lineage tool#43
eri-adepoju wants to merge 3 commits intomainfrom
dw-lineage-tool

Conversation

@eri-adepoju
Copy link
Copy Markdown
Contributor

@eri-adepoju eri-adepoju commented May 5, 2026

Pull Request

Description

Adds Lakebridge Analyzer Lineage (Migration Accelerator, a Databricks App that ingests Lakebridge Analyzer reports, surfaces migration-complexity metrics, and renders interactive data lineage with export. Includes Databricks Asset Bundle wiring (databricks.yaml, app.yaml), Unity Catalog volume-backed storage config, a FastAPI backend, Next.js static frontend (built output in-repo for app packaging), and a root README with UC setup and deploy/run steps using placeholder volume paths suitable for any workspace.

The purpose is to enable customers and their patners with a visual tool to plan their migration based on dependencies.

Category

  • core-platform
  • data-engineering
  • data-governance
  • data-warehousing
  • genai-ml
  • launch-accelerator
  • workspace-setup

Type of Change

  • New project
  • Bug fix
  • Enhancement
  • Documentation

Project Details

Project Name: Lakebridge Analyzer Lineage (Migration Accelerator)

Purpose: Help teams assess ETL migration complexity and visualize lineage from Lakebridge-style analyzer inputs in a Databricks App, with per-user file isolation on UC volumes and documented bundle deploy/run flows.

Technologies Used: Python 3.11+, FastAPI, Uvicorn, Databricks Apps, Databricks CLI / Asset Bundles, Unity Catalog (volumes), Next.js (static export), setuptools CLI entry points, pinned requirements.txt / setup.py

Testing

  • Code runs without errors
  • Documentation is complete
  • Used only synthetic data

Security Compliance ✅

  • No customer data, PII, or proprietary information
  • No credentials or access tokens
  • Only synthetic data used
  • Third-party licenses acknowledged

By submitting this PR, I confirm I have followed the CONTRIBUTING.md guidelines and security requirements.

…ration

- Replace frontend components, configuration files, and related assets with prebuilt files.

- Updated app.yaml to include command for running the application with uvicorn.
- Changed version in setup.py to 1.0.0 for the new release.
@eri-adepoju eri-adepoju marked this pull request as ready for review May 5, 2026 23:46
@eri-adepoju eri-adepoju requested a review from annasviri May 5, 2026 23:47
@annasviri annasviri requested a review from pedrozanlorensi May 6, 2026 14:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant