What is Data Lineage vs Data Provenance?

What is Data Lineage vs Data Provenance?

Introduction: The Trust Deficit

Imagine an executive presenting a critical financial dashboard to the board of directors. The dashboard shows that profits dropped. A board member asks a simple question: “Where exactly did this number come from?”

If the data team cannot trace that number backward through database tables, ETL pipelines, and raw CSV files to its origin, the data is hard to trust. In heavily regulated industries (like banking or healthcare), the inability to show the origin of a metric can lead to regulatory penalties.

This requirement for traceability is satisfied by two closely related, but distinct, Data Governance concepts: Data Lineage and Data Provenance.

Data Lineage: The Map of Movement

Data Lineage answers the question: “How did the data get here, and what happened to it along the way?”

Data Lineage focuses on the physical journey and transformation of data through the enterprise architecture. It is usually visualized as a branching graph (a Directed Acyclic Graph, or DAG).

If you look at the lineage of a “Total Revenue” column in a dashboard, the graph will show:

1. The Source: It originated in the Salesforce.Orders table.
2. The Extraction: An Airflow job copied it to an Amazon S3 raw bucket.
3. The Transformation (dbt): A dbt SQL script joined it with the Stripe.Payments table and filtered out refunded orders.
4. The Destination: It was materialized into the Lakehouse.Gold_Revenue table.
5. The Consumer: It is currently being read by 3 different Tableau dashboards.

Lineage is critical for Impact Analysis. If a data engineer wants to delete or change the Salesforce.Orders table, they look at the lineage graph to see which downstream Tableau dashboards will break if they make that change.

Data Provenance: The Certificate of Authenticity

Data Provenance answers the question: “Who created this data, when, and under what authority?”

While Lineage focuses on the engineering pipeline (the How), Provenance focuses on the historical metadata and ownership (the Who and Why). It is the historical “chain of custody.”

If you look at the provenance of the same “Total Revenue” dataset, it will show:

1. Authorship: The raw data was generated by the Salesforce API v2.1 on May 14, 2026, at 09:00 AM UTC.
2. Ownership: The dataset is owned by “Jane Doe, VP of Sales.”
3. Quality Metrics: When it was ingested, it passed its automated Data Quality checks.
4. Security Classification: It contains PII (Personally Identifiable Information) and is governed by GDPR rules.

Provenance is critical for Regulatory Auditing. When regulators audit a machine learning model that denied a customer a loan, provenance provides the documentation showing who provided the training data and supports the review of whether that data was biased.

Implementing Lineage and Provenance

Historically, lineage and provenance were tracked manually in large Excel spreadsheets, which quickly became outdated.

Today, much of this tracking is automated using Active Metadata tools (like Alation, Collibra, or open-source tools like DataHub and Marquez). As data moves through the modern Lakehouse, the orchestration tools (Airflow) and transformation tools (dbt) automatically emit metadata events. The governance platform listens to these events, draws the lineage maps, and updates the provenance records as events arrive.

Furthermore, Open Table Formats like Apache Iceberg provide foundational provenance by maintaining a history of table versions (Snapshots) for each change made to the table, until old snapshots are expired.

Conclusion

Data Lineage and Data Provenance are the foundational pillars of enterprise data trust. Lineage provides the engineering map necessary to debug pipelines and prevent breaking changes, while Provenance provides the historical chain of custody necessary for legal compliance and executive confidence. Together, they ensure that an organization’s data remains transparent, reliable, and auditable from its raw origin to the final executive dashboard.

Learn More

To learn more about the Data Lakehouse, read The Lakehouse Built for Everyone by Alex Merced. You can find this and other books by Alex Merced at books.alexmerced.com.