Auditing and Lineage

Auditing and Lineage

Data warehouse do not store data as it is created. OLTP databases are populated as business occurs. Source and purpose of data is generally self-explanatory. Data in the OLTP is added as the business occurs.

So when a transection occurs the data is populated into the database, that data is self-explanatory. Meaning one column called product_name is the explanation of itself. Anyone can understand for the name of column.

Data warehouse are populated from the OLTP data. And we do not pull the whole data into the database, the data is pulled based upon some conditions, at every year, month etc. also the data is populated from various sources.

The data can also by informative base on different aspects, like the data itself, the source of the data, and volume of the data. As business grows, so as our data.

Auditing and Lineage identify theses aspects. We store the Auditing and lineage in the tables. Like who perform the transections, why did he do that, where and when was the transection happened. Because Lineage is the data about data, or also called meta data.