Volume : 5, Issue : 8, August - 2016

Data Transformation Complexity and Proposed Solution

Mitul Tripathi, Dr. Pravin Metkewar

Abstract :

<p>&nbsp;In Today&rsquo;s Scenario, as lot of complexities emerge in business, as different approaches companies or individual are adopting to store the data in data warehouse as the approach is different it leads to lot of problem while integrating these different type of data and ing them into common platform, So that they can be on same page and can be understood and evaluated. Transformation includes various mathematical algorithms and process to transform the data into some predefined structure or format. Here the Integration part comes. Integration, is a process of amalgamation of two structure following common attribute. Before Moving to Actual Transformation we need to know, what is the Architecture of Data-warehouse, how data get transformed? Data get fetched from different data sources which is situated in different location and store into the staging area which is also known as ETL layer where all the logic and algorithm is implemented on data and all the transformed data get store in the Operation Data-Source. There can be two different scenario. First, Data which is store in Operational Data Source, Data mart will be created based on this through ETL and then through Data Mart, Data Warehouse should be created. Here I am going to propose solution for removing processing time and reduce complexity while transforming data from one base language/ format to another.</p>