There is an ever greater need in the Business Intelligence environment to have the information in the shortest time possible, data generation cycles getting shorter and updating of data in near real time. There is talk of 'Operational Business Intelligence (OBI)' and 'Real Time Decision Support'.
It is critical to reaching operational data analytic environments in shortest possible time. There is a need for a 'Real Time Data Integration'.
In the optimization of these data integration processes, we must consider both the usual source data (ERP's, CRM's, operating systems, databases, flat files, Excel, XML, etc. ..) and other from more immediate nature such as messaging queues and on-line information accessed via Web services or RSS.
A technology that is allowing shorten these data integration cycles is the CDC technology (Change Data Capture). This technology captures and stores the changes that occur in source systems in real time. In this way, ETL (Extract, Transform and Load) for providing the data warehouse or ODS (Operational Data Store) only have access to change data, streamline processes, avoid overloading servers and drastically reducing the volume of data processed and dumped in these processes. This way they will never access to the master tables (except for initial loading) thus reducing the windows of execution of batch processes and avoiding failure due to massive data dumps.
On the other hand, performed a control register of previously synchronized data .
There are integrated planners that propagates changes periodically. CDC tools market usually offer easy integration with ETL tools market, so that their integration into the BI platform is not expensive.
It is therefore a technology that takes a step towards 'Operational Business Intelligence'.
