Post Bank has implemented a large-scale project to refactor a corporate data warehouse (CDW). It consisted of a complete redesign of the architecture, the creation of an operational data layer and its unified model, and the alignment of the Data Governance processes.
As a result, calculation performance in QCD has increased, QCD algorithms have been unified, financial costs have been reduced, and data relevance and security have increased. The overall quality of data in QCD and other systems has been significantly improved, leading to better customer service.
During the project, the Post Bank team, with the support of Philosophy.IT (part of the Digital Economy League), created a qualitatively new QCD architecture that allows it to receive data from key source systems online and provides incremental updates to all layers. storage. . At the same time, the old QCD was also being developed, containing huge amounts of legacy code accumulated over more than five years of history.
“For the bank’s competitiveness, the speed of introduction of new products and scaling systems is important, first of all. Therefore, the need for a modern and productive data warehouse is ever increasing. The term data-driven is very popular today, but you won’t become a data-driven enterprise by simply amassing volumes of data or deploying ad hoc loads as tasks arise. Without a reliable database, data analysts can spend up to 80% of their time preparing data instead of analyzing it,” says Vasily Korol, Chief Data Officer at Post Bank.
According to the expert, work in this direction is productive only when the foundations are built: the processes of collection, cleaning, unification, storage, management and use of the entire volume of data generated are refined. “At the same time, the project to build such a foundation is always difficult and long, especially if you implement it in a “live” system, in constant operation, on which all company processes depend. But it is in our power to make it effective”, says Vasily Korol.
Firstly, a concept for the development of data management at Post Bank was developed and agreed upon. As part of this concept, a complete corporate storage change management cycle was built, which affected interaction both within the team and with contractors and customers. A hybrid system for the implementation of tasks and projects (scrum and waterfall) was built, which allowed to achieve a high regularity of QCD releases (at least once every two weeks) without significant loss of quality.
A data quality control system was implemented and rules for interaction with source systems were introduced and agreed upon. Transferred QCD monitoring system to robotic software (push notifications, automated calls). In the new architecture, an operational layer (a block of showcases for receiving systems) and a QCD analytical layer (where a unified data model has been introduced and is being developed) have been created. A role model for access to BI reports and storage data has been implemented.
QCD’s performance and reliability parameters have been improved, development and support costs have been reduced, and the total cost of ownership has been reduced. Speed of calculation and provision of information to business customers has been increased (most key storefronts are ready by 8am the day after the report). Stricter SLAs were achieved both in terms of availability speed and data quality.
Regarding technical, process and architecture aspects, a transition to incremental calculations was made, data and business processes were deduplicated. In addition, the resource-intensive key functionality of the user’s financial vault was transferred to a new unified data storage system.
Three previous days (weekends and Monday) the American Fund did not work. The S&P500 closed higher on Friday. Pay attention to the structure of the price movement on the chart. There is an interesting…
Many Russians order a variety of products on Aliexpress. Some for themselves, some for resale. Someone constantly and a lot (this is practically “Aliexpressholics”), someone once a year…
Looking for a high-quality DVR with a radar detector in 2022, you could not overlook the DaoCam Combo model from a well-known Russian brand that has already established itself as a reliable…
I went upstairs, into the tank! Even higher is the observation deck on the roof. One of the brilliant prints was a street artist’s circular work on the events of recent history. At first it seems that…
Before reading, those who are interested can read the first two paragraphs of this article. They contain information about the composition of our “family tourist group”, about what kind of preparation for the family…
We will talk about unusual residential buildings in the Moscow district of Chertanovo. The longest building in Moscow is located at the address: Varshavskoe shosse, 125. The famous “lying skyscraper”, also known as the “arch …
Source: IXBT
