The objective is “to establish common rules of the game for all credit institutions and payment service providers”.

We participated in the process of setting the functional requirements in terms of the products affected, customers (natural persons), level of application (at the “account” level) to ensure proper project execution. With that starting point, we carried out the analysis of the entity’s information platform to determine how to extract the information necessary for the report, requesting the necessary information that does not exist at source. To ensure that the information is correct and necessary for the report, sampling or sets of information specimens are taken with the users.

In the project context, the transformation is also modelled and implemented in PowerCenter, for development of the modelling processes to enable the commercial product, customer, commissions associated with each product in the application period, interest charged and paid, interest rates to be obtained, as well as the loading and extraction of information that is not on the platform. Our team creates final tables and defines the output and reporting structure. 

To ensure the performance of the developments, a recovery of the entire volume of information associated with an account (several customers associated with it) in one year needs to be addressed. Similarly included within the scope of the collaboration are the necessary technical and functional documentation for the developments, the execution of comprehensive testing, test documentation and troubleshooting.

Transfer of the information is carried out by consolidating the information obtained and it is loaded in final tables, downloading information from final table to flat file for transfer. Exploitation of the information is finalised in MicroStrategy with availability of information detail for customer queries, as well as the creation of reports for exploitation of the information in reporting.

A state-of-the-art solution was implemented, reducing development time in the process of developing new analytics and algorithms by the user, proposing an App in which the user has a catalogue of functions to use and can combine them to form a pipeline with the processing they want. 

Our fully compatible architecture uses Docker and Kubernetes (OpenShift) containers to enable horizontal scaling based on microservices that expose the data through various APIs and with a scalable, document-based database to solve the problem of the mutability of data sets and concurrency. Persistence is based on indexing the information; we performed code refactoring using atomisation and parametrisation of functions, and for DevOps scopes, deployment pipelines are created and configured.

The main technologies applied are: Python, django, Apache Airflow, mongoDB, PostgreSQL, and RabbitMQ as the messaging protocol.