Project:
SIXT
How to build an infrastructure for big data analytics
Challenge
Solution
With the help of the RESULT team, SIXT decided to migrate to the AWS cloud and deploy infrastructure to deliver significantly more than on-premises infrastructure.
We implemented data capture from both relational databases and event-based data capture and integrated this data, which was not previously possible. We have provided end-users with near real-time analytics and data capture from a central data warehouse in various ways (APIs, SQL query, and others).
The new infrastructure also enabled self-service analytics, which gave business departments complete freedom to design their dashboards, was able to analyse data in near real-time and connect them to data from local platforms, which was also not possible before.
TECHNOLOGIES USED
| Apache Airflow | Apache Kafka | Apache Nifi | API Gateway | Athena | AWS services | Bitbucket pipelines | Docker | DynamoDB | EC2 | ECR | ECS | Glue | Java | Kinesis | Lambda | Python | Quicksight | S3 | Terraform | VPC |
Result
With cloud infrastructure, users have more access to data fully customised to their needs.