How to build an infrastructure for big data analytics
With the help of the RESULT team, SIXT decided to migrate to the AWS cloud and deploy infrastructure to deliver significantly more than on-premises infrastructure.
We implemented data capture from both relational databases and event-based data capture and integrated this data, which was not previously possible. We have provided end-users with near real-time analytics and data capture from a central data warehouse in various ways (APIs, SQL query, and others).
The new infrastructure also enabled self-service analytics, which gave business departments complete freedom to design their dashboards, was able to analyse data in near real-time and connect them to data from local platforms, which was also not possible before.
| Apache Airflow | Apache Kafka | Apache Nifi | API Gateway | Athena | AWS services | Bitbucket pipelines | Docker | DynamoDB | EC2 | ECR | ECS | Glue | Java | Kinesis | Lambda | Python | Quicksight | S3 | Terraform | VPC |
With cloud infrastructure, users have more access to data fully customised to their needs.