Serverless Data Lake Project
What is a Data Lake? In today’s data-driven world, organisations deal with massive volumes of structured and unstructured data coming from various sources. To manage, store, and analyse this diverse data efficiently, Data Lakes have emerged as a flexible and scalable solution. A Data Lake is a centralised repository that allows you to store all your data — structured, semi-structured, and unstructured — at any scale. You can store your data as-is, without having to structure it first, and run different types of analytics — from dashboards and visualisations to big data processing, real-time analytics, and machine learning — to guide better decisions . While traditional data lakes often require managing servers , storage and complex pipelines, a Serverless Data Lake takes this a step further by removing the need to manage infrastructure. In this project I have implemented Serverless Data lake architecture using various AWS services th...