Leveraging Improved Speed & Immutability of a Data Lake
An automobile insurance company
A cumbersome and slow Enterprise Data Warehouse (EDW) solution which adhered to a stringent set of schemas. The company needed a way to ingest data from various sources & house it in an easily accessible repository. Following this, they also needed to transform the data, storing business-critical metrics & KPIs in data marts, which would then be utilized by business users for analytics, visualization, & advanced data science activities.
- Very slow existing system; updating dashboards would take upwards of 19 hours
- Not easily accessible, required business users to perform multiple complex joins to find the right attributes
- Very strict schema; unable to adapt to the dynamic schemas inherent in the sources
- Difficulty in maintenance