Get the latest tech news
Uber Migrates 1T Records from DynamoDB to LedgerStore to Save $6M Annually
Uber migrated all its payment transaction data from DynamoDB and blob storage into a new long-term solution, a purpose-built data store named LedgerStore. The company was looking for cost savings and had previously reduced the use of DynamoDB to store hot data (12 weeks old). The move resulted in significant savings and simplified the storage architecture.
Kaushik Devarajaiah, tech lead at Uber, explains the unique challenges of creating a bespoke data store: Additionally, Uber implemented offline validation for historical data, coupled with the incremental backfill job running in Apache Spark. Lastly, the team took a conservative approach towards the rollout and adopted a fallback to fetching the data from DynamoDB in case it wasn’t found in LedgerStore.
Or read this on Hacker News