Distributed scaling with Relational Databases
Background A lot of articles will talk about how to scale databases. Typically, they will talk about the purpose and the general idea of sharding and »
Local Secondary Index vs. Global Secondary Index
Secondary Index A secondary index is used in databases to help speed up queries when we want to grab data from popular columns or if we »
Sharding User IDs of Celebrities
Problem When you are partitioning (or sharding) database writes across multiple nodes based on a User ID, a typical partitioning algorithm is to use a basic »
Working with Production at Amazon Retail Website
A short background Prior to working at Amazon, I was developing software at a couple of startups, mostly working with products that were in the conceptual »
Big Data Processing: Batching vs. Streaming
Intro In data processing, we often have to work with large amounts of data. The way in which this data is gathered comes in a few »