BigQuery is Google’s fully managed, NoOps, low cost data analyticsservice. With BigQuery you have no infrastructure to manage and don’t need a database administrator, use familiar SQL and can take advantage of pay-as-you-go model. This collection of features allows you to focus on analyzing data to find meaningful insights. BigQuery is a powerful Big Data analytics platform used by all types of organizations, from startups to Fortune 500 companies.
Amazon Aurora: 5 times faster than Mysql
Q: What does “five times the performance of MySQL” mean?
Amazon Aurora delivers significant increases over MySQL performance by tightly integrating the database engine with an SSD-based virtualized storage layer purpose-built for database workloads, reducing writes to the storage system, minimizing lock contention and eliminating delays created by database process threads. Our tests with SysBench on r3.8xlarge instances show that Amazon Aurora delivers over 500,000 SELECTs/sec and 100,000 updates/sec, five times higher than MySQL running the same benchmark on the same hardware. Detailed instructions on this benchmark and how to replicate it yourself are provided in the Amazon Aurora Performance Benchmarking Guide.
Postgres: Horizontalal Sharding
How should I shard my databases?
This is entirely dependent on the access patterns of your application. A good rule, though, is to look at your indexes. If every query goes through an index on
:user_id, then chances are that you should shard on:user_id. If half of your queries go through:user_idand the other half go through:job_id, then you may need to create two sets of shards, each with its own model, and have your application write to both.
Tuning Filesystem for Postgres (page 63/101)
Turns out default ZFS block size is 128 Kb, and Postgres page size is 8K
Every small write that touched a page, had to write 128 Kb of a ZFS block to the disk
This may be good for huge sequential writes, but not for random access, lots of tiny writes