Recent content on Jin Cong Ho | ML & Analytics with HPC
In this post, we’ll dig into the internal designs of binary encoding for JSON . There’s been little discussion of the trade-offs these encodings make. We’ll see how even a straightforward binary encoding can materially improve retrieval performance.
Yellowbrick: An Elastic Data Warehouse on Kubernetes, 2024 VLDB 1 Key Design Yellowbrick Data Warehou delivers efficient, scalable and resilient data warehousing in public clouds and in private data centers. 2 Architecture Storage is separated from compute and data is persisted in object storage as column-oriented, compressed files known as shards. Microservices Architectrue Deployment Approach 3…
Amazon Redshift and the Case for Simpler Data Warehouses, 2015 SIGMOD 1 Key Design Redshift is a fast, fully managed, petabyte-scale data warehouse solution that makes it simple and cost-effective to efficiently analyze large volumes of data. It uses familiar data warehousing techniques, including columnar layout, per-column compression, co-locating compute and data, co-locating joins, compilation…
ClickHouse - Lightning Fast Analytics for Everyone, 2024 PVLDB ClickHouse is an OLAP database designed for high-performance analytics over petabyte-scale data sets with high ingestion rates. 1 Key Design ClikcHouse is designed to address 5 key challenges of modern analytical data management: Huge data sets with high ingestion rates Many simultaneous queries with an expectation of low latencies:…
The Snowflake Elastic Data Warehouse, 2016 ACM 1 Key Design Snowflake is an enterprise-ready data warehousing solution for the cloud . Cloud promises increased economies of scale, extreme scalability and availability and a pay-as you go cost model — but it can only be captured if the software itself is able to scale elastically over the pool of commodity resources in the cloud. Meanwhile, Saas…
Systems Components Data Lakehouse Lakehouse: A New Generation of Open Platforms that Unify Data Warehousing and Advanced Analytics Petabyte-Scale Row-Level Operations in Data Lakehouses Data Warehouse The Snowflake Elastic Data Warehouse ClickHouse - Lightning Fast Analytics for Everyone Amazon Redshift and the Case for Simpler Data Warehouses Yellowbrick: An Elastic Data Warehouse on Kubernetes…