Having it all: virtual and materialized data products

We want it all: low-latency updates completeness over time, variables, and vertical dimensions access speed for time-series and map-style reads But when your data is 14 PB and 1 billion GRIB messages, making that dream a reality takes some work. Virtual Icechunk Zarrs are a key complement to our materialized (rechunked) Zarrs. Together they get us one step closer to the catalog of our dreams. We…