RSS Amplifier

Home on Matthew Campbell — Hyperworks · Feb 24, 2017

Distributed Timeseries Database in Go

0
Sign in to vote or save

hyperworks.nu

Speaking

GopherCon India · 2017 · India

goprometheustimeseriescassandrakafka

GopherCon India 2017

Deep dive into Vulcan, DigitalOcean’s Prometheus-compatible distributed timeseries database written in Go.

Outline (from the deck)

  • Why Go for NoSQL/NewSQL (Prometheus, Cockroach, Influx, etcd…)
  • Timeseries properties: write-heavy, compressible, lossy-friendly
  • From hash-sharded Prometheus to a pipelined microservice architecture
  • Kafka ingestion, Cassandra/chunk storage, schema evolution (V1 series → V2 chunks + index)
  • In-memory query engine and downsampling
  • Hard numbers we designed for: multi-Gbit/s, 100k writes/s, tens of TB

Links

Read the original on hyperworks.nu

Comments

Nothing yet. Say the first thing.

    Sign in to join the conversation.