omnisketch

data structure for on-line agg of data into approximate sketch

Overview

Package	Version	Category	License	Language
`omnisketch`	`1.0.2`	FUNC	PostgreSQL	C

ID	Extension	Bin	Lib	Load	Create	Trust	Reloc	Schema
4640	`omnisketch`	No	Yes	No	Yes	No	Yes	-

Related	`ddsketch` `count_distinct` `tdigest` `topn` `datasketches` `hll`

Version

Type	Repo	Version	PG Ver	Package	Deps
EXT	PIGSTY	`1.0.2`	1817161514	`omnisketch`	-
RPM	PIGSTY	`1.0.2`	1817161514	`omnisketch_$v`	-
DEB	PIGSTY	`1.0.2`	1817161514	`postgresql-$v-omnisketch`	-

OS / PG	PG18	PG17	PG16	PG15	PG14
el8.x86_64	PIGSTY 1.0.2 el8.x86_64.pg18 : omnisketch_18 omnisketch_18-1.0.2-1PIGSTY.el8.x86_64.rpm PIGSTY · 1.0.2 · 20.4KiB	PIGSTY 1.0.2 el8.x86_64.pg17 : omnisketch_17 omnisketch_17-1.0.2-1PIGSTY.el8.x86_64.rpm PIGSTY · 1.0.2 · 20.4KiB	PIGSTY 1.0.2 el8.x86_64.pg16 : omnisketch_16 omnisketch_16-1.0.2-1PIGSTY.el8.x86_64.rpm PIGSTY · 1.0.2 · 20.4KiB	PIGSTY 1.0.2 el8.x86_64.pg15 : omnisketch_15 omnisketch_15-1.0.2-1PIGSTY.el8.x86_64.rpm PIGSTY · 1.0.2 · 20.4KiB	PIGSTY 1.0.2 el8.x86_64.pg14 : omnisketch_14 omnisketch_14-1.0.2-1PIGSTY.el8.x86_64.rpm PIGSTY · 1.0.2 · 20.4KiB
el8.aarch64	PIGSTY 1.0.2 el8.aarch64.pg18 : omnisketch_18 omnisketch_18-1.0.2-1PIGSTY.el8.aarch64.rpm PIGSTY · 1.0.2 · 20.3KiB	PIGSTY 1.0.2 el8.aarch64.pg17 : omnisketch_17 omnisketch_17-1.0.2-1PIGSTY.el8.aarch64.rpm PIGSTY · 1.0.2 · 20.4KiB	PIGSTY 1.0.2 el8.aarch64.pg16 : omnisketch_16 omnisketch_16-1.0.2-1PIGSTY.el8.aarch64.rpm PIGSTY · 1.0.2 · 20.4KiB	PIGSTY 1.0.2 el8.aarch64.pg15 : omnisketch_15 omnisketch_15-1.0.2-1PIGSTY.el8.aarch64.rpm PIGSTY · 1.0.2 · 20.4KiB	PIGSTY 1.0.2 el8.aarch64.pg14 : omnisketch_14 omnisketch_14-1.0.2-1PIGSTY.el8.aarch64.rpm PIGSTY · 1.0.2 · 20.3KiB
el9.x86_64	PIGSTY 1.0.2 el9.x86_64.pg18 : omnisketch_18 omnisketch_18-1.0.2-1PIGSTY.el9.x86_64.rpm PIGSTY · 1.0.2 · 20.1KiB	PIGSTY 1.0.2 el9.x86_64.pg17 : omnisketch_17 omnisketch_17-1.0.2-1PIGSTY.el9.x86_64.rpm PIGSTY · 1.0.2 · 20.1KiB	PIGSTY 1.0.2 el9.x86_64.pg16 : omnisketch_16 omnisketch_16-1.0.2-1PIGSTY.el9.x86_64.rpm PIGSTY · 1.0.2 · 20.1KiB	PIGSTY 1.0.2 el9.x86_64.pg15 : omnisketch_15 omnisketch_15-1.0.2-1PIGSTY.el9.x86_64.rpm PIGSTY · 1.0.2 · 20.1KiB	PIGSTY 1.0.2 el9.x86_64.pg14 : omnisketch_14 omnisketch_14-1.0.2-1PIGSTY.el9.x86_64.rpm PIGSTY · 1.0.2 · 20.1KiB
el9.aarch64	PIGSTY 1.0.2 el9.aarch64.pg18 : omnisketch_18 omnisketch_18-1.0.2-1PIGSTY.el9.aarch64.rpm PIGSTY · 1.0.2 · 20.3KiB	PIGSTY 1.0.2 el9.aarch64.pg17 : omnisketch_17 omnisketch_17-1.0.2-1PIGSTY.el9.aarch64.rpm PIGSTY · 1.0.2 · 20.2KiB	PIGSTY 1.0.2 el9.aarch64.pg16 : omnisketch_16 omnisketch_16-1.0.2-1PIGSTY.el9.aarch64.rpm PIGSTY · 1.0.2 · 20.2KiB	PIGSTY 1.0.2 el9.aarch64.pg15 : omnisketch_15 omnisketch_15-1.0.2-1PIGSTY.el9.aarch64.rpm PIGSTY · 1.0.2 · 20.2KiB	PIGSTY 1.0.2 el9.aarch64.pg14 : omnisketch_14 omnisketch_14-1.0.2-1PIGSTY.el9.aarch64.rpm PIGSTY · 1.0.2 · 20.2KiB
el10.x86_64	PIGSTY 1.0.2 el10.x86_64.pg18 : omnisketch_18 omnisketch_18-1.0.2-1PIGSTY.el10.x86_64.rpm PIGSTY · 1.0.2 · 20.2KiB	PIGSTY 1.0.2 el10.x86_64.pg17 : omnisketch_17 omnisketch_17-1.0.2-1PIGSTY.el10.x86_64.rpm PIGSTY · 1.0.2 · 20.2KiB	PIGSTY 1.0.2 el10.x86_64.pg16 : omnisketch_16 omnisketch_16-1.0.2-1PIGSTY.el10.x86_64.rpm PIGSTY · 1.0.2 · 20.2KiB	PIGSTY 1.0.2 el10.x86_64.pg15 : omnisketch_15 omnisketch_15-1.0.2-1PIGSTY.el10.x86_64.rpm PIGSTY · 1.0.2 · 20.2KiB	PIGSTY 1.0.2 el10.x86_64.pg14 : omnisketch_14 omnisketch_14-1.0.2-1PIGSTY.el10.x86_64.rpm PIGSTY · 1.0.2 · 20.2KiB
el10.aarch64	PIGSTY 1.0.2 el10.aarch64.pg18 : omnisketch_18 omnisketch_18-1.0.2-1PIGSTY.el10.aarch64.rpm PIGSTY · 1.0.2 · 20.5KiB	PIGSTY 1.0.2 el10.aarch64.pg17 : omnisketch_17 omnisketch_17-1.0.2-1PIGSTY.el10.aarch64.rpm PIGSTY · 1.0.2 · 20.5KiB	PIGSTY 1.0.2 el10.aarch64.pg16 : omnisketch_16 omnisketch_16-1.0.2-1PIGSTY.el10.aarch64.rpm PIGSTY · 1.0.2 · 20.5KiB	PIGSTY 1.0.2 el10.aarch64.pg15 : omnisketch_15 omnisketch_15-1.0.2-1PIGSTY.el10.aarch64.rpm PIGSTY · 1.0.2 · 20.5KiB	PIGSTY 1.0.2 el10.aarch64.pg14 : omnisketch_14 omnisketch_14-1.0.2-1PIGSTY.el10.aarch64.rpm PIGSTY · 1.0.2 · 20.5KiB
d12.x86_64	PIGSTY 1.0.2 d12.x86_64.pg18 : postgresql-18-omnisketch postgresql-18-omnisketch_1.0.2-1PIGSTY~bookworm_amd64.deb PIGSTY · 1.0.2 · 26.1KiB	PIGSTY 1.0.2 d12.x86_64.pg17 : postgresql-17-omnisketch postgresql-17-omnisketch_1.0.2-1PIGSTY~bookworm_amd64.deb PIGSTY · 1.0.2 · 26.0KiB	PIGSTY 1.0.2 d12.x86_64.pg16 : postgresql-16-omnisketch postgresql-16-omnisketch_1.0.2-1PIGSTY~bookworm_amd64.deb PIGSTY · 1.0.2 · 26.0KiB	PIGSTY 1.0.2 d12.x86_64.pg15 : postgresql-15-omnisketch postgresql-15-omnisketch_1.0.2-1PIGSTY~bookworm_amd64.deb PIGSTY · 1.0.2 · 26.3KiB	PIGSTY 1.0.2 d12.x86_64.pg14 : postgresql-14-omnisketch postgresql-14-omnisketch_1.0.2-1PIGSTY~bookworm_amd64.deb PIGSTY · 1.0.2 · 26.0KiB
d12.aarch64	PIGSTY 1.0.2 d12.aarch64.pg18 : postgresql-18-omnisketch postgresql-18-omnisketch_1.0.2-1PIGSTY~bookworm_arm64.deb PIGSTY · 1.0.2 · 26.1KiB	PIGSTY 1.0.2 d12.aarch64.pg17 : postgresql-17-omnisketch postgresql-17-omnisketch_1.0.2-1PIGSTY~bookworm_arm64.deb PIGSTY · 1.0.2 · 26.0KiB	PIGSTY 1.0.2 d12.aarch64.pg16 : postgresql-16-omnisketch postgresql-16-omnisketch_1.0.2-1PIGSTY~bookworm_arm64.deb PIGSTY · 1.0.2 · 26.0KiB	PIGSTY 1.0.2 d12.aarch64.pg15 : postgresql-15-omnisketch postgresql-15-omnisketch_1.0.2-1PIGSTY~bookworm_arm64.deb PIGSTY · 1.0.2 · 26.0KiB	PIGSTY 1.0.2 d12.aarch64.pg14 : postgresql-14-omnisketch postgresql-14-omnisketch_1.0.2-1PIGSTY~bookworm_arm64.deb PIGSTY · 1.0.2 · 26.0KiB
d13.x86_64	PIGSTY 1.0.2 d13.x86_64.pg18 : postgresql-18-omnisketch postgresql-18-omnisketch_1.0.2-1PIGSTY~trixie_amd64.deb PIGSTY · 1.0.2 · 26.2KiB	PIGSTY 1.0.2 d13.x86_64.pg17 : postgresql-17-omnisketch postgresql-17-omnisketch_1.0.2-1PIGSTY~trixie_amd64.deb PIGSTY · 1.0.2 · 26.1KiB	PIGSTY 1.0.2 d13.x86_64.pg16 : postgresql-16-omnisketch postgresql-16-omnisketch_1.0.2-1PIGSTY~trixie_amd64.deb PIGSTY · 1.0.2 · 26.1KiB	PIGSTY 1.0.2 d13.x86_64.pg15 : postgresql-15-omnisketch postgresql-15-omnisketch_1.0.2-1PIGSTY~trixie_amd64.deb PIGSTY · 1.0.2 · 26.1KiB	PIGSTY 1.0.2 d13.x86_64.pg14 : postgresql-14-omnisketch postgresql-14-omnisketch_1.0.2-1PIGSTY~trixie_amd64.deb PIGSTY · 1.0.2 · 26.2KiB
d13.aarch64	PIGSTY 1.0.2 d13.aarch64.pg18 : postgresql-18-omnisketch postgresql-18-omnisketch_1.0.2-1PIGSTY~trixie_arm64.deb PIGSTY · 1.0.2 · 26.1KiB	PIGSTY 1.0.2 d13.aarch64.pg17 : postgresql-17-omnisketch postgresql-17-omnisketch_1.0.2-1PIGSTY~trixie_arm64.deb PIGSTY · 1.0.2 · 26.1KiB	PIGSTY 1.0.2 d13.aarch64.pg16 : postgresql-16-omnisketch postgresql-16-omnisketch_1.0.2-1PIGSTY~trixie_arm64.deb PIGSTY · 1.0.2 · 26.1KiB	PIGSTY 1.0.2 d13.aarch64.pg15 : postgresql-15-omnisketch postgresql-15-omnisketch_1.0.2-1PIGSTY~trixie_arm64.deb PIGSTY · 1.0.2 · 26.1KiB	PIGSTY 1.0.2 d13.aarch64.pg14 : postgresql-14-omnisketch postgresql-14-omnisketch_1.0.2-1PIGSTY~trixie_arm64.deb PIGSTY · 1.0.2 · 26.1KiB
u22.x86_64	PIGSTY 1.0.2 u22.x86_64.pg18 : postgresql-18-omnisketch postgresql-18-omnisketch_1.0.2-1PIGSTY~jammy_amd64.deb PIGSTY · 1.0.2 · 27.5KiB	PIGSTY 1.0.2 u22.x86_64.pg17 : postgresql-17-omnisketch postgresql-17-omnisketch_1.0.2-1PIGSTY~jammy_amd64.deb PIGSTY · 1.0.2 · 28.9KiB	PIGSTY 1.0.2 u22.x86_64.pg16 : postgresql-16-omnisketch postgresql-16-omnisketch_1.0.2-1PIGSTY~jammy_amd64.deb PIGSTY · 1.0.2 · 28.8KiB	PIGSTY 1.0.2 u22.x86_64.pg15 : postgresql-15-omnisketch postgresql-15-omnisketch_1.0.2-1PIGSTY~jammy_amd64.deb PIGSTY · 1.0.2 · 28.9KiB	PIGSTY 1.0.2 u22.x86_64.pg14 : postgresql-14-omnisketch postgresql-14-omnisketch_1.0.2-1PIGSTY~jammy_amd64.deb PIGSTY · 1.0.2 · 28.8KiB
u22.aarch64	PIGSTY 1.0.2 u22.aarch64.pg18 : postgresql-18-omnisketch postgresql-18-omnisketch_1.0.2-1PIGSTY~jammy_arm64.deb PIGSTY · 1.0.2 · 27.2KiB	PIGSTY 1.0.2 u22.aarch64.pg17 : postgresql-17-omnisketch postgresql-17-omnisketch_1.0.2-1PIGSTY~jammy_arm64.deb PIGSTY · 1.0.2 · 28.5KiB	PIGSTY 1.0.2 u22.aarch64.pg16 : postgresql-16-omnisketch postgresql-16-omnisketch_1.0.2-1PIGSTY~jammy_arm64.deb PIGSTY · 1.0.2 · 28.5KiB	PIGSTY 1.0.2 u22.aarch64.pg15 : postgresql-15-omnisketch postgresql-15-omnisketch_1.0.2-1PIGSTY~jammy_arm64.deb PIGSTY · 1.0.2 · 28.5KiB	PIGSTY 1.0.2 u22.aarch64.pg14 : postgresql-14-omnisketch postgresql-14-omnisketch_1.0.2-1PIGSTY~jammy_arm64.deb PIGSTY · 1.0.2 · 28.6KiB
u24.x86_64	PIGSTY 1.0.2 u24.x86_64.pg18 : postgresql-18-omnisketch postgresql-18-omnisketch_1.0.2-1PIGSTY~noble_amd64.deb PIGSTY · 1.0.2 · 27.1KiB	PIGSTY 1.0.2 u24.x86_64.pg17 : postgresql-17-omnisketch postgresql-17-omnisketch_1.0.2-1PIGSTY~noble_amd64.deb PIGSTY · 1.0.2 · 27.0KiB	PIGSTY 1.0.2 u24.x86_64.pg16 : postgresql-16-omnisketch postgresql-16-omnisketch_1.0.2-1PIGSTY~noble_amd64.deb PIGSTY · 1.0.2 · 27.0KiB	PIGSTY 1.0.2 u24.x86_64.pg15 : postgresql-15-omnisketch postgresql-15-omnisketch_1.0.2-1PIGSTY~noble_amd64.deb PIGSTY · 1.0.2 · 27.0KiB	PIGSTY 1.0.2 u24.x86_64.pg14 : postgresql-14-omnisketch postgresql-14-omnisketch_1.0.2-1PIGSTY~noble_amd64.deb PIGSTY · 1.0.2 · 27.2KiB
u24.aarch64	PIGSTY 1.0.2 u24.aarch64.pg18 : postgresql-18-omnisketch postgresql-18-omnisketch_1.0.2-1PIGSTY~noble_arm64.deb PIGSTY · 1.0.2 · 27.1KiB	PIGSTY 1.0.2 u24.aarch64.pg17 : postgresql-17-omnisketch postgresql-17-omnisketch_1.0.2-1PIGSTY~noble_arm64.deb PIGSTY · 1.0.2 · 27.0KiB	PIGSTY 1.0.2 u24.aarch64.pg16 : postgresql-16-omnisketch postgresql-16-omnisketch_1.0.2-1PIGSTY~noble_arm64.deb PIGSTY · 1.0.2 · 27.1KiB	PIGSTY 1.0.2 u24.aarch64.pg15 : postgresql-15-omnisketch postgresql-15-omnisketch_1.0.2-1PIGSTY~noble_arm64.deb PIGSTY · 1.0.2 · 27.0KiB	PIGSTY 1.0.2 u24.aarch64.pg14 : postgresql-14-omnisketch postgresql-14-omnisketch_1.0.2-1PIGSTY~noble_arm64.deb PIGSTY · 1.0.2 · 27.0KiB
u26.x86_64	PIGSTY 1.0.2 u26.x86_64.pg18 : postgresql-18-omnisketch postgresql-18-omnisketch_1.0.2-1PIGSTY~resolute_amd64.deb PIGSTY · 1.0.2 · 26.8KiB	PIGSTY 1.0.2 u26.x86_64.pg17 : postgresql-17-omnisketch postgresql-17-omnisketch_1.0.2-1PIGSTY~resolute_amd64.deb PIGSTY · 1.0.2 · 26.8KiB	PIGSTY 1.0.2 u26.x86_64.pg16 : postgresql-16-omnisketch postgresql-16-omnisketch_1.0.2-1PIGSTY~resolute_amd64.deb PIGSTY · 1.0.2 · 26.8KiB	PIGSTY 1.0.2 u26.x86_64.pg15 : postgresql-15-omnisketch postgresql-15-omnisketch_1.0.2-1PIGSTY~resolute_amd64.deb PIGSTY · 1.0.2 · 26.9KiB	PIGSTY 1.0.2 u26.x86_64.pg14 : postgresql-14-omnisketch postgresql-14-omnisketch_1.0.2-1PIGSTY~resolute_amd64.deb PIGSTY · 1.0.2 · 26.9KiB
u26.aarch64	PIGSTY 1.0.2 u26.aarch64.pg18 : postgresql-18-omnisketch postgresql-18-omnisketch_1.0.2-1PIGSTY~resolute_arm64.deb PIGSTY · 1.0.2 · 27.1KiB	PIGSTY 1.0.2 u26.aarch64.pg17 : postgresql-17-omnisketch postgresql-17-omnisketch_1.0.2-1PIGSTY~resolute_arm64.deb PIGSTY · 1.0.2 · 27.0KiB	PIGSTY 1.0.2 u26.aarch64.pg16 : postgresql-16-omnisketch postgresql-16-omnisketch_1.0.2-1PIGSTY~resolute_arm64.deb PIGSTY · 1.0.2 · 27.0KiB	PIGSTY 1.0.2 u26.aarch64.pg15 : postgresql-15-omnisketch postgresql-15-omnisketch_1.0.2-1PIGSTY~resolute_arm64.deb PIGSTY · 1.0.2 · 27.0KiB	PIGSTY 1.0.2 u26.aarch64.pg14 : postgresql-14-omnisketch postgresql-14-omnisketch_1.0.2-1PIGSTY~resolute_arm64.deb PIGSTY · 1.0.2 · 27.0KiB

Build

You can build the RPM / DEB packages for omnisketch using pig build:

pig build pkg omnisketch         # build RPM / DEB packages

Install

You can install omnisketch directly. First, make sure the PGDG and PIGSTY repositories are added and enabled:

pig repo add pgsql -u          # Add repo and update cache

Install the extension using pig or apt/yum/dnf:

Install

pig install omnisketch;          # Install for current active PG version

pig

pig ext install -y omnisketch -v 18  # PG 18
pig ext install -y omnisketch -v 17  # PG 17
pig ext install -y omnisketch -v 16  # PG 16
pig ext install -y omnisketch -v 15  # PG 15
pig ext install -y omnisketch -v 14  # PG 14

dnf

dnf install -y omnisketch_18       # PG 18
dnf install -y omnisketch_17       # PG 17
dnf install -y omnisketch_16       # PG 16
dnf install -y omnisketch_15       # PG 15
dnf install -y omnisketch_14       # PG 14

apt

apt install -y postgresql-18-omnisketch   # PG 18
apt install -y postgresql-17-omnisketch   # PG 17
apt install -y postgresql-16-omnisketch   # PG 16
apt install -y postgresql-15-omnisketch   # PG 15
apt install -y postgresql-14-omnisketch   # PG 14

Create Extension:

CREATE EXTENSION omnisketch;

Usage

omnisketch: OmniSketch data structure for multi-dimensional stream analytics

Implements OmniSketch for on-line aggregation into approximate sketches and answering count queries with arbitrary predicates on multi-dimensional data.

CREATE EXTENSION omnisketch;

Functions

Function	Description
`omnisketch(epsilon, delta, record)`	Build a sketch from data with accuracy parameters
`omnisketch(sketch)`	Combine multiple compatible sketches
`omnisketch_count(sketch)`	Return total records added to the sketch
`omnisketch_estimate(sketch, record)`	Estimate count of records matching predicates

Parameters

epsilon – accuracy relative to total records, range [0,1] (lower = more accurate, larger sketch)
delta – accuracy, range [0,1]

Examples

-- Create sample data
CREATE TABLE data (id INT, a INT, b INT);
INSERT INTO data SELECT i, mod(i,100), mod(i,100) FROM generate_series(1,1000000) s(i);

-- Pre-calculate sketches on partitions
CREATE TABLE sketches AS
SELECT mod(id,10) AS p, omnisketch(0.01, 0.01, (a, b)) AS s
FROM data GROUP BY mod(id,10);

-- Estimate count for condition (a = 10 AND b = 10)
SELECT omnisketch_estimate(omnisketch(s), (10, 10)) FROM sketches;

-- Get total record count
SELECT omnisketch_count(omnisketch(s)) FROM sketches;

omnisketch

Overview

Version

Build

Install

Usage

Functions

Parameters

Examples

Was this page helpful?