RSSAmplifier

Jeff Klukas · Aug 4, 2021

Deduplication: Where Apache Beam Fits In

0
Sign in to vote or save

This site does not allow itself to be embedded. You can still read it on the original site — the toolbar below keeps your place in the directory.

Summary of a talk delivered at Apache Beam Digital Summit on August 4, 2021. This session will start with a brief overview of the problem of duplicate records and the different options available for handling them. We’ll then explore two concrete approaches to deduplication within a Beam streaming pipeline implemented in Mozilla’s open source codebase for ingesting telemetry data from Firefox…

Read on jeff.klukas.net

Comments

Nothing yet. Say the first thing.

    Sign in to join the conversation.