RSSAmplifier

Dan Snow · Jun 17, 2023

Comparing 500 billion rows with data.table

0
Sign in to vote or save

This site does not allow itself to be embedded. You can still read it on the original site — the toolbar below keeps your place in the directory.

Recently, I’ve been working on a project that requires the element-wise comparison of many rows. The goal is to calculate a sort of similarity score between two tables. A simplified version of the data/problem looks like this: Table X ID V1 V2 V3 V4 V5 X1 9 3 2 4 5 X2 9 1 2 1 1 Table Y ID V1 V2 V3 V4 V5 Y1 9 3 3 1 1 Y2 1 1 1 1 1 Y3 9 9 7 9 8 Each row of Table X is compared to each row of…

Read on sno.ws

Comments

Nothing yet. Say the first thing.

    Sign in to join the conversation.