From fbe20821072ead216cec403a195f4165f94cd454 Mon Sep 17 00:00:00 2001 From: Umberto Sgueglia Date: Mon, 9 Mar 2026 17:32:23 +0100 Subject: [PATCH] feat: add index for dedup copy pipe --- services/libs/tinybird/datasources/activities.datasource | 3 +++ .../tinybird/datasources/activities_deduplicated_ds.datasource | 2 +- 2 files changed, 4 insertions(+), 1 deletion(-) diff --git a/services/libs/tinybird/datasources/activities.datasource b/services/libs/tinybird/datasources/activities.datasource index 68dc8dc893..25f570c3fd 100644 --- a/services/libs/tinybird/datasources/activities.datasource +++ b/services/libs/tinybird/datasources/activities.datasource @@ -48,6 +48,9 @@ SCHEMA > `updatedById` UUID `json:$.updatedById` DEFAULT toUUID('00000000-0000-0000-0000-000000000000'), `segmentId` LowCardinality(String) `json:$.segmentId` DEFAULT '' +INDEXES > + idx_updatedAt updatedAt TYPE minmax GRANULARITY 1 + ENGINE ReplacingMergeTree ENGINE_PARTITION_KEY toYear(createdAt) ENGINE_SORTING_KEY id diff --git a/services/libs/tinybird/datasources/activities_deduplicated_ds.datasource b/services/libs/tinybird/datasources/activities_deduplicated_ds.datasource index 50342803c7..0d8e04fbd9 100644 --- a/services/libs/tinybird/datasources/activities_deduplicated_ds.datasource +++ b/services/libs/tinybird/datasources/activities_deduplicated_ds.datasource @@ -38,4 +38,4 @@ INDEXES > ENGINE MergeTree ENGINE_PARTITION_KEY toYear(timestamp) -ENGINE_SORTING_KEY id, platform, channel +ENGINE_SORTING_KEY id, platform, channel, updatedAt