Real-World Workflows · 35 min
Data transformations at scale
Split In Batches, Aggregate, Sort, Remove Duplicates and Compare Datasets in combination.
Key concepts
- Compare Datasets node
- Sort + dedupe pipelines
- Large-payload memory tips
Exercise
Use Compare Datasets to diff two CSV exports and output only the changed rows.