There is 1TB data on disk with around 1KB per data record. How to find duplicates using 512MB RAM and infinite disk space?
Given a 1TB data set on disk with around 1KB per data record, how can I find duplicates using 512MB RAM and infinite disk space?