Solved
Does having duplicate records in dataset impact licensing?
Hell, im wondering if having duplicates in a dataset has any impact on licensing costs. Thanks!
Kumar29917170hcypAccepted solution
Employee
May 7, 2024
Hi @ryanmoravick,
The duplicate records in the dataset make up the Datalake size. This increases the license storage limit. Having said that, the data in the Datalake is compressed into Parquet file format, so the impact will be minimal unless you ingest millions of duplicate rows every day.
Regards,
Kumar Saurabh