Ignoring records that are duplicate | Community
Skip to main content
ratika
Level 3
Apr 19, 2021 2:27 PM UTC
Solved

Ignoring records that are duplicate

Hi Everyone,

 

Is there any way to ignore the duplicate records from the qualifying base using the deduplication activity. I have a requirement where in I have to discard the records that are duplicate in the file rather than selecting any of them.

 

Thanks

    This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
    Jonathon_wodnicki
    Jonathon_wodnickiAccepted solution
    New Participant
    Apr 20, 2021 5:37 AM UTC

    Hi,

     

    That is what the deduplication activity is intended to do.

    Put it after file ingest to remove undesired duplicates from working table.

     

    Thanks,

    -Jon

    View reply

    2 replies

    Jonathon_wodnicki
    Jonathon_wodnickiAccepted solution
    New Participant
    Apr 20, 2021 5:37 AM UTC

    Hi,

     

    That is what the deduplication activity is intended to do.

    Put it after file ingest to remove undesired duplicates from working table.

     

    Thanks,

    -Jon

    Translate
      mditullio
      Level 2
      Feb 22, 2022 11:13 PM UTC

      my question is though, once you do that does it not still only give you 1 of those duplicate records?
      How do you remove all duplicate records?

      ex. you have 2 records with the same email address but you don't want to send to anyone that has duplicated records?

      Translate
      Terms & ConditionsAccessibility statement

      Loading footer...