How Can I Upsert an array of objects by straming http api source

Question

Hi, {    "tenant": {        "cardDetails": [            {                "cardId": "30",                "cardNumber": "30",                "status": "ativo00s"            }        ],        "cardsList": [            {                "cardId": "100",                "cardNumber": "500",                "status": "ativo0"            }        ],        "identities": {            "myId": "Marcelo"        }    }} I have this schema, i have it enabled for profile, also its dataset is enable for profile and upsert. I have tried data prep upsert_array_append but also no lucky. All I want is to have an array of credit cards being upserted by streaming events. cardId should be unique in the array. can anyone please help me?

marc_stowe_za · Answer

you not going to like this reply but i dont think you can. the data stream is essentially a push to a dataset, so the peices of the array need to be a compelte set of details.

The solve around this is to stream the data to a non profiole enabled dataset, then run something like data distiller against it and create a complete entry with the full object to push into your current dataset. O nly problem here is that getting the data into your active dataset is going to be slow as it runs through distiller first, which most likely means batch

Sign up

Login with SSO

Login to the community

Login with SSO

Scanning file for viruses.

This file cannot be downloaded