ingesting data to array | Community
Skip to main content
N
nirshani
New Participant
November 9, 2023
Solved

ingesting data to array

  • November 9, 2023
  • 2 replies
  • 2294 views

hi  i already read some of the answer provided by @danny-miller but still can not make it work

 

on the the target  schema i have array of objects which i need to ingest data from table (for now it is csv )

 

i tried to use the * notation but i'm problobly miss some casting options 

attached is the target schema and the row data

please advice 

 

    This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
    Best answer by arijitg

    Hi @nirshani 

     

    You can explore upsert feature once, as I remember it appends array elements. This feature gel well with streaming data so if you have an option to stream data to platform you can go for that route else I would suggest you to give it a try with your csv batch.

     

    Ref : Update specific profile attributes using `upsert` | Adobe Experience Platform

     

    Send Partial Row Updates To Real-Time Customer Profile Using Data Prep | Adobe Experience Platform

    2 replies

    M
    Mohan_KrishnaTu
    New Participant
    January 5, 2024

    hi @nirshani - I am in same boat now, do you have any luck with data prep function ?

    arijitg
    arijitg
    Employee
    November 9, 2023

    Hi @nirshani,

     

    if you use 0 in place of * in the destination side, like (object[0].field) you can push this file and each rows will be stored as separate record with just a single element in that array but if your expectation is to group all the policy details of that client_id and store it in that array then you will need a flat staging schema/dataset first (because your source csv file is of tabular structure) and then you can use data distiller capability to schedule query and push that array structure to the main schema/dataset. 

     

    Regards

      N
      nirshaniAuthor
      New Participant
      November 9, 2023

      thanks for the replay , my intention is like you mention , for each client_id list of his policies

      since we don't have license to distiller , do you have another suggestion ?

        arijitg
        arijitgAccepted solution
        Employee
        November 10, 2023

        Hi @nirshani 

         

        You can explore upsert feature once, as I remember it appends array elements. This feature gel well with streaming data so if you have an option to stream data to platform you can go for that route else I would suggest you to give it a try with your csv batch.

         

        Ref : Update specific profile attributes using `upsert` | Adobe Experience Platform

         

        Send Partial Row Updates To Real-Time Customer Profile Using Data Prep | Adobe Experience Platform

          Terms & ConditionsAccessibility statement

          Loading footer...