Data not getting ingested into array type objects using csv file in Adobe Experience Platform | Community
Skip to main content
New Participant
August 22, 2024
Solved

Data not getting ingested into array type objects using csv file in Adobe Experience Platform

  • August 22, 2024
  • 1 reply
  • 2085 views
0

I am trying to ingest data through CSV file into array type object fields in a schema in Adobe experience platform.But the data is not getting ingested although it's not showing any error while ingesting.

Array type objects:

Cool Numbers - Integer type

Favorite Choice - String type

 

Sample data in csv file:

Cool Numbers           Favorite Choice

2|26                           ic|t

5|63|74                      t|ic

 

When I am loading the CSV file manually into schema,I am creating calculated field for both of them like

to_array(true,split(Cool_Numbers,"|"))

and mapping it to the corresponding target field.

Validation is coming fine but when I finish the workflow and check the processed data,it shows blank in both the fields in the dataset.

Best answer by John_Man

Can you provide an example,that would be great.


Hi @ritwikmo 

 

I've done a POC to simulate office purchase, and below is the raw csv sample records, and the screen capture is the data mapping.

 

The array_to_object function can help you to map delimitered fields into the standard productListItems field.

 

Hope it helps.

 

id,timestamp,customerID,storeCode,pageName,purchaseID,priceTotal,SKU,QTY
202311060101-0003,2023-11-06T13:07:19+08:00,u033@yahoo.com,SHOP003,Offline Purchase,635-025-655-6792,8139,SKU113|SKU089,2|2
202311060102-0004,2023-11-06T13:02:19+08:00,u034@icq.com,SHOP004,Offline Purchase,635-025-655-6793,1214,SKU018,4
202311060102-0005,2023-11-06T13:02:19+08:00,u035@icq.com,SHOP001,Offline Purchase,635-025-655-6794,718,SKU023|SKU194|SKU905|SKU226,2|2|3|5

 

 

1 reply

sambhav-jain
New Participant
August 22, 2024

arrays are not supported using file based connector.

Only way in this case would be to store the file data in a non profile enabled dataset and then run schedule a SQL query to read data, transform it in array and then ingest it in profile enabled dataset with array objects. (Checkout your license restrictions before using scheduled queries)

 

 

RitwikMoAuthor
New Participant
August 22, 2024

The dataset is not profile enabled.Is there no other way or approach through which it can be loaded properly through csv file.

sambhav-jain
New Participant
August 22, 2024

no, using csv files, arrays are not supported. Other options would be JSON via API connector or as mentioned above using queries.