Array object field ingestion using Parquet file | Community
Skip to main content
jayakrishnaaparthasarathy
jayakrishnaaparthasarathy
New Participant
February 7, 2024
Solved

Array object field ingestion using Parquet file

  • February 7, 2024
  • 1 reply
  • 998 views

Team - I would like to quickly clarify on ingesting parquet file which has a object array over the target schema. We were trying to ingest parquest based file from S3 and schema has an object array which hold mutiple value for a single customer (holding information about preference on different category). However, data is being ingested except array object, should we use JSON format to ingest array object. Any leads or suggestion would be appreciate. 

 

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
Best answer by ssj

It is very well possible to ingest data into array object from Parquet file. Source Parquet file should be XDM compliant file, as you don't have option for data mapping.

 

fyi, Data of array object won't be visible in UI. you need to query the dataset to see the data of array object attribute.

 

--ssj

1 reply

S
ssjAccepted solution
Employee
February 16, 2024

It is very well possible to ingest data into array object from Parquet file. Source Parquet file should be XDM compliant file, as you don't have option for data mapping.

 

fyi, Data of array object won't be visible in UI. you need to query the dataset to see the data of array object attribute.

 

--ssj

Terms & ConditionsAccessibility statement

Loading footer...