Load data feed into Azure data lake and analyze | Community

martinh36864894

Level 2

Load data feed into Azure data lake and analyze

10 replies
8155 views
Translate

we are trying to load Adobe Data Feed into Azure Storage Blob and do some initial data analysis. I tried with AWS, altough it's quite slow, S3 + Athena works for this, but I'd like to know if there is any alternative way to do the same analysis in Microsoft Azure before building a data warehouse. Azure is required...

1. Does anyone have any suggestion? for data analysis on Azure storage Blob, or if other Azure service is preferred

2. Next step, we will build a data warehouse with ETL. We also like to know the best practice.

Some information: I'm using daily delivery raw Adobe Data Feed data to Azure Storage Blob. Everyday, a new zip or tar.gz (contains a .tsv) file is added. For 30 days, I will have 30 files.

W

Thanks,
Martin

Analytics

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.

New Participant

Martin,

Did you found a solution to connect Analytics data feed into Azure BLOB?

Thanks in Advance!

Translate

Employee

Do you have any feedvack on this. Did you manage to connect it to Azure?

Translate

Employee

Clarification - do you have the Adobe Analytics side working? Is your question geared towards analysis on Azure?

Translate

martinh36864894Author

Level 2

Thanks for reply. Yes. from Adobe side, data feed works and I can see raw data file coming to S3, Blob, or SFTP.

I was wondering if you or anyone in the community has relevant experience in setting up analytic platform of data feed data in Microsoft Azure cloud.

Martin

T

Translate

Employee

Gotcha. Unfortunately I don't have much experience with Azure, but hopefully someone in the community can chime in!

Translate