Replicate Marketo Database | Community
Skip to main content
February 29, 2016
Solved

Replicate Marketo Database

  • February 29, 2016
  • 3 replies
  • 5090 views

Hi,

I need to build an analytics application in top of the data available in Marketo.

For that I want to replicate the Marketo data into a local database (Sql Server/Oracle, etc.) so I can use that info in a simpler way.

Any suggestions on how to accomplish this.

I was planning in using the REST API for getting all the new activities and activity attributes and I can't foreseen an issue there, however when getting the lead data, getting the updated leads will not do the job I think because I'll still keep delete/merged leads.

Any suggestion on how to overcome this or on how to implement a different replication mechanism.

Regards.

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
Best answer by Grégoire_Miche2

Hi Carlos,

The API is really needed to extract activities. But for the lead themselves, you may just use the data export feature.

-Greg

3 replies

September 13, 2016

Hi Carlos,

We have bumped into the same issue as you had before while we are trying to replicate data to SQL server database to build some analytic reports, but it turned out to be hard to achieve with Marketo standard  API.

Therefore, we have developed our own data retrieving tool called Data Loader for Marketo(DLM) which allows you to sync Marketo data to the database without any coding. We invite you to visit our website to have a free trial of DLM and see if this could solve your problem.

Data Loader for Marketo:  dlm.trend.org

Feel free to contact us for further information or any feedback are very welcome!

Sincerely,

Vivian

SanfordWhiteman
New Participant
September 13, 2016

The product appears to require old Marketo SOAP credentials -- i.e. full create/read/update/delete access to Marketo -- in addition to REST API access. Is that correct?

October 4, 2016

Hi Sanford,

We use both SOAP and REST APIs in our product, but if you have any concern about SOAP credentials, welcome to contact us to try REST-only version.

The reason why we use both SOAP and REST APIs is that there is some limitation in REST API Marketo provided.

First, Marketo only supports Opportunity REST API for those who use Marketo without integration with CRM tool. Therefore, we won’t be able to include Opportunity REST in our product since we use Marketo and Salesforce. Second, although Program can be retrieved with REST API, it might easily exceed API limitation since it returns only 1 record in 1 API call.

Per the limitation of REST API-only might have, we will still provide current version which has the full function (SOAP+REST). In the same time, REST API-only version will also be provided but with limited functions.

Btw, although SOAP API has the delete function, we didn't use it at all. You're welcome to give it a test.

Thank you again for your suggestions, all the opinions are valuable for other people to have a better product to use.

Best Regards,

Vivian

Grégoire_Miche2
New Participant
February 29, 2016

Hi Carlos,

Mind the REST API limitations. If your database is big, you may exhaust them pretty quickly. From the doc:

Latest API Version: v1

Default Daily API Quota: 10,000 API calls (counter resets daily at 12:00 AM CST)

For higher volume integration scenarios, please contact your account representative to increase your daily API quota.  The quota applies to SOAP and REST API calls only.

Rate Limit: 100 API calls in a 20 second window

-Greg

February 29, 2016

Yes I know.

I've a 10.000 quota daily. I'dd say that for now, based on the data I have, those would be enough to cope with that.

I was wondering if there was a better way of doing this.

To me is kind of odd to find out that I have to go through all this trouble with REST API's to be able to extract analytics from Marketo.

Grégoire_Miche2
Grégoire_Miche2Accepted solution
New Participant
February 29, 2016

Hi Carlos,

The API is really needed to extract activities. But for the lead themselves, you may just use the data export feature.

-Greg

February 29, 2016

There is an API call for get deleted leads as well.  Not sure why you would want to keep merged leads as by definition they are the same lead so I would think you would want the data to be merged from reporting purposes as well

February 29, 2016

I don't want to keep them. That's why I need to get the delete leads so I can act accordingly in my local replica.

Thanks for the response. In that point that's exactly what I needed. Not quite sure how I missed that.