Bulk Import | Community
Skip to main content
A
Anonymous
August 1, 2018
Solved

Bulk Import

  • August 1, 2018
  • 2 replies
  • 2488 views

Hi:

We are going to use the API call to send the Leads to Marketo. I am trying to design the job and read thru this post:

http://developers.marketo.com/rest-api/bulk-import/

It says the following:

Limits

Max Concurrent Import Jobs: 2

Max Queued Import Jobs (inclusive of currently importing jobs): 10

Max Size of Import File: 10 MB-

Does that mean that I can send 10 concurrent request (with 10MB file each .) and only two API calls will be made each time and rest will automatically be in Queue.

OR

Should I only make 2 concurrent API calls with 10MB file each and once complete make the next two call  .

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
Best answer by SanfordWhiteman

Should I only make 2 concurrent API calls with 10MB file each and once complete make the next two call .

It really depends.

If you have a clearly fixed number of imports, like you've already sliced one day's single file into 10MB slices and that's under 10 files, then I would upload them all at once. Again that's assuming you will not be uploading again for 24 hours.

But if you don't know how many files will come in and at what pace, you don't gain much by uploading in advance. Instead, poll for completion every minute and then upload when there's a slot available. 10MB files are so fast to upload that pre-queueing them has little advantage (if the limit were 100MB+ it would be another story).

2 replies

SanfordWhiteman
SanfordWhitemanAccepted solution
New Participant
August 1, 2018

Should I only make 2 concurrent API calls with 10MB file each and once complete make the next two call .

It really depends.

If you have a clearly fixed number of imports, like you've already sliced one day's single file into 10MB slices and that's under 10 files, then I would upload them all at once. Again that's assuming you will not be uploading again for 24 hours.

But if you don't know how many files will come in and at what pace, you don't gain much by uploading in advance. Instead, poll for completion every minute and then upload when there's a slot available. 10MB files are so fast to upload that pre-queueing them has little advantage (if the limit were 100MB+ it would be another story).

Josh_Hill13
Josh_Hill13
New Participant
August 1, 2018

so it says you can run 2 imports at same time.

and 10 can be queued of up to 10mb each.

You can increase that size temporarily with support.

Terms & ConditionsAccessibility statement

Loading footer...