Query getNodes() Extremely Slow | Community
Skip to main content
J
joshua103us
New Participant
October 16, 2015
Solved

Query getNodes() Extremely Slow

  • October 16, 2015
  • 9 replies
  • 2004 views

I am building a query using QueryBuilder and the query returns 32k results.  I am using the following to create an Iterator so that I can index over each result.  

 

Iterator<Node> itr =  query.getResult().getNodes();

 

This line however takes a really long time and is slowing my page down drastically.  How can I speed this up?

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
Best answer by joerghoh

In Jackrabbit and Oak the complete execution time of a query always consists of the exucution of the query itself and the retrieval of the results. This is because it's quite common that you're query returns lot of results, but you never retrieve them all, so it is split. And 32k results is quite a number.

I am not in the details, but for me it looks like that this command (especially the query.getResult() part) takes that long because it fetches a good number of results from the repository. And this means not only only loading nodes, but there are also a lot of other acitivites (e.g. validating ACLs, so you only the pages you have at least read access to, etc.).

kind regards,
Jörg

9 replies

Pacoolsky
Pacoolsky
New Participant
October 16, 2015

what is the exact query ? does it contain order by clause ?

Feike_Visser1
Feike_Visser1
Employee
October 16, 2015

Do you see any warnings in the log-file? (error.log)

joerghoh
joerghohAccepted solution
Employee
October 16, 2015

In Jackrabbit and Oak the complete execution time of a query always consists of the exucution of the query itself and the retrieval of the results. This is because it's quite common that you're query returns lot of results, but you never retrieve them all, so it is split. And 32k results is quite a number.

I am not in the details, but for me it looks like that this command (especially the query.getResult() part) takes that long because it fetches a good number of results from the repository. And this means not only only loading nodes, but there are also a lot of other acitivites (e.g. validating ACLs, so you only the pages you have at least read access to, etc.).

kind regards,
Jörg

J
joshua103usAuthor
New Participant
October 16, 2015

So, there is really no way to speed this process up?

J
joshua103usAuthor
New Participant
October 16, 2015

Pacoolsky wrote...

what is the exact query ? does it contain order by clause ?

 

Yes, it does Order By

J
joshua103usAuthor
New Participant
October 16, 2015

Jörg Hoh wrote...

In Jackrabbit and Oak the complete execution time of a query always consists of the exucution of the query itself and the retrieval of the results. This is because it's quite common that you're query returns lot of results, but you never retrieve them all, so it is split. And 32k results is quite a number.

I am not in the details, but for me it looks like that this command (especially the query.getResult() part) takes that long because it fetches a good number of results from the repository. And this means not only only loading nodes, but there are also a lot of other acitivites (e.g. validating ACLs, so you only the pages you have at least read access to, etc.).

kind regards,
Jörg

 

Then this means there is nothing I can do to increase the speed of this function?

O
ogill
Employee
October 16, 2015

Can you share the query with us?

joerghoh
joerghoh
Employee
October 16, 2015

When you use "order by", the complete result set must be loaded from the repo in order to get sorted properly. Try to avoid ordering if you don't need it, it can speed up the performance significantly.

kind regards,
Jörg

Peter_Puzanovs
Peter_Puzanovs
New Participant
October 16, 2015

QueryBuilder is great fun to use and improve :)

Does your query contains search for custom fields you have created ?

When you go inside the /system/console/jmx/com.adobe.granite%3Atype%3DQueryStat do you see your query there ?

 

Thanks,

Peter

Terms & ConditionsAccessibility statement

Loading footer...