Exclude Content nodes from Search engine indexing

Yes, it is possible to exclude certain directories in the DAM from Google Search engine indexing in AEM. This can be done by setting the robots.txt file to disallow search engine bots from indexing those directories. Additionally, you can also add a meta tag to the HTML of the pages you want to exclude, which will prevent search engines from indexing them.

Also This can be done at the dispatcher level. You can configure the dispatcher.any file to exclude certain paths or directories from being indexed by Google.

As Arun mentioned, we can add the paths which should not be crawled by search engines in robots.txt

Robots.txt file should be available at root level (Ex: https://www.example.com/robots.txt)

You can have the file available in publisher and add redirection in dispatcher file so that it will load at root level as url provided above.

More details of robots.txt can be found in 

https://www.semrush.com/blog/beginners-guide-robots-txt/?kw=&cmp=US_SRCH_DSA_Blog_EN&label=dsa_pagefeed&Network=g&Device=c&utm_content=631620704803&kwid=aud-391253447936:dsa-1875638614702&cmpid=18348486859&agpid=142604696083&BU=Core&extid=60113850590&adpos=&gclid=Cj0KCQiA1sucBhDgARIsAFoytUtQk3Jg0Ahx3_wZrHYOlAnLIU-tVTdmk8U50wrCE4Udv3psXA4z-CIaAiXWEALw_wcB

you can try adding those path in robots.txt