Disallow files in Design Studio to be crawled | Community
Skip to main content
Jean-Pascal_Mer
New Participant
February 25, 2016
Solved

Disallow files in Design Studio to be crawled

  • February 25, 2016
  • 4 replies
  • 3777 views

Hi folks,

I'm looking for a way to disallow files uploaded in the Design Studio to be crawled.

We have an area of our website we are hiding from search engines, but because these pages link to PDF hosted in the Design Studio, robots still crawl the pages and result in some organic traffic hitting the pages.

Anyone know of a way to do this and keep the files in the design studio v. switching files to an in-house server.

Thanks

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.
Best answer by Edward_Unthank_

Hey Jean-Pascal, you can call up Marketo Support and work with them to change your robots.txt file to disallow the Design Studio files (site folder, really) to be archived.

Cheers

Edward

4 replies

Jamie-Carey
New Participant
March 28, 2017

I'm actually shocked to find out this is the default that those files are indexed. For a business that is built on gated content for leads, this is a HUGE oversight.

New Participant
February 25, 2016

@Edward Unthank is correct.  We just did this ourselves!

Open a support case with Marketo

Edward_Unthank_
Edward_Unthank_Accepted solution
New Participant
February 25, 2016

Hey Jean-Pascal, you can call up Marketo Support and work with them to change your robots.txt file to disallow the Design Studio files (site folder, really) to be archived.

Cheers

Edward

Jean-Pascal_Mer
New Participant
February 26, 2016

Magical!

Thanks!!

February 25, 2016

Hey @Jean-Pascal Mercier​, I believe you set your LPs to "no index/no follow" , that should do it. Referring to this post: "No Follow" on Landing Pages?