Hide duplicate and gated content from search

Page or resource

A page, such as a resource download or thank you for gated content should not be made available to either internal or external search. In addition, any purposefully duplicate content should also be hidden.

For example, a download page used in conjunction with a gated form should not appear in a search result listing. If the page appears in search results a direct link to the PDF will be promoted.

In these cases, configure the page properties with the following:

• “Robots – No Index,”
• "No-Follow", and 
• "Hide in navigation*" 

*This setting is important since it will prevent the page from appearing on the site map. Be aware that any pages appearing on the sitemap will be indexed.

Managing purposefully duplicate content

If a page is duplicated or has very similar content for whatever reason, the page should be marked so that search engine bots do not index the duplicate versions and only crawl the primary.

Content authors assign, the page that should be indexed using the “canonical link” option found in the page properties. The canonical link element tells the search engines which page should be indexed.

In these cases the configure the page properties with the following:

• “Robots – No Index,”
• "No-Follow", and 
• "Hide in navigation*
• "Canonical link" — Under advanced tab, assign the page that should be indexed.

Gated resources

When a resource item such as a white paper, video or case study should not be found via a site search, the resource should be placed inside the "gated" folder located in the main "Resources" directory of the DAM.