Omitting Pages & Text

You can tell USD’s search engine to skip over your page, to skip over your links, or to skip over parts of your page.

Robots meta tag

You can control our search engine’s reaction to your entire page by adding a “meta” tag called “robots” to the “head” area of your document. This tag can have as its content “noindex”, “nofollow”, and “none”.

Setting the robot meta tag to “noindex” causes the USD search engine to follow any links from this page, but not to index this page.

<meta name="robots" content="noindex" />

Setting the robot meta tag to “nofollow” causes the USD search engine to index the current page, but not to follow any links off of it.

<meta name="robots" content="nofollow" />

Setting the robot meta tag to “none” causes the USD search engine to neither index the page nor follow its links.

<meta name="robots" content="none" />

Hiding parts of your page

You can use the following comments to cause the USD search engine to skip over parts of your page:

<!--htdig_noindex--> Text here that will not be indexed <!--/htdig_noindex-->