Magento 1.9 | Manage robots TXT

1°

• Login on admin area :
• enter in : System -> Configuration -> Design -> HTML Head -> Default Robots
• here you can manage global robots.txt options

2°

• For static cms page
• locate the field Layout Update XML
• add <reference name=”head”> <action method=”setRobots”><value>noindex, nofollow</value><name>robots</name></action> </reference>
• This code can also be used in any template you choose.

If you want add it on search results page :

• open or loacal.xml , or, catalogsearch.xml,
• find ” <catalogsearch_result_index translate=”label”> ” and immediately before </catalogsearch_result_index>
• add <reference name=”head”> <action method=”setRobots”><value>noindex, nofollow</value><name>robots</name></action> </reference>
• made same steps for <catalogsearch_advanced_result translate=”label”>