# /robots.txt file for http://www.fama.org User-agent: * Disallow: /CFTags Disallow: /EWS Disallow: /p7pm Disallow: /psd Disallow: /p7csslm Disallow: /members/ Disallow: /_notes/ Disallow: /js/ Disallow: /siteadmin/ # You can use wildcards * # Also the $ anchors the end of a file else a= would mean a= AND a=123 # so a=$ ONLY means the url END with a= and not value # http://help.yahoo.com/l/us/yahoo/search/webcrawler/slurp-02.html # http://www.google.com/support/webmasters/bin/topic.py?topic=8843 # http://search.msn.com/docs/siteowner.aspx?t=SEARCH_WEBMASTER_REF_RestrictAccessToSite.htm