# robots.txt file for melchior.muhlenberg.edu # - each entry contains a User-agent and a set of Disallow directories # disallow access for Google (supports wildcards) User-agent: Googlebot Disallow: /moin/*?action=diff* Disallow: /moin/*?action=info* Disallow: /moin/*?action=login* Disallow: /moin/*?action=print* Disallow: /moin/*?action=raw* Disallow: /moin/*?highlight* Disallow: /moin/moinusers/Help Disallow: /pipermail/ Disallow: /serendipity/ Disallow: /tmp/ Disallow: /twiki/bin/*?skin=print Disallow: /twiki/bin/edit/ Disallow: /twiki/bin/login/ Disallow: /twiki/bin/oops/ Disallow: /twiki/bin/rdiff/ Disallow: /twiki/bin/rdiffauth/ Disallow: /twiki/bin/search/ Disallow: /twiki/bin/view/PUIeship/*sortcol* Disallow: /twiki/bin/view/Sandbox/ Disallow: /twiki/bin/view/TWiki/ Disallow: /twiki/bin/view/Trash/ Disallow: /twiki/bin/view/WikiWay/ Disallow: /twiki/bin/viewauth/ Disallow: /twiki/tmp/ # disallow access for all agents User-agent: * Disallow: /moin/moinusers/Help Disallow: /pipermail/ Disallow: /serendipity/ Disallow: /tmp/ Disallow: /twiki/bin/edit/ Disallow: /twiki/bin/login/ Disallow: /twiki/bin/oops/ Disallow: /twiki/bin/rdiff/ Disallow: /twiki/bin/rdiffauth/ Disallow: /twiki/bin/search/ Disallow: /twiki/bin/view/Sandbox/ Disallow: /twiki/bin/view/TWiki/ Disallow: /twiki/bin/view/Trash/ Disallow: /twiki/bin/view/WikiWay/ Disallow: /twiki/bin/viewauth/ Disallow: /twiki/tmp/