#               Robots Crawler file.
#               ===================
#
#  This file is accessed by all robots, not just Google.
#  It will list the Sitemap URL - a list of all pages to be indexed.
#
#  This file will list all pages NOT to be indexed.
#  This file is an 'exclusion' list.
#
#  The exclusion list is only a set of requests - not orders.
#  Similar to 'Private - Keep Out' on an unlocked door.
#  Nasty robots will ignore all such requests.
#
#
#  This file does not support an 'Allow' statement.
#
#
# ===================================================



# the sitemap listed below holds all useful pages on the site.

Sitemap: http://www.antiquemaps.org.uk/crawler.txt



# the lines below are all exclusion statements


User-agent: *
Disallow: /*.css
Disallow: /*.asp
Disallow: /*.php
Disallow: /images/
Disallow: /maps/