User-Agent: * ##### DSpace Settings Sitemap: http://digital.lib.washington.edu/researchworks-webcrawlers/htmlmap Sitemap: http://digital.lib.washington.edu/researchworks-webcrawlers/sitemap # Disable access to Discovery search and filters Disallow: /researchworks/discover Disallow: /researchworks/search-filter Disallow: /researchworks/displaystats Disallow: /researchworks/browse Disallow: /researchworks/advanced-search Disallow: /researchworks/contact Disallow: /researchworks/feedback Disallow: /researchworks/forgot Disallow: /researchworks/login Disallow: /researchworks/register Disallow: /researchworks/search # OAI xml not useful to search engines Disallow: /dspace-oai # These urls are regularly queried by google bots for unknown reasons # Since they query into the researchworks app along valid paths, DSpace sends them to internal code. # Unfortunately, this internal code does not check for file existance, thus 500 error occurs # Is thought to be harmless, but does fill dspace.log with annoying exception trails # Listed here in attempt to get google bots to stop querying them # in alphabetical order Disallow: /researchworks/static/css/discovery/style.css Disallow: /researchworks/static/js/discovery/core/AbstractFacetWidget.js Disallow: /researchworks/static/js/discovery/core/AbstractManager.js Disallow: /researchworks/static/js/discovery/core/AbstractWidget.js Disallow: /researchworks/static/js/discovery/core/Core.js Disallow: /researchworks/static/js/discovery/core/Parameter.js Disallow: /researchworks/static/js/discovery/core/ParameterStore.js Disallow: /researchworks/static/js/discovery/managers/Manager.jquery.js Disallow: /researchworks/static/js/discovery/search/search.js Disallow: /researchworks/static/js/discovery/widgets/AutocompleteWidget.js Disallow: /researchworks/static/js/jquery/jquery.autocomplete.js Disallow: /researchworks/themes/ResearchWorks/images/rwwlogo1.gif Disallow: /researchworks/themes/ResearchWorks/lib/style.css