# Disallow Access to spiders/crawlers so individual # files pertinent to courses & resources are not # spidered and directly listed in search results page # This allows all directories containing the .html files # to be spidered but not local files linked in those # .html files #disallow offline browsers and bad bots User-agent: HTTrack Disallow: / User-agent: HTTrack/3.0x Disallow: / User-agent: HTTrack Website Copier/3.0x Disallow: / User-agent: Teleport Disallow: / User-agent: Teleport+Pro/1.29 Disallow: / User-agent: Teleport+Pro/1.29.1820 Disallow: / #Disallow all access to datasheets & source code directly User-agent: * # Root Site # images Disallow: /images/ Disallow: /Whitepapers/ Disallow: /software/PeripheralLibrary/LibApi/