User-Agent: * Disallow: */admin/* Disallow: */order/add/* Disallow: /common/file/ Disallow: /*/common/file/ Disallow: */midi-player/load Disallow: */soundfont/* # Add to shopping cart. Bots did this and created many empty orders Disallow: /add/ # Google indexes these as separate pages for each product page Disallow: /composition/comment-prompt # mqprv_ query fields are used only when the user is logged in and should not be indexed. If you want the bots to index, do not add even empty field starting with mqprv_ Disallow: *?mqprv_* Disallow: *&mqprv_* # If we allow bots to crawl the lists by sorting them will completely kill the server and have duplicate pages many time for small lists Disallow: *pord* # Exception is the last compositions for SEO purposes, the last month top downloads, and the default sort by ever top downloads Allow: */detailed-search-composition?pord=last&pdir=desc Allow: */detailed-search-composition?pord=last&pdir=desc&ppage=* Allow: */detailed-search-composition?pord=last_month_downloads&pdir=desc Allow: */detailed-search-composition?pord=last_month_downloads&pdir=desc&ppage=* Disallow: *tord* Disallow: *sord=* # Disallow: *sscontent* Disallow: *?content=* Disallow: *?&content=* Disallow: *&content=* # !!! Allow empty content, otherwise you block all search #Allow: *&content=&*&i=&* Allow: *en/scores/sheet-music/*&content=&*&i=&* Allow: *de/scores/noten/*&content=&*&i=&* Allow: *es/scores/partituras/*&content=&*&i=&* Allow: */scores/notes/composition/detailed-search-composition?*&content=&*&i=&* # Do not remove this. The bots overload the server. This does not stop search by single instruments, but only by multiple Disallow: *?i=* Allow: *?i=&* Disallow: *&i=* Allow: *&i=&* Disallow: */edit/* # The view-pdf page is only for registered members Disallow: */composition/view-pdf/* Disallow: */edit?* Disallow: *show_form* Disallow: *smi=* Disallow: *gclid=* Disallow: */compositionid/* Disallow: *tabs=comments Disallow: */detailed-search-shop?postBack=true* Disallow: *layout=* # Download file link - members only section Disallow: *download=* Disallow: *show_form=* Disallow: *showloginform=* Disallow: *fb_xd_fragment=* Disallow: *newcomp_page=* Disallow: *topdownl_page=* Disallow: *shoppage=* Disallow: *../* Disallow: *newcomp_page* Disallow: *topdownl_page?* Disallow: *newtopic_page* Disallow: */composition/detailed-search-result* Disallow: */composition/detailed-search-shop-result* Disallow: */interpretation/view/ipid/* Disallow: */get-*-partial* Disallow: */get-select-element* Disallow: */remember/add* Disallow: *?synth=1 Disallow: *?soundfont=1 Disallow: */soundfonts/* Disallow: *?soundfont_low_quality=1 Disallow: */soundfont_low_quality/* Disallow: */members/member/paypal-old-subscription Disallow: */create-paypal-checkout-subscription Disallow: */embed/* Disallow: */change-cookies-policy* Disallow: */interpretation/similar-you-tube-videos* Crawl-delay: 15 User-agent: Amazonbot Disallow: / User-agent: 008 Disallow: / User-agent: AhrefsBot Disallow: / User-agent: SMTBot Disallow: / User-Agent: yacy Disallow: / User-agent: 360Spider Disallow: / User-agent: 80legs Disallow: / User-agent: Abonti Disallow: / User-agent: Aboundex Disallow: / User-agent: Acunetix Disallow: / User-agent: ADmantX Disallow: / User-agent: AIBOT Disallow: / User-agent: AiHitBot Disallow: / User-agent: Aipbot Disallow: / User-agent: Alexibot Disallow: / User-agent: Alligator Disallow: / User-agent: AllSubmitter Disallow: / User-agent: Anarchie Disallow: / User-agent: Apexoo Disallow: / User-agent: ASPSeek Disallow: / User-agent: Asterias Disallow: / User-agent: Attach Disallow: / User-agent: autoemailspider Disallow: / User-agent: BackDoorBot Disallow: / User-agent: Backlink-Ceck Disallow: / User-agent: backlink-check Disallow: / User-agent: BacklinkCrawler Disallow: / User-agent: BackStreet Disallow: / User-agent: BackWeb Disallow: / User-agent: Badass Disallow: / User-agent: Bandit Disallow: / User-agent: BatchFTP Disallow: / User-agent: Battleztar Bazinga Disallow: / User-agent: BBBike Disallow: / User-agent: BDFetch Disallow: / User-agent: BecomeBot Disallow: / User-agent: BetaBot Disallow: / User-agent: Bigfoot Disallow: / User-agent: Bitacle Disallow: / User-agent: Black Hole Disallow: / User-agent: Blackboard Disallow: / User-agent: BlackWidow Disallow: / User-agent: BLEXBot Disallow: / User-agent: Blow Disallow: / User-agent: BlowFish Disallow: / User-agent: Boardreader Disallow: / User-agent: Bolt Disallow: / User-agent: BomboraBot Disallow: / User-agent: BotALot Disallow: / User-agent: Brandprotect Disallow: / User-agent: Brandwatch Disallow: / User-agent: Bubing Disallow: / User-agent: Buddy Disallow: / User-agent: BuiltBotTough Disallow: / User-agent: BuiltWith Disallow: / User-agent: Bullseye Disallow: / User-agent: BunnySlippers Disallow: / User-agent: BuzzSumo Disallow: / User-agent: Calculon Disallow: / User-agent: CATExplorador Disallow: / User-agent: CazoodleBot Disallow: / User-agent: CCBot Disallow: / User-agent: Cegbfeieh Disallow: / User-agent: CheeseBot Disallow: / User-agent: CherryPicker Disallow: / User-agent: ChinaClaw Disallow: / User-agent: Chlooe Disallow: / User-agent: Claritybot Disallow: / User-agent: Cliqzbot Disallow: / User-agent: Cogentbot Disallow: / User-agent: cognitiveseo Disallow: / User-agent: Collector Disallow: / User-agent: com.plumanalytics Disallow: / User-agent: Copier Disallow: / User-agent: CopyRightCheck Disallow: / User-agent: Copyscape Disallow: / User-agent: Cosmos Disallow: / User-agent: Craftbot Disallow: / User-agent: CrazyWebCrawler Disallow: / User-agent: CRAZYWEBCRAWLER Disallow: / User-agent: Crescent Disallow: / User-agent: CSHttp Disallow: / User-agent: Curious Disallow: / User-agent: Custo Disallow: / User-agent: DatabaseDriverMysqli Disallow: / User-agent: DataCha0s Disallow: / User-agent: DBLBot Disallow: / User-agent: Demon Disallow: / User-agent: Deusu Disallow: / User-agent: Devil Disallow: / User-agent: DIIbot Disallow: / User-agent: Dirbuster Disallow: / User-agent: Disco Disallow: / User-agent: Discobot Disallow: / User-agent: Discoverybot Disallow: / User-agent: DittoSpyder Disallow: / User-agent: DJEcoBot Disallow: / User-agent: DomainAppender Disallow: / User-agent: DomainCrawler Disallow: / User-agent: DomainSigmaCrawler Disallow: / User-agent: dotbot Disallow: / User-agent: Dotbot Disallow: / User-agent: Download Demon Disallow: / User-agent: Download Devil Disallow: / User-agent: Download Wonder Disallow: / User-agent: Dragonfly Disallow: / User-agent: Drip Disallow: / User-agent: DTS Agent Disallow: / User-agent: EasyDL Disallow: / User-agent: Ebingbong Disallow: / User-agent: eCatch Disallow: / User-agent: ECCP/1.0 Disallow: / User-agent: Ecxi Disallow: / User-agent: EirGrabber Disallow: / User-agent: EMail Collector Disallow: / User-agent: EMail Extractor Disallow: / User-agent: EMail Siphon Disallow: / User-agent: EMail Wolf Disallow: / User-agent: EroCrawler Disallow: / User-agent: Evil Disallow: / User-agent: Exabot Disallow: / User-agent: Express WebPictures Disallow: / User-agent: Extractor Disallow: / User-agent: ExtractorPro Disallow: / User-agent: Extreme Picture Finder Disallow: / User-agent: EyeNetIE Disallow: / User-agent: Ezooms Disallow: / User-agent: FDM Disallow: / User-agent: FHscan Disallow: / User-agent: Fimap Disallow: / User-agent: FindLinks Disallow: / User-agent: Findxbot Disallow: / User-agent: Firefox/7.0 Disallow: / User-agent: FlashGet Disallow: / User-agent: Flunky Disallow: / User-agent: Foobot Disallow: / User-agent: fq Disallow: / User-agent: Freeuploader Disallow: / User-agent: FrontPage Disallow: / User-agent: fyberspider Disallow: / User-agent: Fyrebot Disallow: / User-agent: GalaxyBot Disallow: / User-agent: Genieo Disallow: / User-agent: Getintent Disallow: / User-agent: GetRight Disallow: / User-agent: GetWeb Disallow: / User-agent: Gigablast Disallow: / User-agent: Gigabot Disallow: / User-agent: Go!Zilla Disallow: / User-agent: Go-Ahead-Got-It Disallow: / User-agent: Gotit Disallow: / User-agent: GoZilla Disallow: / User-agent: Grabber Disallow: / User-agent: GrabNet Disallow: / User-agent: Grafula Disallow: / User-agent: GrapeFX Disallow: / User-agent: GrapeshotCrawler Disallow: / User-agent: GridBot Disallow: / User-agent: GT::WWW Disallow: / User-agent: HaosouSpider Disallow: / User-agent: Harvest Disallow: / User-agent: Havij Disallow: / User-agent: HEADMasterSEO Disallow: / User-agent: Heritrix Disallow: / User-agent: Hloader Disallow: / User-agent: HMView Disallow: / User-agent: HTMLparser Disallow: / User-agent: HTTP::Lite Disallow: / User-agent: HTTrack Disallow: / User-agent: Humanlinks Disallow: / User-agent: HybridBot Disallow: / User-agent: Iblog Disallow: / User-agent: Id-search Disallow: / User-agent: IDBot Disallow: / User-agent: IlseBot Disallow: / User-agent: Image Fetch Disallow: / User-agent: Image Stripper Disallow: / User-agent: Image Sucker Disallow: / User-agent: Indy Library Disallow: / User-agent: InfoNaviRobot Disallow: / User-agent: InfoTekies Disallow: / User-agent: instabid Disallow: / User-agent: Intelliseek Disallow: / User-agent: InterGET Disallow: / User-agent: Internet Ninja Disallow: / User-agent: InternetSeer Disallow: / User-agent: internetVista monitor Disallow: / User-agent: Iria Disallow: / User-agent: IRLbot Disallow: / User-agent: Iskanie Disallow: / User-agent: JamesBOT Disallow: / User-agent: Jbrofuzz Disallow: / User-agent: JennyBot Disallow: / User-agent: JetCar Disallow: / User-agent: JikeSpider Disallow: / User-agent: JOC Web Spider Disallow: / User-agent: Joomla Disallow: / User-agent: Jorgee Disallow: / User-agent: JustView Disallow: / User-agent: Jyxobot Disallow: / User-agent: Kenjin Spider Disallow: / User-agent: Keyword Density Disallow: / User-agent: Lanshanbot Disallow: / User-agent: Larbin Disallow: / User-agent: LeechFTP Disallow: / User-agent: LeechGet Disallow: / User-agent: LexiBot Disallow: / User-agent: Lftp Disallow: / User-agent: LibWeb Disallow: / User-agent: Libwhisker Disallow: / User-agent: Lightspeedsystems Disallow: / User-agent: Likse Disallow: / User-agent: Linkdexbot Disallow: / User-agent: LinkextractorPro Disallow: / User-agent: LinkpadBot Disallow: / User-agent: LinkScan Disallow: / User-agent: LinksManager Disallow: / User-agent: LinkWalker Disallow: / User-agent: LinqiaMetadataDownloaderBot Disallow: / User-agent: LinqiaRSSBot Disallow: / User-agent: LinqiaScrapeBot Disallow: / User-agent: Lipperhey Disallow: / User-agent: Litemage_walker Disallow: / User-agent: Lmspider Disallow: / User-agent: LNSpiderguy Disallow: / User-agent: Ltx71 Disallow: / User-agent: lwp-request Disallow: / User-agent: lwp-trivial Disallow: / User-agent: LWP::Simple Disallow: / User-agent: Mag-Net Disallow: / User-agent: Magnet Disallow: / User-agent: magpie-crawler Disallow: / User-agent: Mail.ru Disallow: / User-agent: Majestic12 Disallow: / User-agent: MarkMonitor Disallow: / User-agent: MarkWatch Disallow: / User-agent: Mass Downloader Disallow: / User-agent: Masscan Disallow: / User-agent: Mata Hari Disallow: / User-agent: Meanpathbot Disallow: / User-agent: Mediatoolkitbot Disallow: / User-agent: MegaIndex.ru Disallow: / User-agent: metajobbot Disallow: / User-agent: Metauri Disallow: / User-agent: MFC_Tear_Sample Disallow: / User-agent: Microsoft Data Access Disallow: / User-agent: Microsoft URL Control Disallow: / User-agent: MIDown tool Disallow: / User-agent: MIIxpc Disallow: / User-agent: Mister PiX Disallow: / User-agent: MJ12bot Disallow: / User-agent: Mojeek Disallow: / User-agent: MojeekBot Disallow: / User-agent: Morfeus Fucking Scanner Disallow: / User-agent: MS Web Services Client Protocol Disallow: / User-agent: MSFrontPage Disallow: / User-agent: MSIE 6.0 Disallow: / User-agent: MSIECrawler Disallow: / User-agent: Msrabot Disallow: / User-agent: Musobot Disallow: / User-agent: Name Intelligence Disallow: / User-agent: Nameprotect Disallow: / User-agent: Navroad Disallow: / User-agent: NearSite Disallow: / User-agent: Needle Disallow: / User-agent: Nessus Disallow: / User-agent: Net Vampire Disallow: / User-agent: NetAnts Disallow: / User-agent: Netcraft Disallow: / User-agent: netEstate NE Crawler Disallow: / User-agent: NetLyzer Disallow: / User-agent: NetMechanic Disallow: / User-agent: NetSpider Disallow: / User-agent: Nettrack Disallow: / User-agent: NetZIP Disallow: / User-agent: NextGenSearchBot Disallow: / User-agent: Nibbler Disallow: / User-agent: NICErsPRO Disallow: / User-agent: Niki-bot Disallow: / User-agent: Nikto Disallow: / User-agent: NimbleCrawler Disallow: / User-agent: Ninja Disallow: / User-agent: Nmap Disallow: / User-agent: NPbot Disallow: / User-agent: Nutch Disallow: / User-agent: Octopus Disallow: / User-agent: Offline Explorer Disallow: / User-agent: Offline Navigator Disallow: / User-agent: Openfind Disallow: / User-agent: OpenLinkProfiler Disallow: / User-agent: Openvas Disallow: / User-agent: OrangeBot Disallow: / User-agent: OrangeSpider Disallow: / User-agent: OutfoxBot Disallow: / User-agent: Page Analyzer Disallow: / User-agent: Page Grabber Disallow: / User-agent: page scorer Disallow: / User-agent: PageAnalyzer Disallow: / User-agent: PageGrabber Disallow: / User-agent: PageScorer Disallow: / User-agent: Panscient Disallow: / User-agent: Papa Foto Disallow: / User-agent: Pavuk Disallow: / User-agent: pcBrowser Disallow: / User-agent: PECL::HTTP Disallow: / User-agent: PeoplePal Disallow: / User-agent: PHPCrawl Disallow: / User-agent: Pi-Monster Disallow: / User-agent: Picscout Disallow: / User-agent: Picsearch Disallow: / User-agent: PictureFinder Disallow: / User-agent: Pimonster Disallow: / User-agent: Pixray Disallow: / User-agent: PleaseCrawl Disallow: / User-agent: plumanalytics Disallow: / User-agent: Pockey Disallow: / User-agent: POE-Component-Client-HTTP Disallow: / User-agent: Probethenet Disallow: / User-agent: ProPowerBot Disallow: / User-agent: ProWebWalker Disallow: / User-agent: Proximic Disallow: / User-agent: Psbot Disallow: / User-agent: Pump Disallow: / User-agent: PyCurl Disallow: / User-agent: QueryN Metasearch Disallow: / User-agent: Qwantify Disallow: / User-agent: RankActive Disallow: / User-agent: RankActiveLinkBot Disallow: / User-agent: RankFlex Disallow: / User-agent: RankingBot Disallow: / User-agent: RankingBot2 Disallow: / User-agent: Rankivabot Disallow: / User-agent: RankurBot Disallow: / User-agent: RealDownload Disallow: / User-agent: Reaper Disallow: / User-agent: RebelMouse Disallow: / User-agent: Recorder Disallow: / User-agent: RedesScrapy Disallow: / User-agent: ReGet Disallow: / User-agent: RepoMonkey Disallow: / User-agent: Ripper Disallow: / User-agent: RocketCrawler Disallow: / User-agent: rogerbot Disallow: / User-agent: Rogerbot Disallow: / User-agent: SalesIntelligent Disallow: / User-agent: SBIder Disallow: / User-agent: ScanAlert Disallow: / User-agent: Scanbot Disallow: / User-agent: Scrapy Disallow: / User-agent: Screaming Disallow: / User-agent: Screaming Frog SEO Spider Disallow: / User-agent: ScreenerBot Disallow: / User-agent: Searchestate Disallow: / User-agent: SearchmetricsBot Disallow: / User-agent: Semrush Disallow: / User-agent: SemrushBot Disallow: / User-agent: SemrushBot-SA Disallow: / User-agent: SEOkicks Disallow: / User-agent: SEOkicks-Robot Disallow: / User-agent: SEOlyticsCrawler Disallow: / User-agent: Seomoz Disallow: / User-agent: SEOprofiler Disallow: / User-agent: seoscanners Disallow: / User-agent: SEOstats Disallow: / User-agent: Siphon Disallow: / User-agent: SISTRIX Disallow: / User-agent: SISTRIX Crawler Disallow: / User-agent: Site Sucker Disallow: / User-agent: Sitebeam Disallow: / User-agent: SiteExplorer Disallow: / User-agent: Siteimprove Disallow: / User-agent: SiteLockSpider Disallow: / User-agent: SiteSnagger Disallow: / User-agent: SiteSucker Disallow: / User-agent: Sitevigil Disallow: / User-agent: Slackbot-LinkExpanding Disallow: / User-agent: SlySearch Disallow: / User-agent: SmartDownload Disallow: / User-agent: Snake Disallow: / User-agent: Snapbot Disallow: / User-agent: Snoopy Disallow: / User-agent: SocialRankIOBot Disallow: / User-agent: Sogou web spider Disallow: / User-agent: Sosospider Disallow: / User-agent: Sottopop Disallow: / User-agent: SpaceBison Disallow: / User-agent: Spammen Disallow: / User-agent: SpankBot Disallow: / User-agent: Spanner Disallow: / User-agent: Spbot Disallow: / User-agent: Spinn3r Disallow: / User-agent: SputnikBot Disallow: / User-agent: Sqlmap Disallow: / User-agent: Sqlworm Disallow: / User-agent: Sqworm Disallow: / User-agent: Steeler Disallow: / User-agent: Stripper Disallow: / User-agent: Sucker Disallow: / User-agent: Sucuri Disallow: / User-agent: SuperBot Disallow: / User-agent: SuperHTTP Disallow: / User-agent: Surfbot Disallow: / User-agent: SurveyBot Disallow: / User-agent: Suzuran Disallow: / User-agent: Swiftbot Disallow: / User-agent: Szukacz Disallow: / User-agent: T0PHackTeam Disallow: / User-agent: T8Abot Disallow: / User-agent: tAkeOut Disallow: / User-agent: Teleport Disallow: / User-agent: TeleportPro Disallow: / User-agent: Telesoft Disallow: / User-agent: Telesphoreo Disallow: / User-agent: Telesphorep Disallow: / User-agent: The Intraformant Disallow: / User-agent: TheNomad Disallow: / User-agent: TightTwatBot Disallow: / User-agent: Titan Disallow: / User-agent: Toata Disallow: / User-agent: Toweyabot Disallow: / User-agent: Trendictionbot Disallow: / User-agent: True_Robot Disallow: / User-agent: Turingos Disallow: / User-agent: Turnitin Bot Disallow: / User-agent: Turnitin Robot Disallow: / User-agent: TurnitinBot Disallow: / User-agent: TwengaBot Disallow: / User-agent: Twice Disallow: / User-agent: Typhoeus Disallow: / User-agent: UnisterBot Disallow: / User-agent: URLy Warning Disallow: / User-agent: URLy.Warning Disallow: / User-agent: Vacuum Disallow: / User-agent: Vagabondo Disallow: / User-agent: VB Project Disallow: / User-agent: VCI Disallow: / User-agent: VeriCiteCrawler Disallow: / User-agent: VidibleScraper Disallow: / User-agent: Virusdie Disallow: / User-agent: VoidEYE Disallow: / User-agent: Voil Disallow: / User-agent: Voltron Disallow: / User-agent: Wallpapers/3.0 Disallow: / User-agent: WallpapersHD Disallow: / User-agent: WASALive-Bot Disallow: / User-agent: WBSearchBot Disallow: / User-agent: Web Auto Disallow: / User-agent: Web Bandit Disallow: / User-agent: Web Collage Disallow: / User-agent: Web Copier Disallow: / User-agent: Web Enhancer Disallow: / User-agent: Web Fetch Disallow: / User-agent: Web Fuck Disallow: / User-agent: Web Image Collector Disallow: / User-agent: Web Pix Disallow: / User-agent: Web Reaper Disallow: / User-agent: Web Sauger Disallow: / User-agent: Web Stripper Disallow: / User-agent: Web Sucker Disallow: / User-agent: Web Whacker Disallow: / User-agent: Webalta Disallow: / User-agent: WebAuto Disallow: / User-agent: WebBandit Disallow: / User-agent: WebCollage Disallow: / User-agent: WebCopier Disallow: / User-agent: WEBDAV Disallow: / User-agent: WEBDAV Client Disallow: / User-agent: WebEnhancer Disallow: / User-agent: WebFetch Disallow: / User-agent: WebFuck Disallow: / User-agent: WebGo IS Disallow: / User-agent: WebImageCollector Disallow: / User-agent: WebLeacher Disallow: / User-agent: WebmasterWorldForumBot Disallow: / User-agent: webmeup-crawler Disallow: / User-agent: WebPix Disallow: / User-agent: WebReaper Disallow: / User-agent: WebSauger Disallow: / User-agent: Webshag Disallow: / User-agent: Website Extractor Disallow: / User-agent: Website Quester Disallow: / User-agent: WebsiteExtractor Disallow: / User-agent: WebsiteQuester Disallow: / User-agent: Webster Disallow: / User-agent: WebStripper Disallow: / User-agent: WebSucker Disallow: / User-agent: WebWhacker Disallow: / User-agent: WebZIP Disallow: / User-agent: WeSEE Disallow: / User-agent: Whack Disallow: / User-agent: Whacker Disallow: / User-agent: Whatweb Disallow: / User-agent: Widow Disallow: / User-agent: WinHTTrack Disallow: / User-agent: WiseGuys Robot Disallow: / User-agent: WISENutbot Disallow: / User-agent: Wonderbot Disallow: / User-agent: Woobot Disallow: / User-agent: Wotbox Disallow: / User-agent: Wprecon Disallow: / User-agent: WPScan Disallow: / User-agent: WWW-Collector-E Disallow: / User-agent: WWW-Mechanize Disallow: / User-agent: WWW::Mechanize Disallow: / User-agent: WWWOFFLE Disallow: / User-agent: x22Mozilla Disallow: / User-agent: Xaldon WebSpider Disallow: / User-agent: Xaldon_WebSpider Disallow: / User-agent: Xenu Disallow: / User-agent: yacybot Disallow: / User-agent: YoudaoBot Disallow: / User-agent: Zade Disallow: / User-agent: Zermelo Disallow: / User-agent: Zeus Disallow: / User-agent: Zgrab Disallow: / User-agent: Zitebot Disallow: / User-agent: ZmEu Disallow: / User-agent: ZumBot Disallow: / User-agent: ZyBorg Disallow: / User-agent: PiplBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: ltx71 - (http://ltx71.com/) Disallow: / User-agent: PetalBot Disallow: / User-agent: Scrapy/2.11.2 (+https://scrapy.org) Disallow: /