# $Id: robots.txt,v 1.8 2001/11/14 13:13:08 kapil Exp $ # # This is a file retrieved by webwalkers a.k.a. spiders that # conform to a defacto standard. # See # # The webmaster for this site is # # Format is: # User-agent: # Disallow: | # Flag Date By Reason # $l1- 19950130 epc finally understood what the file was for! # $L2= 19960909 epc fixed url since mak moved to Webcrawler... # $L3= 19970811 epc drop /Stretch/ # $L4= 19991102 krusch fixed User-agent capitalization and contact info # $L5= 20010327 krusch Updated disallow rules # ----------------------------------------------------------------------------- User-agent: Googlebot Disallow: /Admin/ Disallow: /administration/ Disallow: /cartes/ Disallow: /includes/ Disallow: /BLUENEW/ Disallow: /asp/ Disallow: /BlueNewphoto.asp* Disallow: /BlueNewInfoCommande.asp* Disallow: /BlueNewUneCarte.asp* Disallow: /BlueNewRenseignement.asp?Code=Pro Disallow: /BlueNewRenseignement.asp?Code=BDv Disallow: /Famille.asp* Disallow: /Produit.asp* Disallow: /etaIndex.asp* Disallow: /marIndex.asp* Disallow: /bluelagoon-carte-de-plongee.asp?carte=CartePlongeeSriLanka Disallow: /bluelagoon-carte-de-plongee.asp?carte=CartePlongeeThailande Disallow: /bluelagoon-carte-de-plongee.asp?carte=cartePlongeMalaisieSipadan Disallow: /bluelagoon-carte-de-plongee.asp?carte=cartePlongeMalaisieTioman Disallow: /bluelagoon-carte-de-plongee.asp?carte=cartePlongeMalaisieSusu Disallow: /bluelagoon-carte-de-plongee.asp?carte=cartePlongeMalaisieMabul Disallow: /bluelagoon-carte-de-plongee.asp?carte=CartePlongeeCuba Disallow: /bluelagoon-carte-de-plongee.asp?carte=CartePlongeeThailande2 Disallow: /bluelagoon-carte-de-plongee.asp?carte=CartePlongeeOman Disallow: /bluelagoon-carte-de-plongee. asp?carte=cartePlongeMalaisieLayang Disallow: /BlueLagoon/BlPhDiaporamaFin.asp Disallow: /BlueFamilleDiaporama.asp* User-agent: * Disallow: /Admin/ Disallow: /administration/ Disallow: /cartes/ Disallow: /includes/ Disallow: /BLUENEW/ Disallow: /asp/ Disallow: /refblue/ Disallow: /refmarmara/ Disallow: /refetapes/ Disallow: /info-hotel/ Disallow: /info-sejour/ Disallow: /prix/ Disallow: /BlueNewphoto. asp Disallow: /BlueNewInfoCommande. asp Disallow: /BlueNewUneCarte. asp Disallow: /BlueNewRenseignement.asp?Code=Pro Disallow: /BlueNewRenseignement.asp?Code=BDv Disallow: /BlueNewFamille.asp Disallow: /BlueNewProduit1a.asp Disallow: /BlueNewProduit1b.asp Disallow: /BlueNewProduit1c.asp Disallow: /Famille.asp Disallow: /Produit.asp Disallow: /BlueNewConcours3.asp Disallow: /BlueNewConcours2Fin.asp Disallow: /BlueNewConcours2Fin.asp Disallow: /BlueNewConcours1.asp Disallow: /BlueNewConcours3.asp Disallow: /EtaIndex.asp?Client= Disallow: /MarIndex.asp?Client= Disallow: /BlueNewConcours1.asp Disallow: /BlueNewConcours1.asp Disallow: /BlueFamilleDiaporama.asp