#This script specifies the files and folders on GandaSpace.com that shouldn't #be indexed by search engine spiders. #User-agent field specifies the robot, for example googlebot. In this case all robots User-agent: * #Disallow prevents the robot from indexing/downloading the specified folders Disallow: /blocks/ Disallow: /crm/ Disallow: /forexrates/ Disallow: /functions/ Disallow: /includes/ Disallow: /javascript/ Disallow: /metatags/ Disallow: /shop/ Disallow: /sms/ #Disallow prevents the robot from indexing any dynamic urls Disallow: /?