User-agent: * Disallow: /database/ Disallow: /images/ Disallow: /uploads/ Disallow: /bkm/ Disallow: /log/ Disallow: /scripts/ Disallow: /aspnet_client/ Disallow: /webctrl_client/ Request-rate: 1/5 # maximum rate is one page every 5 seconds