User-agent: * Disallow: /log/ User-agent: spbot Disallow: /