User-agent: * Disallow: /regs.php Disallow: /demo/ Disallow: /admin/ Disallow: /auth/