# robot exclusion for site User-agent: * Disallow: /dev/ Disallow: /c/dev/* Disallow: /res Disallow: /c/list.html