# All robots will spider the domain User-agent: * Disallow: # Disallow directory User-agent: * Disallow: /sk.admin/ Disallow: /Admin/ Disallow: /common/ Disallow: /kor/include/ Disallow: /eng/include/ Disallow: /files/ Disallow: /img/