# Robots.txt # For domain: http://blog.khalla.it # All robots will spider the domain User-agent: * Disallow: /img/ Disallow: /mdb-database/ Disallow: /public/