# All robots will spider all folders of the domain
User-agent: *
Disallow: