Important tiny file...
The robots.txt file is placed in your www or public_html directory. So the correct location where to put this file is in www.example.com/robots.txt. This file indicates how “deep” the spiders can crawl into your website.
It’s possible to keep a spider out of a directory that’s called “customers” or a directory like “images”. Obviously it’s a request, not a guarantee. And if you don’t want the file /secret1960 to be found by anyone, maybe it’s better not to put it on the internet anyway, and especially not in your robots.txt file. If you want to protect your information you use a password security like .htaccess or a login-script.
- This file can make or break your website if used wrong.
- Add the robots.txt tag in the public_html or www directory.
SEO Influence Meter
The robots.txt file has a lot of
SEO influence if used wrong!
Affordable & Effective
We offer affordable SEO services that are fast and effective.
It's not that difficult to create meta-tags. We've made it simple for you by offering you this free meta-tags wizard.
Boost My Metatags
You've created the perfect meta-tags. Now it's time to let the world know your website is open for business.
Create My MetaTags
Rely on the experts. We create the prefect meta-tags for you. Build around the perfect keywords attracting the right customers.
Need some professional
Contact our Customer Service representative to make an appointment and to answer all your questions!