Pages: 1
This topic has been closed for further discussion.
#1 2009-08-18 22:56:39robots.txt
amber.ella
Member
From: Philippines
Registered: 2009-06-17
Posts: 60
I've been thanked 0 times.
Offline
Member
From: Philippines
Registered: 2009-06-17
Posts: 60
I've been thanked 0 times.
Offline
What is robots.txt?
What's the importance of robots.txt?
#2 2009-08-18 23:39:08 Re: robots.txt
waveshoppe
Administrator
From: 10% Off W/Coupon: SR2010
Registered: 2005-06-10
Posts: 2300
I've been thanked 80 times.
Offline
Administrator
From: 10% Off W/Coupon: SR2010
Registered: 2005-06-10
Posts: 2300
I've been thanked 80 times.
Offline
#3 2009-08-19 00:17:25 Re: robots.txt
Robots.txt is a text file you put on your site to tell search robots which pages you would like them not to visit. You can visit http://www.javascriptkit.com/howto/robots.shtml to know how to create robots.txt file.
Last edited by gissele (2009-08-19 00:19:39)#4 2009-08-19 02:57:13 Re: robots.txt
1-Clan
Administrator
From: Maidstone, Kent, UK
Registered: 2009-03-27
Posts: 942
I've been thanked 36 times.
Offline
Administrator
From: Maidstone, Kent, UK
Registered: 2009-03-27
Posts: 942
I've been thanked 36 times.
Offline
The google webmasters guidlines to robots.txt http://www.google.com/support/webmasters/bin/answer.py?hl=en&answer=35303
Also see the crawler access guidlines here http://www.google.com/support/webmasters/bin/topic.py?topic=20667
"stupid people say stupid things, and smart people out smart each other!" SOAD
Game Servers at high speeds! | URL Shortener Creating tiny links in seconds!
Free SEO Tools collection and more! | Web Design, Netfox CMS, SEO and much more!
Game Servers at high speeds! | URL Shortener Creating tiny links in seconds!
Free SEO Tools collection and more! | Web Design, Netfox CMS, SEO and much more!
| Never |
You are not logged in.
Active Discussions
Review Requests & Intros
Powered by 
