Poker Affiliate World
News Forums affiliate network Affiliate Tools Reviews

Go Back   Poker Affiliate World - Poker Affiliate Programs Discussion and Forums > Poker Affiliate Programs - Discussions for Poker Affiliates > Search Engine Optimization

Search Engine Optimization Better rankings in the search engines mean more money in our bank accounts. Share tips and strategies for SEO here.

Reply
 
Social Bookmarking Thread Tools Display Modes
  #1  
Old 08-13-2006, 11:13 AM
Justin's Avatar
Justin Justin is offline
The up and comer
 
Join Date: May 2005
Posts: 528
Send a message via AIM to Justin
Default No search engine traffic wanted

Ive been lookin around this morning for this, but cant seem to find what I need. How do I put the robots.txt file in so that the spiders dont go through my site? Im workin on a new site, and dont want any spiders goin throught it right now.
__________________
JustinGoff.com


NEW GOAL - $15,000 per month by December 31st
November - $12,346 net income
Reply With Quote
  #2  
Old 08-13-2006, 11:22 AM
Nick0r Nick0r is offline
Members
 
Join Date: Apr 2005
Location: London
Posts: 558
Default

User-agent: *
Disallow: /

Put the above in a file named robots.txt in the root directory of your site.
Reply With Quote
  #3  
Old 08-13-2006, 04:58 PM
Webgator's Avatar
Webgator Webgator is offline
Members
 
Join Date: Jan 2005
Posts: 116
Default

If it's a brand new site, and you havn't submitted it to the SE's and have no inbound links then you will have nothing to worry about.
__________________
Easy Poker Money - Tips, tricks, and techniques to get you in the money!
Reply With Quote
  #4  
Old 08-13-2006, 06:07 PM
mikebrad mikebrad is offline
Members
 
Join Date: Nov 2005
Posts: 466
Default

Quote:
If it's a brand new site, and you havn't submitted it to the SE's and have no inbound links then you will have nothing to worry about.
That depends. I had a site get indexed before I did anything with it. Now, that doesn't mean that someone else (like my hosting company) didn't submit it automatically or something. I added the above robots.txt file and it did not get indexed any further.

Point is: Add the robots.txt file
Reply With Quote
  #5  
Old 08-14-2006, 01:36 PM
Justin's Avatar
Justin Justin is offline
The up and comer
 
Join Date: May 2005
Posts: 528
Send a message via AIM to Justin
Default

Quote:
Originally Posted by Webgator
If it's a brand new site, and you havn't submitted it to the SE's and have no inbound links then you will have nothing to worry about.
Yeh don't do this. I have a new site that got indexed with no back links. Apaprently it has happened to a lot of webmasters recently, I believe it might have somethin to do with the Google toolbar. Theres a thread on Digital Point I think that talks about it.
__________________
JustinGoff.com


NEW GOAL - $15,000 per month by December 31st
November - $12,346 net income
Reply With Quote
  #6  
Old 08-14-2006, 01:43 PM
mikebrad mikebrad is offline
Members
 
Join Date: Nov 2005
Posts: 466
Default

interesting, I didn't think about that.
Reply With Quote
  #7  
Old 08-21-2006, 07:36 AM
Webgator's Avatar
Webgator Webgator is offline
Members
 
Join Date: Jan 2005
Posts: 116
Default

Well I have pages on domains that are not in the SE's, I have the Google toolbar running in Firefox and can honestly say that I have never experienced domains or sites showing up in the SE's index unless I submitted them via link exchanges, blogs, etc.

But yes, putting in the robots.txt should block them...if they listen. Not all spiders follow this protocal and will still follow any and all links it can find on your domain. The same applies to the noindex,nofollow tags.
__________________
Easy Poker Money - Tips, tricks, and techniques to get you in the money!
Reply With Quote
Reply


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is On
Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Search Engine Submissions??? edmc Search Engine Optimization 6 12-26-2006 04:33 PM
Search Engine Strategies Conference indieangler Search Engine Optimization 2 02-14-2006 11:45 PM
New Gambling Search Engine and Directory jharri26 New Affiliate Q&A - Site Reviews 10 10-21-2005 02:14 PM
Search Engine Submission sooners83 General Poker Affiliate Discussion 4 07-25-2005 04:13 PM
Search Engine Optimization Tool Ritch111 General Poker Affiliate Discussion 0 02-11-2005 11:01 PM


All times are GMT -5. The time now is 01:49 PM.


Poker Affiliate Programs Poker News

Powered by vBulletin® Version 3.6.7
Copyright ©2000 - 2007, Jelsoft Enterprises Ltd.
SEO by vBSEO 2.4.0