<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	xmlns:media="http://search.yahoo.com/mrss/">

<channel>
	<title>SEO.com &#187; Seth Ellsworth</title>
	<atom:link href="http://www.seo.com/author/seth/feed/" rel="self" type="application/rss+xml" />
	<link>http://www.seo.com</link>
	<description>Search Engine Optimization SEO &#38; Internet Marketing Company</description>
	<lastBuildDate>Fri, 24 May 2013 14:50:19 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.5.1</generator>
<atom:link rel="hub" href="http://pubsubhubbub.appspot.com"/><atom:link rel="hub" href="http://superfeedr.com/hubbub"/>		<item>
		<title>Hooking Up Your Hyperlink Rel and Not Following It</title>
		<link>http://www.seo.com/blog/hooking-up-your-hyperlink-rel-and-not-following-it/?utm_source=rss&#038;utm_medium=rss&#038;utm_campaign=hooking-up-your-hyperlink-rel-and-not-following-it</link>
		<comments>http://www.seo.com/blog/hooking-up-your-hyperlink-rel-and-not-following-it/#comments</comments>
		<pubDate>Wed, 03 Jun 2009 15:27:03 +0000</pubDate>
		<dc:creator>Seth Ellsworth</dc:creator>
				<category><![CDATA[Blog]]></category>

		<guid isPermaLink="false">http://www.seo.com/?p=2710</guid>
		<description><![CDATA[<p><p><a href="http://www.seo.com/blog/hooking-up-your-hyperlink-rel-and-not-following-it/">Hooking Up Your Hyperlink Rel and Not Following It</a> is a post by SEO expert <a rel="author" href="http://www.seo.com/author/seth/">Seth Ellsworth</a>. For information about our <a href="http://www.seo.com/services/">SEO services</a> or more great SEO tips and tricks, visit the <a href="http://www.seo.com/blog">SEO.com blog</a>.</p><p>Relnofollow is a cool hyperlink attribute. In the SEO world, we say relnofollow as if it’s a legit word that Webster’s should know about. No, it’s not in the dictionary yet, because there’s an equals sign and some quotation marks in the real version of relnofollow that make relnofollow actual HTML code. It normally looks [...]<a href='http://www.seo.com/request-a-proposal/?utm_source=seoblog&utm_medium=banner&utm_content=insight&utm_campaign=blogcta'><img width="670" height="116" src="http://www.seo.com/wp-content/uploads/2012/06/Get-Internet-Marketing-Insight-For-Your-Company-SEO.com_.png" class="attachment-blog-header wp-post-image" alt="Get Internet Marketing Insight For Your Company - SEO.com" /></a></p></p><p><a href="http://www.seo.com/blog/hooking-up-your-hyperlink-rel-and-not-following-it/">Hooking Up Your Hyperlink Rel and Not Following It</a> is a post by SEO expert <a rel="author" href="http://www.seo.com/author/seth/">Seth Ellsworth</a>. For information about our <a href="http://www.seo.com/services/">SEO services</a> or more great SEO tips and tricks, visit the <a href="http://www.seo.com/blog">SEO.com blog</a>.</p>]]></description>
				<content:encoded><![CDATA[<p><a href="http://www.seo.com/blog/hooking-up-your-hyperlink-rel-and-not-following-it/">Hooking Up Your Hyperlink Rel and Not Following It</a> is a post by SEO expert <a rel="author" href="http://www.seo.com/author/seth/">Seth Ellsworth</a>. For information about our <a href="http://www.seo.com/services/">SEO services</a> or more great SEO tips and tricks, visit the <a href="http://www.seo.com/blog">SEO.com blog</a>.</p><p><img class="alignright size-full wp-image-2713" title="nofollow" src="http://www.seo.com/wp-content/uploads/2009/05/nofollow.jpg" alt="nofollow" width="302" height="215" align="right" />Relnofollow is a cool hyperlink attribute. In the SEO world, we say relnofollow as if it’s a legit word that Webster’s should know about. No, it’s not in the dictionary yet, because there’s an equals sign and some quotation marks in the real version of relnofollow that make relnofollow actual HTML code. It normally looks like this:</p>
<pre>rel=”nofollow”</pre>
<p>Here’s the actual HTML with the correct relnofollow hyperlink attribute usage:</p>
<pre class="Body" style="margin: 0in 0in 0pt;"><span style="font-family: Calibri; mso-bidi-font-size: 11.0pt;">&lt;a href="<a href="http://www.seo.com/"><span style="color: #000099;">http://www.seo.com</span></a>" rel="nofollow"&gt;No follow link&lt;/a&gt;

</span></pre>
<p>When referring to it, we don’t say rel equals quotation mark no follow quotation mark. That would be completely fatuous. If you haven’t guessed, I’m going to be talking about relnofollow and how it relates to your SEO success, so listen up.</p>
<p>First, there’s good ways and stupid ways to use relnofollow. We’ll discuss the good ways in detail, and mention a few bad ways, because you shouldn’t be doing those unless you’re a knucklehead who likes to commit SEO suicide.</p>
<p>In conversations about relnofollow, you will often hear mention of pagerank, or PR as SEOs affectionately refer to it. Pagerank has become an important attribute of overall SEO health, and matters quite a bit when thinking about why the heck we use relnofollow in the first place.</p>
<p>Over time, and through effective on- and off-page search engine optimization, you achieve pagerank, which is Google’s way of declaring how important your site is, or how much authority it has in their index. Pagerank, in Google, is pretty important and shouldn’t be ignored.</p>
<p>Relnofollow allows you to carefully manage and distribute your pagerank across pages of your site, and also the sites that you link to. It allows your search engine indexing to be clean and powerful.</p>
<p>How Does RelNoFollow work?</p>
<p>Quite simply, it tells the search engine spiders to not follow a particular link and to not pass link authority or pagerank to the page that the link points to. If you have pages with many links, you can use relnofollow so that you don’t pass pagerank and you don’t pass authority. Nofollow is critical in managing your sites pagerank and in keeping your site’s SEO attributes clean. By maintaining a high pagerank, and by nofollowing links to shady or semi-shady sites, you can better maintain SEO trust and authority which is critical for search engine success.</p>
<p>Back in 2005, Google started paying attention to relnofollow. You can find this quote <a href="http://googleblog.blogspot.com/2005/01/preventing-comment-spam.html">on the official Google blog</a>:</p>
<p>“From now on, when Google sees the attribute (rel=&#8221;nofollow&#8221;) on hyperlinks, those links won&#8217;t get any credit when we rank websites in our search results.”</p>
<p>Google initially made this move in response to the comment spam that was hammering bloggers. Commenting was the new and improved way to get “unlimited” links. People who wanted  links for their site would post comments on random blogs, most of them worthless, and put the anchor text they want to rank for as their name, which is made into a link to their site in most blogging platforms. They would also stuff the comment with links. Google tested out a new tag, which became relnofollow, to combat the spammers. They have suggested the use of relnofollow anywhere that users can post their own links. Since then, there have been many other helpful uses for relnofollow.</p>
<p>Pagerank is passed through links. Incoming links with good authority provide pagerank. Each page of your site has its own pagerank so you can end up with different pageranks throughout your site. Similarly, your outgoing links provide pagerank for other pages of other sites. You may or may not want to pass pagerank to other sites, and you may or may not want to pass pagerank to other pages on your site. Herein lies the uber secret of relnofollow&#8230;</p>
<p>Here’s how pagerank is divvied up. If your home page has a page rank of 5 and you have 5 outgoing links, no matter if they point to internal pages of your site or to external pages of other sites, each link will pass 1 point of pagerank to the page that receives that link. Hypothetically, the page that receives that link would gain a pagerank of one. Pagerank affects where Google places your site in the search engine results pages (SERPS). You should focus on passing pagerank to pages that you want to rank well.</p>
<p>NOTE: If you have too many links pointing to other pages the amount of pagerank you pass is limited. If you have a pagerank of 5 and you have 50 outgoing links, each link is worth less pagerank, in this case just one tenth of a rank.</p>
<p>What are some common uses for the rel=”nofollow” tag?</p>
<ol>
<li>The most common use of relnofollow is to nofollow blog comments. Most blogging platforms do this by default, and you have to either have a plugin or manually change the link attributes to allow blog comment links to be followed.</li>
<li>You probably don’t want to pass pagerank to your privacy policy, terms of service, or disclaimers. Who cares if those rank for anything, ever. Add a simple relnofollow attribute to the hyperlink and you won’t have to worry about spreading your pagerank where it shouldn’t be spread.</li>
<li>A lot of advertisers choose to nofollow the ads that they display on their sites. This way, the sites the ads point to don’t steal pagerank and authority.</li>
<li>On the blacker side of SEO, some webmasters may use relnofollow to cheat out reciprocal link partners (if you do that, I promise it will come back to haunt you). They will perform a link trade. After the link has been verified, they’ll nofollow the link to the unsuspecting webmaster’s site. That way they don’t pass pagerank but they get pagerank from the weaseled webmaster.</li>
</ol>
<p>Rel=”nofollow” is critical to your site’s SEO health and should be used accordingly. Remember, you want your site to look natural to the search engines, so even with this useful tag, use it wisely and with moderation.</p>
<a href='http://www.seo.com/request-a-proposal/?utm_source=seoblog&utm_medium=banner&utm_content=insight&utm_campaign=blogcta'><img width="670" height="116" src="http://www.seo.com/wp-content/uploads/2012/06/Get-Internet-Marketing-Insight-For-Your-Company-SEO.com_.png" class="attachment-blog-header wp-post-image" alt="Get Internet Marketing Insight For Your Company - SEO.com" /></a><p><a href="http://www.seo.com/blog/hooking-up-your-hyperlink-rel-and-not-following-it/">Hooking Up Your Hyperlink Rel and Not Following It</a> is a post by SEO expert <a rel="author" href="http://www.seo.com/author/seth/">Seth Ellsworth</a>. For information about our <a href="http://www.seo.com/services/">SEO services</a> or more great SEO tips and tricks, visit the <a href="http://www.seo.com/blog">SEO.com blog</a>.</p>]]></content:encoded>
			<wfw:commentRss>http://www.seo.com/blog/hooking-up-your-hyperlink-rel-and-not-following-it/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
	
		<media:thumbnail url="http://www.seo.com/wp-content/uploads/2009/05/nofollow.jpg" />
		<media:content url="http://www.seo.com/wp-content/uploads/2009/05/nofollow.jpg" medium="image">
			<media:title type="html"><![CDATA[nofollow]]></media:title>
		</media:content>
	</item>
		<item>
		<title>Web Two Point What?</title>
		<link>http://www.seo.com/blog/social-media/web-two-point-what/?utm_source=rss&#038;utm_medium=rss&#038;utm_campaign=web-two-point-what</link>
		<comments>http://www.seo.com/blog/social-media/web-two-point-what/#comments</comments>
		<pubDate>Thu, 23 Apr 2009 16:08:35 +0000</pubDate>
		<dc:creator>Seth Ellsworth</dc:creator>
				<category><![CDATA[Social Media]]></category>

		<guid isPermaLink="false">http://www.seo.com/?p=1801</guid>
		<description><![CDATA[<p><p><a href="http://www.seo.com/blog/social-media/web-two-point-what/">Web Two Point What?</a> is a post by SEO expert <a rel="author" href="http://www.seo.com/author/seth/">Seth Ellsworth</a>. For information about our <a href="http://www.seo.com/services/">SEO services</a> or more great SEO tips and tricks, visit the <a href="http://www.seo.com/blog">SEO.com blog</a>.</p><p>I’m going to go way out here. I’m going way out on the weakest, most rotted out extremity of the nearest and most treacherous tree limb and make a blatant assumption. Here it is&#8230; If you’re reading this, which neither of us can dispute the fact that you are, I’ll bet my salary on the [...]<a href='http://www.seo.com/request-a-proposal/?utm_source=seoblog&utm_medium=banner&utm_content=insight&utm_campaign=blogcta'><img width="670" height="116" src="http://www.seo.com/wp-content/uploads/2012/06/Get-Internet-Marketing-Insight-For-Your-Company-SEO.com_.png" class="attachment-blog-header wp-post-image" alt="Get Internet Marketing Insight For Your Company - SEO.com" /></a></p></p><p><a href="http://www.seo.com/blog/social-media/web-two-point-what/">Web Two Point What?</a> is a post by SEO expert <a rel="author" href="http://www.seo.com/author/seth/">Seth Ellsworth</a>. For information about our <a href="http://www.seo.com/services/">SEO services</a> or more great SEO tips and tricks, visit the <a href="http://www.seo.com/blog">SEO.com blog</a>.</p>]]></description>
				<content:encoded><![CDATA[<p><a href="http://www.seo.com/blog/social-media/web-two-point-what/">Web Two Point What?</a> is a post by SEO expert <a rel="author" href="http://www.seo.com/author/seth/">Seth Ellsworth</a>. For information about our <a href="http://www.seo.com/services/">SEO services</a> or more great SEO tips and tricks, visit the <a href="http://www.seo.com/blog">SEO.com blog</a>.</p><p><img class="alignright size-full wp-image-1815" title="web-202" src="http://www.seo.com/wp-content/uploads/2009/04/web-202.jpg" alt="web-202" hspace="2" width="236" height="207" align="right" />I’m going to go way out here. I’m going way out on the weakest, most rotted out extremity of the nearest and most treacherous tree limb and make a blatant assumption. Here it is&#8230;</p>
<p>If you’re reading this, which neither of us can dispute the fact that you are, I’ll bet my salary on the fact that you’ve heard of at least one of these behemoths of social media.</p>
<ul>
<li><a href="http://www.facebook.com" target="_blank">Facebook</a> &#8211; Ain’t just for young kids. The largest growth on Facebook is from 30+ year old patrons and 50 million people in 35 languages use it almost every day. Wow. Facebook is killing <a href="http://www.myspace.com" target="_blank">MySpace</a>, and not softly. (Oops. I wasn’t going to mention MySpace because I wanted you to connect the dots. MySpace was the pioneer in social media so naturally MySpace belongs in this list of social media giants. Even though it deserves a mention, I’ll leave them MySpace “unbulleted” in this bulleted list.</li>
<li><a href="http://www.youtube.com" target="_blank">YouTube</a> &#8211; Nielsen Online estimates that Youtube serves over 32% of the videos watched online. I guarantee you’ve laughed at a video from YouTube. Inescapable.</li>
<li><a href="http://www.twitter.com" target="_blank">Twitter</a> &#8211; The incredibly popular micro-blogging platform grew at 752% growth last year. You must get on Twitter. This is one of the best ways to listen to and follow the pulse of your industry.</li>
<li><a href="http://www.stumbleupon.com" target="_blank">StumbleUpon </a>It’s just what you do when you stumble across something cool. (My personal favorite for social bookmarking. If I find some content I enjoy, I can bookmark it using StumbleUpon so that everyone can enjoy it).</li>
<li><a href="http://www.itunes.com" target="_blank">iTunes Podcasts</a> &#8211; Even Apple has joined “social media.”</li>
<li><a href="http://www.linkedin.com" target="_blank">LinkedIn</a> &#8211; Business networking powerhouse.</li>
<li><a href="http://www.squidoo.com" target="_blank">Squidoo</a> &#8211; Community of content sharing “lenses” created by the Social Media, Permission Marketing Master Mogul himself, Mr. Seth Godin.</li>
<li><a href="http://www.blogger.com" target="_blank">Blogger</a> &#8211; Google’s baby. The most popular and user-friendly hosted blogging platform.</li>
</ul>
<p>If you haven’t heard of any of these mega-sites it’s safe to assume that you have no business reading this blog post either. I’d also guess that if you’ve never heard of them you don’t use a computer (which is impossible), haven’t turned on your computer (impossible), don’t watch television (almost impossible), or you don’t have teenage kids (very possible).  So what is this fad? It’s called Web 2.0.</p>
<p><strong>What is Web 2.0?</strong></p>
<p>With technical geek speak aside, Web 2.0 is synonymous with social media. For our purposes, it’s that simple.</p>
<p>The sites I mentioned above are just a few sites that make up a major part of the new generation in internet user experience. Social media is made up of online social communities built around an interactive, conversational delivery and sharing of all things media. Social media is about content.</p>
<p>Just how popular is Web 2.0? Here’s a stat offered by <a href="http://news.cnet.com/8301-13846_3-10200669-62.html" target="_blank">Dave Rosenberg</a> over at CNet: social networks and blogs are MORE popular than email.</p>
<p>“He’s kidding, right?”</p>
<p>No, he’s not.</p>
<p><strong>Why You MUST Be Using Social Media</strong></p>
<p>If you aren’t utilizing social media in your marketing (called social marketing or social networking) you’re leaving mounds of cash on the table. Why? Social media is FREE to use and the absolutely best way to create raving fans of your brand or product.</p>
<p>Is your business struggling? Hit social media and you won’t strain your budget. Is your business already successful? Use social media to bury your competition so deep they won’t be able to get out. There are just no excuses not to use social media. If you’re not using it, your competitors will. Just do it.</p>
<p>People spend more time in social media than ever and the amount of time they spend sharing stuff, and chatting, and posting, and commenting increases by the hour.</p>
<p>The social media landscape just gets better and better and better and better. New social sites are popping up all over the place. What’s more is that supplementary sister sites with software and programs to help you use the behemoth social media sites are showing up more and more. For example, Twitter users have new tools that are published to help them generate more Tweeps (Twitter followers) and analyze their Twitter traffic and statistics and even allow for incredible search capabilities (how you keep up on your industry). There are almost two dozen of these programs that I’m aware of. These useful tools help to eliminate any excuse you have for not getting involved in social media. All these tools allow you to automate and analyze some social networking tasks. Even more evidence that you just can’t ignore social media.</p>
<p>Social media allows for you to brand your business, share media, generate traffic, presell new customers (without actually selling anything), create relationships, monitor the pulse of your industry&#8212; and do it all for FREE. You can’t beat that. Social media is the kind of thing that your bottom line loves.</p>
<p><strong>Start with Facebook and Twitter.</strong> As of today, these are the two pillars. Set up a LinkedIn profile next. Steadily build your profile and your exposure will increase. Honestly, you won’t find a subject that isn’t been worked over in social media. Just jump in and get involved in the conversation that’s already taking place in your industry. We’ll talk next about social media rules that will help you do social media right.</p>
<p><strong>Basic Rules of Social Media:</strong></p>
<ul>
<li> <strong>Be real. Be genuine. Be yourself.</strong> Social Media is not about selling stuff. It’s about communicating with others. If you “promote” yourself you’ll get hammered and it will ruin your brand. Social media is a lot like high school where everyone will start talking about you, whether for good or bad.</li>
<li><strong>Most important Rule of Thumb: Add indisputable value to the conversation.</strong> Nobody likes people who are always selling stuff. By adding value to a conversation people will seek you out in large numbers and look to you for answers. The biggest way to add value is to give away free stuff and to TEACH. People will begin to see you as an expert.</li>
<li><strong>Transparency is the social media protocol.</strong> Transparency has never been easier to recognize than it is now. It can absolutely catapult your business or rip it apart. If you are real and genuine, people can see you for who you really are in social media. If you’re fake, you can’t hide. So don’t be fake. If you’re real, let people in to your life (Don’t worry, you’re in control of what they do and don’t see about your life). You’re literally bringing thousands of people in to your world through social media so let them pull up a chair, sit in your parlor and chill with you for a minute.</li>
<li><strong>Use real names and profiles. </strong>Unless you’re branding your business, use real usernames and real profiles that don’t sound promotional. People are wary of salesmen. Don’t be salesy.</li>
</ul>
<p>That should get you pointed in the right direction. Now go set up a Facebook account for yourself and a Facebook Fan page for your business and put a link to that on your site. Sign up for Twitter, study Twitter, and go kill it. Put a link to your Twitter profile on your site as well.</p>
<p>Any questions, concerns, or rude comments?</p>
<p>Post your comments below.</p>
<a href='http://www.seo.com/request-a-proposal/?utm_source=seoblog&utm_medium=banner&utm_content=insight&utm_campaign=blogcta'><img width="670" height="116" src="http://www.seo.com/wp-content/uploads/2012/06/Get-Internet-Marketing-Insight-For-Your-Company-SEO.com_.png" class="attachment-blog-header wp-post-image" alt="Get Internet Marketing Insight For Your Company - SEO.com" /></a><p><a href="http://www.seo.com/blog/social-media/web-two-point-what/">Web Two Point What?</a> is a post by SEO expert <a rel="author" href="http://www.seo.com/author/seth/">Seth Ellsworth</a>. For information about our <a href="http://www.seo.com/services/">SEO services</a> or more great SEO tips and tricks, visit the <a href="http://www.seo.com/blog">SEO.com blog</a>.</p>]]></content:encoded>
			<wfw:commentRss>http://www.seo.com/blog/social-media/web-two-point-what/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
	
		<media:thumbnail url="http://www.seo.com/wp-content/uploads/2009/04/web-202.jpg" />
		<media:content url="http://www.seo.com/wp-content/uploads/2009/04/web-202.jpg" medium="image">
			<media:title type="html"><![CDATA[web-202]]></media:title>
		</media:content>
	</item>
		<item>
		<title>Killer Robots From Outer SEO Space: How to Dominate the Robots.txt File</title>
		<link>http://www.seo.com/blog/seo-tips/killer-robots-from-outer-seo-space-how-to-dominate-the-robotstxt-file/?utm_source=rss&#038;utm_medium=rss&#038;utm_campaign=killer-robots-from-outer-seo-space-how-to-dominate-the-robotstxt-file</link>
		<comments>http://www.seo.com/blog/seo-tips/killer-robots-from-outer-seo-space-how-to-dominate-the-robotstxt-file/#comments</comments>
		<pubDate>Mon, 02 Mar 2009 16:03:46 +0000</pubDate>
		<dc:creator>Seth Ellsworth</dc:creator>
				<category><![CDATA[SEO Tips]]></category>
		<category><![CDATA[robots]]></category>
		<category><![CDATA[robots.txt]]></category>

		<guid isPermaLink="false">http://www.seo.com/?p=1011</guid>
		<description><![CDATA[<p><p><a href="http://www.seo.com/blog/seo-tips/killer-robots-from-outer-seo-space-how-to-dominate-the-robotstxt-file/">Killer Robots From Outer SEO Space: How to Dominate the Robots.txt File</a> is a post by SEO expert <a rel="author" href="http://www.seo.com/author/seth/">Seth Ellsworth</a>. For information about our <a href="http://www.seo.com/services/">SEO services</a> or more great SEO tips and tricks, visit the <a href="http://www.seo.com/blog">SEO.com blog</a>.</p><p>If you haven’t heard of Mr. Robots, don’t blame yourself. It wasn’t even on the SEO map till just a couple years ago. Most of you, however, know what it is but don’t know exactly how to dominate the robots. Robots.txt files are no secret. You can spy on literally anyone’s robots file by simply [...]<a href='http://www.seo.com/request-a-proposal/?utm_source=seoblog&utm_medium=banner&utm_content=insight&utm_campaign=blogcta'><img width="670" height="116" src="http://www.seo.com/wp-content/uploads/2012/06/Get-Internet-Marketing-Insight-For-Your-Company-SEO.com_.png" class="attachment-blog-header wp-post-image" alt="Get Internet Marketing Insight For Your Company - SEO.com" /></a></p></p><p><a href="http://www.seo.com/blog/seo-tips/killer-robots-from-outer-seo-space-how-to-dominate-the-robotstxt-file/">Killer Robots From Outer SEO Space: How to Dominate the Robots.txt File</a> is a post by SEO expert <a rel="author" href="http://www.seo.com/author/seth/">Seth Ellsworth</a>. For information about our <a href="http://www.seo.com/services/">SEO services</a> or more great SEO tips and tricks, visit the <a href="http://www.seo.com/blog">SEO.com blog</a>.</p>]]></description>
				<content:encoded><![CDATA[<p><a href="http://www.seo.com/blog/seo-tips/killer-robots-from-outer-seo-space-how-to-dominate-the-robotstxt-file/">Killer Robots From Outer SEO Space: How to Dominate the Robots.txt File</a> is a post by SEO expert <a rel="author" href="http://www.seo.com/author/seth/">Seth Ellsworth</a>. For information about our <a href="http://www.seo.com/services/">SEO services</a> or more great SEO tips and tricks, visit the <a href="http://www.seo.com/blog">SEO.com blog</a>.</p><p><img class="alignright size-full wp-image-1012" title="3d_tin_robot" src="http://www.seo.com/wp-content/uploads/2009/02/3d_tin_robot.jpg" alt="3d_tin_robot" width="173" height="230" align="right" />If you haven’t heard of Mr. Robots, don’t blame yourself. It wasn’t even on the SEO map till just a couple years ago. Most of you, however, know what it is but don’t know exactly how to dominate the robots.</p>
<p>Robots.txt files are no secret. You can spy on literally anyone’s robots file by simply typing “www.domain.com/robots.txt.” The robots.txt should always and only be in the root of the domain and EVERY website should have one, even if it’s generic and I’ll tell you why.</p>
<p>There’s mixed communication about the robots. Use it. Don’t use it. Use meta-robots. You could have also heard advice to abandon the robots.txt all together. Who is right?</p>
<p>Here’s the secret sauce. Check it out.</p>
<p>First things first, understand that the robots.txt file was not designed for human usage. It was designed to command search ‘bots’ about how exactly they can behave on your site. It sets parameters that the bots have to obey and mandates what information they can and cannot access.</p>
<p>This is critical for your sites SEO success. You don’t want the bots looking through your dirty closets, so to speak.</p>
<p><strong>What is a Robots.txt File?</strong></p>
<p>The robots.txt is nothing more than a simple text file that should always sit in the root directory of your site. Once you understand the proper formats it’s a piece of cake to create. This system is called the Robots Exclusion Standard.</p>
<p>Always be sure to create the file in a basic text editor like Notepad or TextEdit and NOT in an HTML editor like Dreamweaver or FrontPage. That’s critically important. The robots.txt is NOT an html file and is not even remotely close to any web language. It has its own format that is completely different than any other language out there. Lucky for us, it’s extremely simple once you know how to use it.</p>
<p><strong>Robots.txt Breakdown</strong></p>
<p>The robots file is simple. It consists of two main directives: User-agent and Disallow.</p>
<p><strong>User Agent</strong><br />
Every item in the robots.txt file is specified by what is called a ‘user agent.’ The user agent line specifies the robot that the command refers to.</p>
<p>Example:</p>
<pre>User-agent: googlebot</pre>
<p>On the user agent line you can also use what is called a ‘wildcard character’ that specifies ALL robots at once.</p>
<p>Example:</p>
<pre>User-agent: *</pre>
<p>If you don’t know what the user agent names are, you can easily find these in your own site logs by checking for requests to the robots.txt file. The cool thing is that most major search engines have names for their spiders. Like pet names. I’m not kidding. Slurp.</p>
<p>Here some major bots:</p>
<p>Googlebot<br />
Yahoo! Slurp<br />
MSNbot<br />
Teoma<br />
Mediapartners-Google (Google AdSense Robot)<br />
Xenu Link Sleuth</p>
<p><strong>Disallow</strong><br />
The second most important part of your robots.txt file is the ‘disallow’ directive line which is usually written right below the user agent. Remember, just because the disallow directive is present does not mean that the specified bots are completely disallowed from your site, you can pick and choose what they can and can’t index or download.</p>
<p>The disallow directives can specify files and directories.</p>
<p>For example, if you want to instruct ALL spiders to not download your privacy policy, you would enter:</p>
<pre>User-agent: *
Disallow: privacy.html</pre>
<p>You can also specify entire directories with a directive like this:</p>
<pre>User-agent: *
Disallow: /cgi-bin/</pre>
<p>Again, if you only want a certain bot to be disallowed from a file or directory, put its name in place of the *.</p>
<p>This will block spiders from your cgi-bin directory.</p>
<p><strong>Super Ninja Robots.txt Trick</strong></p>
<p>Security is a huge issue online. Naturally, some webmasters are nervous about listing the directories that they want to keep private thinking that they’ll be handing the hackers and black-hat-ness-doers a roadmap to their most secret stuff.</p>
<p>But we’re smarter than that aren’t we?</p>
<p>Here’s what you do: If the directory you want to exclude or block is &#8220;secret&#8221; all you need to do is abbreviate it and add an asterisk to the end. You’ll want to make sure that the abbreviation is unique. You can name the directory you want protected ‘/secretsizzlesauce/’ and you’ll just add this line to your robots.txt:</p>
<pre>User-agent: *
Disallow: /sec*</pre>
<p>Problem solved.</p>
<p>This directive will disallow spiders from indexing directories that begin with “sec.” You’ll want to double check your directory structure to make sure you won’t be disallowing any other directories that you wouldn’t want disallowed. For example, this directive would disallow the directory “secondary” if you had that directory on your server.</p>
<p>To make things easier, just as the user agent directive, there is a similar wildcard command for the disallow directive. If you were to disallow /tos then by default it will disallow files with ‘tos‘  such as a tos.html as well as any file inside the /tos directory such as /tos/terms.html.</p>
<p><strong>Important Tactics For Robot Domination</strong></p>
<ul>
<li>Always place your robots in the root directory of your site so that it can be accessed like this: www.yourdomain.com/robots.txt</li>
<li>If you leave the disallow line blank, it indicates that ALL files may be retrieved.
<pre>User-agent:*
Disallow:</pre>
</li>
<li>You can add as many disallow directives to a single user agent as you need to but all user agents must have a disallow directive whether the directive disallows or not.</li>
<li>To be SEO kosher, at least one disallow line must be present for every user agent directive. You don’t want the bots to misread your stuff, so be sure and get it right. If you don’t get the format right they may just ignore the entire file and that is not cool. Most people who have their stuff indexed when they don’t want it to be indexed have syntax errors in their robots.</li>
<li>Use the Analyze Robots.txt tool in your <a href="http://www.google.com/webmasters/tools/">Google Webmaster Account</a> to make sure you set up your robots file correctly.</li>
<li>An empty robots is the exact same as not having one at all. So, if nothing else, use at least the basic directive to allow the entire site.</li>
<li>How to add comments to a robots? To add comments into your robots, all you need to do is throw a # in front and that entire line will be ignored. DO NOT put comments on the end of a directive line.  That is bad form and some bots may not read it correctly.</li>
<li>What stuff do you want to disallow in your robots?
<ul>
<li>Any folder that you don’t want the public eye to find or those that aren’t password protected that should be.</li>
<li>Printer friendly versions of pages (mostly to avoid the duplicate content filter).</li>
<li>Image directory to protect them from leeches and to make your content more spiderable.</li>
<li>CGI-BIN which houses some of the programming code on your site.</li>
<li>Find bots in your site logs that are sucking up bandwidth and not returning any value</li>
</ul>
</li>
</ul>
<p><strong>Killer Robot Tactics</strong></p>
<p>• This set up allows the bots to visit everything on your site and sometimes on your server, so use carefully. The * specifies ALL robots and the open disallow directive applies no restrictions to ANY bot.</p>
<pre>User-agent: *
Disallow:</pre>
<p>• This set up prevents your entire site from being indexed or downloaded. In theory, this will keep ALL bots out.</p>
<pre>User-agent: *
Disallow: /</pre>
<p>• This set up keeps out just one bot. In this case, we’re denying the heck out of Ask’s bot, Teoma.</p>
<pre>User-agent: Teoma
Disallow: /</pre>
<p>• This set up keeps ALL bots out of your cgi-bin and your image directory:</p>
<pre>User-agent: *
Disallow: /cgi-bin/
Disallow: /images/</pre>
<p>• If you want to disallow Google from indexing your images in their image search engine but allow all other bots, do this:</p>
<pre>User-agent: Googlebot-Image
Disallow: /images/</pre>
<p>• If you create a page that is perfect for Yahoo!, but you don&#8217;t want Google to see it:</p>
<pre>User-Agent: Googlebot
Disallow: /yahoo-page.html
#don’t use user agents or robots.txt for cloaking. That’s SEO suicide.</pre>
<p><strong><br />
</strong><strong>If You Don’t Use a Robots.txt File&#8230;</strong></p>
<p>A well written robots.txt file helps your site get indexed up to 15% deeper for most sites. It also allows you to control your content so that your site’s SEO footprint is clean and indexable and literal fodder for search engines. That, is worth the effort.</p>
<p>Everyone should have and employ a solid robots.txt file. It is critical to the long term success of your site.</p>
<p>Get it done.</p>
<p>Bling.</p>
<a href='http://www.seo.com/request-a-proposal/?utm_source=seoblog&utm_medium=banner&utm_content=insight&utm_campaign=blogcta'><img width="670" height="116" src="http://www.seo.com/wp-content/uploads/2012/06/Get-Internet-Marketing-Insight-For-Your-Company-SEO.com_.png" class="attachment-blog-header wp-post-image" alt="Get Internet Marketing Insight For Your Company - SEO.com" /></a><p><a href="http://www.seo.com/blog/seo-tips/killer-robots-from-outer-seo-space-how-to-dominate-the-robotstxt-file/">Killer Robots From Outer SEO Space: How to Dominate the Robots.txt File</a> is a post by SEO expert <a rel="author" href="http://www.seo.com/author/seth/">Seth Ellsworth</a>. For information about our <a href="http://www.seo.com/services/">SEO services</a> or more great SEO tips and tricks, visit the <a href="http://www.seo.com/blog">SEO.com blog</a>.</p>]]></content:encoded>
			<wfw:commentRss>http://www.seo.com/blog/seo-tips/killer-robots-from-outer-seo-space-how-to-dominate-the-robotstxt-file/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
	
		<media:thumbnail url="http://www.seo.com/wp-content/uploads/2009/02/3d_tin_robot.jpg" />
		<media:content url="http://www.seo.com/wp-content/uploads/2009/02/3d_tin_robot.jpg" medium="image">
			<media:title type="html"><![CDATA[3d_tin_robot]]></media:title>
		</media:content>
	</item>
		<item>
		<title>What Does Alex Rodriguez Have to Do With SEO?</title>
		<link>http://www.seo.com/blog/seo-tips/what-does-alex-rodriguez-have-to-do-with-seo/?utm_source=rss&#038;utm_medium=rss&#038;utm_campaign=what-does-alex-rodriguez-have-to-do-with-seo</link>
		<comments>http://www.seo.com/blog/seo-tips/what-does-alex-rodriguez-have-to-do-with-seo/#comments</comments>
		<pubDate>Mon, 23 Feb 2009 15:41:09 +0000</pubDate>
		<dc:creator>Seth Ellsworth</dc:creator>
				<category><![CDATA[SEO Tips]]></category>
		<category><![CDATA[A-Rod]]></category>
		<category><![CDATA[grey hat]]></category>
		<category><![CDATA[seo]]></category>

		<guid isPermaLink="false">http://www.seo.com/?p=895</guid>
		<description><![CDATA[<p><p><a href="http://www.seo.com/blog/seo-tips/what-does-alex-rodriguez-have-to-do-with-seo/">What Does Alex Rodriguez Have to Do With SEO?</a> is a post by SEO expert <a rel="author" href="http://www.seo.com/author/seth/">Seth Ellsworth</a>. For information about our <a href="http://www.seo.com/services/">SEO services</a> or more great SEO tips and tricks, visit the <a href="http://www.seo.com/blog">SEO.com blog</a>.</p><p>Disappointed? Yeah. Threw me into my low-mid-life crisis. We should have held a memorial for baseball as we knew it. I remember the years when baseball was a man’s sport, not a cheaters sport. I loved it. I couldn’t miss a Mariner’s game rain or shine&#8230;more rain than shine, but the King Dome ruled. I [...]<a href='http://www.seo.com/request-a-proposal/?utm_source=seoblog&utm_medium=banner&utm_content=insight&utm_campaign=blogcta'><img width="670" height="116" src="http://www.seo.com/wp-content/uploads/2012/06/Get-Internet-Marketing-Insight-For-Your-Company-SEO.com_.png" class="attachment-blog-header wp-post-image" alt="Get Internet Marketing Insight For Your Company - SEO.com" /></a></p></p><p><a href="http://www.seo.com/blog/seo-tips/what-does-alex-rodriguez-have-to-do-with-seo/">What Does Alex Rodriguez Have to Do With SEO?</a> is a post by SEO expert <a rel="author" href="http://www.seo.com/author/seth/">Seth Ellsworth</a>. For information about our <a href="http://www.seo.com/services/">SEO services</a> or more great SEO tips and tricks, visit the <a href="http://www.seo.com/blog">SEO.com blog</a>.</p>]]></description>
				<content:encoded><![CDATA[<p><a href="http://www.seo.com/blog/seo-tips/what-does-alex-rodriguez-have-to-do-with-seo/">What Does Alex Rodriguez Have to Do With SEO?</a> is a post by SEO expert <a rel="author" href="http://www.seo.com/author/seth/">Seth Ellsworth</a>. For information about our <a href="http://www.seo.com/services/">SEO services</a> or more great SEO tips and tricks, visit the <a href="http://www.seo.com/blog">SEO.com blog</a>.</p><p><img class="alignright size-medium wp-image-896" style="margin-left:10px;margin-bottom:10px;" title="arod-swings-for-homerun" src="http://www.seo.com/wp-content/uploads/2009/02/arod-swings-for-homerun-191x300.jpg" alt="arod-swings-for-homerun" width="191" height="300" align="right" />Disappointed? Yeah. Threw me into my low-mid-life crisis. We should have held a memorial for baseball as we knew it.</p>
<p>I remember the years when baseball was a man’s sport, not a cheaters sport. I loved it. I couldn’t miss a Mariner’s game rain or shine&#8230;more rain than shine, but the King Dome ruled. I was there to watch Griffey’s rookie season, the Jr. and Sr. tandem, his first Grand Slam and A-Rod’s inaugural homerun. Jay Buhner, Pete O’Brien, Dave Valle, Harold Reynolds, Tino Martinez, Omar Vizquel, The Big Unit&#8230;all ancient memories now. We’re talking stone-age ancient, or so it seems.</p>
<p>When the recent news came out about Alex Rodriguez, I was broken for a day. Extremely disappointed. Literally every last one of my hopes for baseball’s future was finally strung out to fade in the sun on an unreachable limb of shame.</p>
<p>How does baseball bounce back from having its icon player completely, publicly wamboozled? Who knows. Alas, we’re not here to talk about the MLB and roids. Thankfully.</p>
<p><strong>Something Profound Amidst the Muck </strong></p>
<p>And what else is there to do than apply the A-Fraud stuff to SEO? Yup, we can apply what A-Rod is going through to SEO. It’s brilliant, check it out.</p>
<p>A-Fraud broke the cardinal rule of SEO, and, well, of life too. Though steroids weren’t in the day to day conversation back then, he marginalized his personal brand integrity and partook of ‘grey area’ stuff when the consequences of taking it weren’t even considered. Steroids was part of the ‘loosey goosey’ era in baseball where players, coaches and trainers just looked the other way and let it happen (I would have considered it flat out cheating, but, to be fair, it actually was a grey area back then. It baffles me as to why but that’s just how it was).</p>
<p>Every day at SEO.com we come across webmasters that have doomed their business to SEO failure. They’re doing the exact same thing that A-Rod did, but to their businesses. They marginalize their site’s integrity by partaking in grey area, loosey-goosey stuff without concern for future consequences. They pump the juice to get some cool short term results without a thought for future ailments that may come of it. Bad idea. Very bad idea.</p>
<p>When you have an all-seeing and omniscient powerhouse like Google looming over you, as a webmaster, you can’t hide under ‘ignorance’ like A-Rod did for so many years. Google doesn’t care who you are. They know everyone and are everywhere, watching you. Kinda creepy. More creepy knowing they control your web business, at least the free traffic part of it. So you HAVE to make them happy. You have no choice. They are no respecter of persons [or websites]. They will find you and they will dump your site as if it didn’t even exist. And search engine placement resurrection is a difficult, lengthy process.</p>
<p><strong>Avoid Grey-ness Like You Would Steroids</strong></p>
<p>Using A-Rod as an example of what happens when you go the grey hat route, you get hammered when the sun exposes the true colors or when the market/boss changes expectations. In other words, once Google finds out or changes policies (and they will) you get hammered. Once the U.S. found out about her golden boy baller’s ugly, old, stale grey stuff, golden boy got hammered. Wouldn’t A-Rod have been better to steer clear of anything that could be considered cheating? Duh. Your business is no different.</p>
<p>For your main site, things that are considered ‘grey hat’ should be avoided completely. It’s not worth the long term repercussions. It just isn’t. Build your site right the first time. Keep as far from the ledge as possible and you’ll be loved by Google and you’ll find a place in your niche’s Google hall of fame. Good luck A-Rod.</p>
<p>For long term sustainability, steady and white hat will win the race. Don’t go for the ‘quick’ score.</p>
<p><strong>What is Grey Hat?</strong></p>
<p>Here’s the legit definition so bookmark this page or <a href="http://twitter.com">tweet</a> it to your friends because this is good:</p>
<p>Grey hat SEO is the employment of techniques that are not technically against Google’s policies but that don’t provide value and are done solely for SEO purposes without regard for user experience.</p>
<p>Here’s the kicker. Pay attention. Grey hat today can literally become black hat tomorrow.</p>
<p>I’ve seen grey turn to black too many times. Here’s an example: Remember when blog commenting was the craze about 18 months ago? Everyone came out with their own software to almost automate blog spamming because it was cool. An immediate billion anchor text links!</p>
<p>All of a sudden, Google laid the smack down and it hurt. Blog spamming will kill you now. That’s not to say you can’t comment on a blog and point to your site, but you have to actually make a real comment and join the conversation.</p>
<p>***Don’t risk sandboxing your brand for the latest SEO craze. Be real all the time***</p>
<p><strong>What Are Grey Hat Techniques?<br />
</strong><br />
Before we lay out the common grey hat mojo, know that there are literally unlimited grey hat areas. When building SEO focus on adding value and user experience and you will win, always. Period. Limit the things that you do that are ONLY for SEO purposes. Remember, grey hat today can be black hat tomorrow morning so pick your battles wisely. Don’t blow it like A-Rod did.</p>
<p>These are a few grey-hat tactics that could be just as bad for your site in the long run as steroids were to A-Rod:</p>
<p>• Stuffing keywords in alt tags, link titles and image titles.<br />
• Linking to sites that have nothing to do with your niche or industry.<br />
• Obtaining inbound links that have nothing to do with your niche or industry.<br />
• Purchasing links under the guise of &#8216;advertising&#8217; or &#8216;traffic purposes&#8217; when they are really for SEO.<br />
• Social media spam.<br />
• Blog comment spamming is now black hat.</p>
<p>Have you committed the grey hat A-Rod steroid sin? Repent. Do you have anything to add to the grey hat areas that we’ve gone over?</p>
<p>Bling.</p>
<a href='http://www.seo.com/request-a-proposal/?utm_source=seoblog&utm_medium=banner&utm_content=insight&utm_campaign=blogcta'><img width="670" height="116" src="http://www.seo.com/wp-content/uploads/2012/06/Get-Internet-Marketing-Insight-For-Your-Company-SEO.com_.png" class="attachment-blog-header wp-post-image" alt="Get Internet Marketing Insight For Your Company - SEO.com" /></a><p><a href="http://www.seo.com/blog/seo-tips/what-does-alex-rodriguez-have-to-do-with-seo/">What Does Alex Rodriguez Have to Do With SEO?</a> is a post by SEO expert <a rel="author" href="http://www.seo.com/author/seth/">Seth Ellsworth</a>. For information about our <a href="http://www.seo.com/services/">SEO services</a> or more great SEO tips and tricks, visit the <a href="http://www.seo.com/blog">SEO.com blog</a>.</p>]]></content:encoded>
			<wfw:commentRss>http://www.seo.com/blog/seo-tips/what-does-alex-rodriguez-have-to-do-with-seo/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
	
		<media:thumbnail url="http://www.seo.com/wp-content/uploads/2009/02/arod-swings-for-homerun-191x300.jpg" />
		<media:content url="http://www.seo.com/wp-content/uploads/2009/02/arod-swings-for-homerun-191x300.jpg" medium="image">
			<media:title type="html"><![CDATA[arod-swings-for-homerun]]></media:title>
		</media:content>
	</item>
	</channel>
</rss>
