To avoid undesirable content in the search indexes, webmasters can instruct spiders not to crawl certain files or directories through the standard robots.txt file in the root directory of the domain. Additionally, a page can be explicitly excluded from a search engine's database by using a meta tag specific to robots (usually ). When a search engine visits a site, the robots.txt located in the root directory is the first file crawled. The robots.txt file is then parsed and will instruct the robot as to which pages are not to be crawled. As a search engine crawler may keep a cached copy of this file, it may on occasion crawl pages a webmaster does not wish crawled. Pages typically prevented from being crawled include login specific pages such as shopping carts and user-specific content such as search results from internal searches. In March 2007, Google warned webmasters that they should prevent indexing of internal search results because those pages are considered search spam.[47]
I first heard you talk about your techniques in Pat Flynn’s podcast. Must admit, I’ve been lurking a little ever since…not sure if I wanted to jump into these exercises or just dance around the edges. The clever and interesting angles you describe here took me all afternoon to get through and wrap my brain around. It’s a TON of information. I can’t believe this is free for us to devour! Thank you!! Talk about positioning yourself as THE expert! Deep bow.
That second link will still help you because it will pass extra PR to that page. But in terms of anchor text, most of the experiments I’ve seen show that the second link’s anchor text probably doesn’t help. That being said, Google is more sophisticated than when a lot of these came out so they may count both anchors. But to stay on the safe side I recommend adding keywords to navigation links if possible.
Of course, we are always thinking about cost/value/likelihood we can upgrade the best content in the vertical—it is almost always the case that the low competition content, although lower benefit, also doesn’t need the same content quality the high competition terms do, so we can sometimes capture more benefit at a faster velocity by hitting those terms earlier.
Breaking it down, Traffic Cost is SEMRush’s way of showing the hypothetical value of a page. Traffic Cost estimates the traffic a page is getting by estimating clickthrough rate (CTR), and then multiplying it against all the positions it ranks for. From there, it looks at what others would be willing to pay for that same traffic using Google AdWords’ CPC.
SEO is not an appropriate strategy for every website, and other Internet marketing strategies can be more effective, such as paid advertising through pay per click (PPC) campaigns, depending on the site operator's goals. Search engine marketing (SEM) is the practice of designing, running and optimizing search engine ad campaigns.[56] Its difference from SEO is most simply depicted as the difference between paid and unpaid priority ranking in search results. Its purpose regards prominence more so than relevance; website developers should regard SEM with the utmost importance with consideration to visibility as most navigate to the primary listings of their search.[57] A successful Internet marketing campaign may also depend upon building high quality web pages to engage and persuade, setting up analytics programs to enable site owners to measure results, and improving a site's conversion rate.[58] In November 2015, Google released a full 160 page version of its Search Quality Rating Guidelines to the public,[59] which revealed a shift in their focus towards "usefulness" and mobile search. In recent years the mobile market has exploded, overtaking the use of desktops, as shown in by StatCounter in October 2016 where they analyzed 2.5 million websites and found that 51.3% of the pages were loaded by a mobile device [60]. Google has been one of the companies that are utilizing the popularity of mobile usage by encouraging websites to use their Google Search Console, the Mobile-Friendly Test, which allows companies to measure up their website to the search engine results and how user-friendly it is.

As of 2009, there are only a few large markets where Google is not the leading search engine. In most cases, when Google is not leading in a given market, it is lagging behind a local player. The most notable example markets are China, Japan, South Korea, Russia and the Czech Republic where respectively Baidu, Yahoo! Japan, Naver, Yandex and Seznam are market leaders.
Use the right anchor text. Using our previous example: if you wanted to internally link to the “how to make money” blog post, you can write a sentence in another blog, like “Once you have mastered [how to make money], you can enjoy as much luxury as you can dream.” In this case, the reader has a compelling case for clicking on the link because of both the anchor text (“how to make money”) and the context of the sentence. There is a clear benefit from clicking the link.
Hey Brian, love your site + content. Really awesome stuff! I have a question about dead link building on Wikipedia. I actually got a “user talk” message from someone moderating a Wikipedia page I replaced a dead link on. They claimed that “Wikipedia uses nofollow tags” so “additions of links to Wikipedia will not alter search engine rankings.” Any thoughts here?

Keywords. Keyword research is the first step to a successful SEO strategy. Those successful with SEO understand what people are searching for when discovering their business in a search engine. These are the keywords they use to drive targeted traffic to their products. Start brainstorming potential keywords, and see how the competition looks by using Google AdWords Keyword Tool. If you notice that some keywords are too competitive in your niche, go with long-tail keywords (between two and five words) which will be easier for you to rank. The longer the keyword, the less competition you will have for that phrase in the engines.


Thanks to decreasing attention spans, it should come as no surprise that people don’t have the patience to wait more than a few seconds for a site to load. According to a study by Akamai, 40% of people leave a site if it takes more than three seconds to load. Keep users on your website by making sure that it’s running as fast as possible. A few simple ways that you can increase website speed are by reducing the number of plugins on your site, compressing images and enabling browser caching.
After you have identified your target keywords, you need to create a page targeting that keyword. This is known as SEO content. In many cases, it makes sense to publish a blog post targeting keywords. However, you need to make decisions based on the search intent. If your target keyword phrase is “buy black Nike shoes”, then it doesn’t make sense to create a long-form piece of content.

Thanks Jure. That actually makes sense. Exactly: I’ve tested lowering the number of tips in a few posts and it’s helped CTR/organic traffic. One thing to keep in mind is that the number can also be: the year, time (like how long it will take to find what someone needs), % (like 25% off) etc. It doesn’t have to be the number of tips, classified ads, etc.


Great article, Brian. Like that you’re finally talking about Domain Authority (DA). It’s essential to make skyscraper technique work as well. Also, a great pointer on comments as I have personally seen articles perform well because of comments. Do you recommend closing the comments as well a few days after the article is published? Kinda like Copyblogger does now.
Some features on the Service require payment of fees. If you elect to sign up for these features, you agree to pay Us the applicable fees and any taxes as described on the Service. All payments due are in the U.S. dollars unless otherwise indicated. Upon payment, You will have access to the chosen features immediately. If Your use of the Service is terminated for any reason, whether by You or by Us, You will lose and forfeit any time remaining on Your account with Us.
i just kind the amazing article like this.. i have been read much article all about SEO but not like this.. i spent 2 hours more to read this article over and over. i have been checklist to get your tips. and also i have follow your twiiter 🙂 , i hope you are always send me tips and trick for amazing SEO.. i want to learn with you.. Thanks Very Much Brian.. Keep Share for me 🙂 , Cheers
Having an industry influencer publish a blog post on your site or turning an interview with them into a blog post can help to drive traffic both through organic search but also via that influencer promoting the content to their audience (see the backlinks section above). This can also help to add more variety to your content and show your visitors that you are active in your field.
Ever heard of Maslow's hierarchy of needs? It's a theory of psychology that prioritizes the most fundamental human needs (like air, water, and physical safety) over more advanced needs (like esteem and social belonging). The theory is that you can't achieve the needs at the top without ensuring the more fundamental needs are met first. Love doesn't matter if you don't have food.
Think of it this way: The more specific your content, the more specific the needs of your audience are -- and the more likely you'll convert this traffic into leads. This is how Google finds value in the websites it crawls; the pages that dig into the interworkings of a general topic are seen as the best answer to a person's query, and will rank higher.
Optimization and conversion rate are buzzwords that are easy to find but can be tricky to implement without a plan and clear objectives. To be clear, optimization is the process of making changes and tweaks to your site to make it better, more visible and more user-friendly to site visitors. Conversion rate optimization specifically deals with changes you can make to your site to encourage visitors to complete a desired action whether its making a purchase, filling out an opt-in form or engaging with your site via comments or social shares. You might have a site that sees hundreds of visitors a month - but those numbers mean nothing if those visitors are not completing the action you made the site for. And while there is no exact formula for raising your conversion rate, there are certainly good practices to get you started. Below are 11 tips to consider when converting your visitors into customers.
The strength of your link profile isn’t solely determined by how many sites link back to you – it can also be affected by your internal linking structure. When creating and publishing content, be sure to keep an eye out for opportunities for internal links. This not only helps with SEO, but also results in a better, more useful experience for the user – the cornerstone of increasing traffic to your website.
Social media is one of the most popular free marketing tools around, and plays a role in driving traffic to your website. Use Facebook, Instagram, and LinkedIn to promote blog posts and other useful pages on your website. This way you can turn your social media audience into website visitors, and draw traffic from their networks if you post shareable content.
Guest blogging is a two-way street. In addition to posting content to other blogs, invite people in your niche to blog on your own site. They’re likely to share and link to their guest article, which could bring new readers to your site. Just be sure that you only post high-quality, original content without spammy links, because Google is cracking way down on low-quality guest blogging.
×