Page 2 of 2 First 12
  • Jump to page:
    #16
  1. No Profile Picture
    Registered User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Aug 2010
    Posts
    9
    Rep Power
    0
    Originally Posted by jsteele823
    The "best pages" linking to the "newer pages" is to help them be crawled and indexed faster.
    That is logical more popular pages are crawled more often due the activity. That is why new pages (posts) should be always on the frontpage. This will attract visitors human as well the spiders from the searchengines.
  2. #17
  3. Contributing User
    SEO Chat Discoverer (100 - 499 posts)

    Join Date
    Sep 2010
    Location
    Israel
    Posts
    114
    Rep Power
    13

    That is basically true


    Originally Posted by jsteele823
    Better, but I'd cut out a few points that only have marginal effect.

    In fact, I'd cut it down to:

    If your site has indexation problems:
    1) Shoot for higher quality backlinks.
    2) double check duplicate content
    3) follow Google's Webmaster Guidelines

    But that may be too simple.
    But the original post is more impressive
  4. #18
  5. No Profile Picture
    Registered User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Jan 2008
    Posts
    21
    Rep Power
    0
    Jesus

    I have a terrible time convincing Google to come to my blog when I have just one big new page to show it.

    Google will come back only when you have about one hundred new posts. Maybe a ping will warn when it is time to return to a page.
  6. #19
  7. Extremely Googled
    SEO Chat Good Citizen (1000 - 1499 posts)

    Join Date
    Dec 2004
    Posts
    1,030
    Rep Power
    497
    Can an admin lock this thread? It's getting diluted with spam and irrelevant questions and it really is a useful thread.
  8. #20
  9. Moderator
    SEO Chat Genius (4000 - 4499 posts)

    Join Date
    Apr 2006
    Location
    I N D I A
    Posts
    4,031
    Rep Power
    540
    Thread closed

    SEO FAQs - You might find your answer here.
    SEOchat Forum Rules - Read Before You Post
  10. #21
  11. Cool bra. Go with Christ!
    SEO Chat Mastermind (5000+ posts)

    Join Date
    Mar 2004
    Location
    Gloucester (South West UK).
    Posts
    5,956
    Rep Power
    1239
    I cleaned it up and reopened it.. Seems a shame to lock it, better to update it
    ClickyB
    "The quality of the visitor is more important than the volume".. Egol 22nd Feb 2008
    New to SEO/SeoChat?...Click Here
    Canonical Problems?... Click Here
    Forum Rules & Posting Guidelines
  12. #22
  13. No Profile Picture
    Banned
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Jun 2014
    Posts
    9
    Rep Power
    0
    Google says that they don't pass link value or "authority" to links with a no follow tag.
  14. #23
  15. No Profile Picture
    Newbie
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Jun 2014
    Posts
    4
    Rep Power
    0
    Thanks for the useful and valuable post. Quality content feeds on dofollow , blogs submission social bookmarking and forum posting, all these will get high crawlers or visitors click on webpage. And this will leads a possible of getting high page rank.
  16. #24
  17. No Profile Picture
    Banned
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Jul 2014
    Posts
    5
    Rep Power
    0
    Thanks for sharing knowledge about Google Crawling and Indexation ......
  18. #25
  19. No Profile Picture
    Registered User

    Join Date
    Jul 2014
    Posts
    4
    Rep Power
    0
    Google crawl only do follow sites. Google crawl source page of a site. during the crawling google store all data about site in own database.
  20. #26
  21. No Profile Picture
    Newbie
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Jul 2014
    Posts
    2
    Rep Power
    0
    Hi All,

    Crawling and indexing are processes which can take some time and which rely on many factors. In general, we cannot make predictions or guarantees about when or if your URLs will be crawled or indexed. When looking at a site's indexing in Webmaster Tools, make sure that you have both the "www" and the "non-www" versions (like "www.example.com" and "example.com") verified and have a set a preferred domain. Keep in mind that while a Sitemap file can help us learn about your site, it does not guarantee indexing or increase your site's ranking.

    We have several Help Center articles that explain these processes:

    http://www.google.com/support/webmas...y?answer=70897
    http://www.google.com/support/webmas...y?answer=34444
    http://www.google.com/support/webmas...y?answer=35769

    Here are the other common reasons why a website or parts of a website might not be indexed yet:

    - A website might not be well connected through multiple links from other sites on the web.
    - The design of the website might make crawling and indexing difficult. Maybe the site itself is even explicitly blocking crawling or indexing?
    - Perhaps it was temporarily unavailable when we attempted to crawl? You might find crawl errors in Webmaster Tools in this case.
    - Verify that the website complies with our Webmaster Guidelines and hasn't been hacked or otherwise modified by a third party.
    - In very rare cases, it might be that content previously hosted on a domain name is causing issues. In this case, you may wish to submit a reconsideration request detailing the change of content and ownership.
    - If the website recently moved to a different address, make sure that you follow our guidelines for moving a site.
    - It's possible that a previous owner or someone else with access to the website requested removal through Webmaster Tools. You can cancel these requests by going to "Site configuration" / "Crawler access" / "Remove URLs" in your Webmaster Tools account.

    Thanks
    Mike
  22. #27
  23. No Profile Picture
    Newbie
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Aug 2014
    Posts
    6
    Rep Power
    0
    The good quality backlinks obtained from high PR will really help out in google rankings...
  24. #28
  25. No Profile Picture
    Newbie
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Aug 2014
    Posts
    2
    Rep Power
    0
    I have one basic question about <changefreq> value: What happens when you set it to "never" just for the old articles you have on your website? I mean I need the old articles crawled and indexed at least once, but the truth is that articles older than 1-2 months wont be changed ever and I do not need the bot to read them daily or monthly again and again because it causes a big CPU load for example. Basically I need only the new articles crawled and indexed.

    So, may I dynamically set my sitemap <changefreq> to "daily" when the article is newer than 1 month and to "never" when the article is older than 1 month? Will this affect the good SEO quality of my content?

    Cheers!
  26. #29
  27. No Profile Picture
    Newbie
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Aug 2014
    Posts
    2
    Rep Power
    0
    Originally Posted by Jeniffercartet
    Hey google don't crawl no-follow links
    I still need URLs listed in sitemap.xml to be crawled at least once (in fact just once) and never more.

    What I have done:

    1) The front page: I need it to be crawled on a daily basis. So it's XML file:
    http://www.mysite.net/sitemaps/frontpage.xml
    contains this block:

    Code:
    <url>
      <loc>http://www.mysite.net</loc>
      <changefreq>daily</changefreq>
     </url>

    2) The other URLs listed in sitemap to be crawled just once and then never again.

    Code:
    <sitemap>
     <loc>http://www.mysite.net/sitemaps/01.xml</loc>
    </sitemap>
    <sitemap>
     <loc>http://www.mysite.net/sitemaps/02.xml</loc>
    </sitemap>
    .....

    Each of the XMLs contains blocks like this:
    Code:
    <url>
     <loc>
      http://mysite.net/url-to-article-to-be-crawled-01
     </loc>
     <changefreq>never</changefreq>
    </url>
    <url>
     <loc>
      http://mysite.net/url-to-article-to-be-crawled-02
     </loc>
     <changefreq>never</changefreq>
    </url>
    ....

    3) I have decreased the crawler interval to 10 sec. in robots.txt and filter all other bots except Google:

    User-agent: Google
    Disallow:
    Crawl-delay: 10
    Sitemap: http://www.mysite.net/sitemap.xml

    User-agent: *
    Disallow: /

    =================
    What do you think? My main task is to reduce the CPU load that crawler causes.

    Cheers,
    Vladimir
  28. #30
  29. No Profile Picture
    Registered User
    SEO Chat Explorer (0 - 99 posts)

    Join Date
    Aug 2014
    Posts
    3
    Rep Power
    0
    I believed search engines does not spider no follow links? How is this possible?
Page 2 of 2 First 12
  • Jump to page:

Similar Threads

  1. Search Engine Strategies -Munich (part one)
    By Webby in forum Search Engine Optimization
    Replies: 8
    Last Post: Nov 26th, 2003, 10:42 PM

IMN logo majestic logo threadwatch logo seochat tools logo