Have you ever needed to prevent Google from indexing a particular URL on your website and displaying it in your search engine result pages (SERPs)? If you manage web sites for a long time, a day will come when you need to know how to do it.
The three methods commonly used by Google to prevent indexing of URLs are:
Using the rel = "nofollow" attribute on all anchor elements used to link to the page to prevent links from being followed by the crawler.
Using a disallow directive in the site's robots.txt file to prevent the page from being crawled and indexed.
Using the meta robot tag with the content = "noindex" attribute to prevent the page from being indexed.
While the differences in the three approaches seem subtle at first glance, the effectiveness can vary greatly depending on the method you choose.
Using rel = "nofollow" to stop Google indexing
Many inexperienced webmasters try to prevent Google from indexing a particular URL by using the rel = "nofollow" attribute on HTML anchor elements. They add attributes to each anchor element of their site used to link to that URL.
The inclusion of the rel = "nofollow" attribute on a link prevents Google's crawler from following the link, which in turn, prevents them from searching, crawling, and indexing the target page. While this method can serve as a short-term solution, it is not a viable long-term solution.
The drawback with this approach is that it considers all inbound links to the URL that would include a rel = "nofollow" attribute. However, the webmaster has no way to prevent other web sites from linking with URLs. So chances are that the URL will eventually be crawled and indexed using this method.
Using robots.txt to stop Google indexing
Another common method used by Google to prevent URLs from being indexed is to use a robots.txt file. A rejected directive can be added to the robots.txt file for the URL in question. Google's crawler will honor the directive that prevents the page from being crawled and indexed. However, in some cases, the URL may still appear in the SERPs.
Sometimes Google will display a URL in their SERPs, although they have never indexed the content of that page. If enough web sites link to the URL then Google can often infer the subject of the page from the link text of the inbound link. As a result they will display URLs in SERPs for related searches. When using a disallow directive in a robots.txt file, it will prevent Google from crawling and indexing the URL, guaranteeing that the URL will never appear in the SERPs.
Using Meta Robot Tags to Stop Google Indexing
If you need to prevent Google from indexing URLs while preventing that URL from appearing in SERPs, the most effective approach is to have a meta robot with a content = "noindex" attribute within the main element of the web page Tags to be used. Of course, for Google to actually see this meta robot tag they first need to be able to search and crawl the page, so don't block URLs with robots.txt. When Google crawls the page and the Meta Robot noindex tag is detected, they will flag the URL so that it will never be shown in SERPs. This is the most effective way to prevent Google from indexing URLs and displaying them in your search results. I have list down some backlinks--
https://www.eeweb.com/profile/alexpatton32
https://ficwad.com/a/alexpatton32
https://artmight.com/user/profile/54241
https://alexpatton32.podbean.com/e/podbean_best_podcast_hosting_audio_video_blog_hosting/?token=aea991bf6e44445e31dd4a27bfbad36c
https://speakerdeck.com/alexpatton32
http://webmii.com/5d32c34a4b5d8-G98LmE
https://austintodd101.dreamwidth.org/profile
https://soundcloud.com/user-737601100
https://www.behance.net/austintodd
https://kinja.com/austintodd101
https://www.intensedebate.com/people/austintodd101
https://openlibrary.org/account/login
http://www.feedbooks.com/user/5401030/profile
http://www.feedbooks.com/user/5401030/profile
https://austintodd101.livejournal.com/profile
https://list.ly/austintodd101/lists
https://ficwad.com/a/austintodd101
https://artmight.com/user/profile/54171
https://austintodd101.podbean.com/e/podbean_best_podcast_hosting_audio_video_blog_hosting/
https://speakerdeck.com/austintodd101
http://webmii.com/5d319dd2342ec-Vs0bMv
https://donshelton32.dreamwidth.org/profile
https://soundcloud.com/user-211312313
https://www.behance.net/donshelton
https://openlibrary.org/people/donshelton32
http://www.feedbooks.com/user/5276580/profile
https://www.viki.com/users/donshelton32_338/about
https://donshelton32.livejournal.com/profile
https://list.ly/donshelton32/lists
https://www.finecooking.com/profile/donshelton32
https://www.burdastyle.com/profiles/donshelton32
https://www.edocr.com/account/create
https://www.turnkeylinux.org/user/804179
http://yourlisten.com/donshelton32
https://www.finecooking.com/profile/leesilva50
https://www.burdastyle.com/profiles/leesilva50
https://www.turnkeylinux.org/user/682815
http://yourlisten.com/leesilva50
https://www.threadsmagazine.com/profile/leesilva50
https://splice.com/leesilva50
https://luiscook20.dreamwidth.org/profile
https://soundcloud.com/user-225613866
https://www.behance.net/luiscook
https://kinja.com/luiscook20
https://www.intensedebate.com/
https://openlibrary.org/people/benmack29
http://www.feedbooks.com/user/5406286/profile
https://www.viki.com/users/benmack29_76/about
https://benmack29.livejournal.com/profile
https://list.ly/benmack29
https://billlewis205.dreamwidth.org/profile
https://soundcloud.com/user-472017126
https://www.behance.net/billlewis1
https://kinja.com/billlewis205
https://www.intensedebate.com/people/billlewis205
https://openlibrary.org/account/login
http://www.feedbooks.com/user/5413354/profile
https://www.viki.com/users/abelclark74_835/about
https://abelclark74.livejournal.com/profile
https://list.ly/abelclark74/lists
https://seekingalpha.com/user/50531435/comments
https://harjotmcc.tumblr.com/
https://www.apsense.com/user/harjotmcc
https://www.burdastyle.com/profiles/rexlucas20
https://www.turnkeylinux.org/user/817376
http://yourlisten.com/rexlucas20
https://www.threadsmagazine.com/profile/rexlucas20
https://splice.com/rexlucas20
https://experiment.com/users/rlucas
https://speakerdeck.com/ryanprice623
http://webmii.com/5bfe5a5f5bfe4-jlCOfd
The three methods commonly used by Google to prevent indexing of URLs are:
Using the rel = "nofollow" attribute on all anchor elements used to link to the page to prevent links from being followed by the crawler.
Using a disallow directive in the site's robots.txt file to prevent the page from being crawled and indexed.
Using the meta robot tag with the content = "noindex" attribute to prevent the page from being indexed.
While the differences in the three approaches seem subtle at first glance, the effectiveness can vary greatly depending on the method you choose.
Using rel = "nofollow" to stop Google indexing
Many inexperienced webmasters try to prevent Google from indexing a particular URL by using the rel = "nofollow" attribute on HTML anchor elements. They add attributes to each anchor element of their site used to link to that URL.
The inclusion of the rel = "nofollow" attribute on a link prevents Google's crawler from following the link, which in turn, prevents them from searching, crawling, and indexing the target page. While this method can serve as a short-term solution, it is not a viable long-term solution.
The drawback with this approach is that it considers all inbound links to the URL that would include a rel = "nofollow" attribute. However, the webmaster has no way to prevent other web sites from linking with URLs. So chances are that the URL will eventually be crawled and indexed using this method.
Using robots.txt to stop Google indexing
Another common method used by Google to prevent URLs from being indexed is to use a robots.txt file. A rejected directive can be added to the robots.txt file for the URL in question. Google's crawler will honor the directive that prevents the page from being crawled and indexed. However, in some cases, the URL may still appear in the SERPs.
Sometimes Google will display a URL in their SERPs, although they have never indexed the content of that page. If enough web sites link to the URL then Google can often infer the subject of the page from the link text of the inbound link. As a result they will display URLs in SERPs for related searches. When using a disallow directive in a robots.txt file, it will prevent Google from crawling and indexing the URL, guaranteeing that the URL will never appear in the SERPs.
Using Meta Robot Tags to Stop Google Indexing
If you need to prevent Google from indexing URLs while preventing that URL from appearing in SERPs, the most effective approach is to have a meta robot with a content = "noindex" attribute within the main element of the web page Tags to be used. Of course, for Google to actually see this meta robot tag they first need to be able to search and crawl the page, so don't block URLs with robots.txt. When Google crawls the page and the Meta Robot noindex tag is detected, they will flag the URL so that it will never be shown in SERPs. This is the most effective way to prevent Google from indexing URLs and displaying them in your search results. I have list down some backlinks--
https://www.eeweb.com/profile/alexpatton32
https://ficwad.com/a/alexpatton32
https://artmight.com/user/profile/54241
https://alexpatton32.podbean.com/e/podbean_best_podcast_hosting_audio_video_blog_hosting/?token=aea991bf6e44445e31dd4a27bfbad36c
https://speakerdeck.com/alexpatton32
http://webmii.com/5d32c34a4b5d8-G98LmE
https://austintodd101.dreamwidth.org/profile
https://soundcloud.com/user-737601100
https://www.behance.net/austintodd
https://kinja.com/austintodd101
https://www.intensedebate.com/people/austintodd101
https://openlibrary.org/account/login
http://www.feedbooks.com/user/5401030/profile
http://www.feedbooks.com/user/5401030/profile
https://austintodd101.livejournal.com/profile
https://list.ly/austintodd101/lists
https://ficwad.com/a/austintodd101
https://artmight.com/user/profile/54171
https://austintodd101.podbean.com/e/podbean_best_podcast_hosting_audio_video_blog_hosting/
https://speakerdeck.com/austintodd101
http://webmii.com/5d319dd2342ec-Vs0bMv
https://donshelton32.dreamwidth.org/profile
https://soundcloud.com/user-211312313
https://www.behance.net/donshelton
https://openlibrary.org/people/donshelton32
http://www.feedbooks.com/user/5276580/profile
https://www.viki.com/users/donshelton32_338/about
https://donshelton32.livejournal.com/profile
https://list.ly/donshelton32/lists
https://www.finecooking.com/profile/donshelton32
https://www.burdastyle.com/profiles/donshelton32
https://www.edocr.com/account/create
https://www.turnkeylinux.org/user/804179
http://yourlisten.com/donshelton32
https://www.finecooking.com/profile/leesilva50
https://www.burdastyle.com/profiles/leesilva50
https://www.turnkeylinux.org/user/682815
http://yourlisten.com/leesilva50
https://www.threadsmagazine.com/profile/leesilva50
https://splice.com/leesilva50
https://luiscook20.dreamwidth.org/profile
https://soundcloud.com/user-225613866
https://www.behance.net/luiscook
https://kinja.com/luiscook20
https://www.intensedebate.com/
https://openlibrary.org/people/benmack29
http://www.feedbooks.com/user/5406286/profile
https://www.viki.com/users/benmack29_76/about
https://benmack29.livejournal.com/profile
https://list.ly/benmack29
https://billlewis205.dreamwidth.org/profile
https://soundcloud.com/user-472017126
https://www.behance.net/billlewis1
https://kinja.com/billlewis205
https://www.intensedebate.com/people/billlewis205
https://openlibrary.org/account/login
http://www.feedbooks.com/user/5413354/profile
https://www.viki.com/users/abelclark74_835/about
https://abelclark74.livejournal.com/profile
https://list.ly/abelclark74/lists
https://seekingalpha.com/user/50531435/comments
https://harjotmcc.tumblr.com/
https://www.apsense.com/user/harjotmcc
https://www.burdastyle.com/profiles/rexlucas20
https://www.turnkeylinux.org/user/817376
http://yourlisten.com/rexlucas20
https://www.threadsmagazine.com/profile/rexlucas20
https://splice.com/rexlucas20
https://experiment.com/users/rlucas
https://speakerdeck.com/ryanprice623
http://webmii.com/5bfe5a5f5bfe4-jlCOfd
0 comments:
Post a Comment