Search engines index all pages that a website sees, even pages it doesn’t see in some cases. As Web site owners, we may not want each of our content to be open to search engines. In such cases, it should be removed from the search engine results to not damage the site’s image.
- In which cases the content can be cleaned
- Content Cleanup Options
- Why should unwanted indexers be deleted?
- Which methods with index are deleted
- How can I remove a URL on my website from the Google Index?
In which cases the content can be cleaned
- Pre-existing but subsequently deleted content
This situation is likely to happen if the content we have previously published on our site is outdated or if the sale of the product we sell is withdrawn.
- External links to pages not included on our site
This is the links given by other sites, which are considered to be a page that is not actually included in the site.
- As a result of moving the site to another address, the indexes on the old site must be deleted and transferred to the new site.
In which cases we may link to content that is not on our site
- If a previously existing content was deleted, the link to that content might not have been deleted.
- A link can be given due to coding errors or misunderstandings.
- By adding REF codes, you can consciously link for advertising purposes.
- Hidden content
In the case of confidential content, if the product or information on a site is only open to the desired member or persons, the index of such pages is cleaned up by search engines to prevent any visits to that content.
Content Cleanup Options
- Clearing a site completely from search engines
- Transferring all the results of a site to another site
- This situation is preferred when the site is moved to another address.
- Clearing specific content for a site
- It is suspected of spam, considering that pages that are not on our site appear to have search engines and that sites have more index counts. For this reason, non-existent indexers can lead to the SEO work of the sites and even the sites to be punished by the search engines by filtering.
- At the same time, invalid Indexs found in search engines are shadowing the site’s image. Visitors can think of any information or products they are looking for when they reach a page that is not on your site.
- Apart from these, the Admin panel entry or official document and information belonging to the site must be confidential to any user who may come through the search engine.
- Webmaster Tools
- Meta Code
Why should unwanted indexers be deleted?
Which methods with index are deleted
Webmaster Tools Configuration
Webmaster Tools allows search engines to notify website owners about search and scan situations.
In this article, the world’s most used search engine will be narrated through Google.
After registering our website with Google Webmaster Tools, in the Site configuration section, go to the Browser Access section and click on the Create Robots. txt tab to see all content of our website visible to Google or 2. With the option, you can have the entire site removed from Google search results.
If you want to remove the unique links from the site instead of the entire website content, we ask Google to enter the URLs we want removed from the browser Access URL tab.
Robots. txt edit
We can intervene on all site content by editing Robots. txt via Webmaster tools. However, by manually editing the Robots. txt file, you can delete the page, directory, category, and all site content you want removed from search engines.
To delete a whole site
Only for desired page, index or category
For Google image searches
Only desired image
All pictures on the site
Adding a Meta code
Meta robots code can be used to delete all site content or only the index of the requested content.
Placing the following code only on the desired pages, placing the index of those pages or all pages in the entire index of the site content, the next search engine will be removed from search engine results with the visit of the bot Can.
< meta content = “noindex, nofollow” >
If you want to delete the index of some search engines rather than all search engines, only the name of that bot should be entered, as in the example below.
< meta content = “noindex, nofollow” >
Otherwise, you’ll need to add the following code to prevent search engines from being able to cache your site or to delete pages in memory.
< meta content = “Noarchive” >
As a result of changing the site address, the index of the old site is redirected to the new site, both the search engine and the future visits to the new site lossless redirect with this redirect and old indexes as new site index The htaccess arrangement is used to ensure that the
For pages that do not open, the index of the 404 pages by creating the page 404 can be prevented by other methods.
We may be able to redirect an old product or information page to a new product page.
Redirect Permanent http://www.old-site.com/http://www.new-site.com/
How can I remove a URL on my website from the Google Index?
To remove a specific URL (for example, the page http://www.example.com/page4.html) of your own website from Google’s index, there are two options available:
Option #1: Use the robots meta-element with NOINDEX
Add the meta-element robots to the source code of the page which is not supposed to appear in the index and set the value to NOINDEX.
By adding the following to the source code of a page, it will be removed from the index:
<meta name="robots" content="noindex">
You have to add the meta-element in the <head> area of the specific page:
If the page already has the robots meta-element with the value INDEX, you can simply replace it with NOINDEX.
Done. Now you just have to wait until the desired URL is removed from the Google index.
Option #2: Use the Google Search Console
Using a setting within the Google Search Console, you are able to easily have a URL removed from the Google index.
In case you are not yet using the Google Search Console, you can activate your website for the free (www.google.com/webmasters/tools/?hl=en) in just a few minutes. This also lets you remove URLs from the Google Index afterwards.
Removing a URL from the index with the Google Search Console:
- Log into the Google Search Console and select the desired website
- Click on “Optimization” in the left-hand navigation
- Click on “Remove URL” in the sub-menu
- Click on the button “create a new request for removal” on this page
- You will now be asked to type in the URL of the page that you want to be removed and confirm your choice by clicking on “continue” (in our example this is the page http://www.example.com/page4.html)
Done. Now you have to wait some time until the desired URL is removed from Google’s index.
The Google Search Console will now also indicate the status of the removal process of the URL on this page.
The search engine Bing also provides their own webmaster tools, which you can use to have URLs removed from their index.
If you use option #2 to remove a URL from the index, by using the Google Search Console / Bing Webmaster-Tools, the deletion may only be temporary in some cases.
The URL will definitely be removed from the search index for 90 days. Afterwards, there is a possibility that the URL may be re-introduced into the index, if the URL is still accessible and links still point to it.
If you want to make sure that a URL is permanently removed from the index, you should go with option #1 and use the robots meta-element with NOINDEX.