Google, Yahoo and Microsoft decided to implement a new web standard which will enable millions of publishers to remove duplicate pages from their websites. The joint web cleaning initiative will also help the search engines to come out with more comprehensive search results. According to Matt Cutts of Google, the publishers all over the world face the problem of duplicate pages and with new web standard they will be able to clean up a lot of junk. Cutts is the chief engineer of Google's spam fighting efforts.

 

Now-a-days several web publishers possess voluminous sites and have multiple URLs that all point to the same page. Due to the presence of multiple URLs and large numbers of sites, the search engines often get confused and index the same page multiple times. According to estimates, as much as 20 percent of URLs on the web may be duplicates.