ProductCart E-Commerce Solutions Homepage
Forum Home Forum Home > ProductCart > Search Engine Optimization
  New Posts New Posts RSS Feed - Robots.txt and Supplemental Results
  FAQ FAQ  Forum Search   Events   Register Register  Login Login

Robots.txt and Supplemental Results

 Post Reply Post Reply
Author
Message
watercrazed View Drop Down
Groupie
Groupie
Avatar

Joined: 31-December-2005
Location: United States
Status: Offline
Points: 0
Post Options Post Options   Thanks (0) Thanks(0)   Quote watercrazed Quote  Post ReplyReply Direct Link To This Post Topic: Robots.txt and Supplemental Results
    Posted: 28-March-2006 at 7:09pm
Here are some of the area's I have disallowed in my robots.  These are areas that either I did not feel SE needed access to and somehow they showed up in my logs.  Or they were the cause of contentless pages getting indexed, or causing duplicate content problems with google.

User-agent: *

Disallow: /ProductCart/calendar/
Disallow: /ProductCart/htmleditor/
Disallow: /ProductCart/ii/
Disallow: /ProductCart/pcadmin/
Disallow: /ProductCart/UPSLicense/
Disallow: /ProductCart/setup/
Disallow: /ProductCart/pc/New
Disallow: /ProductCart/pc/images/
Disallow: /ProductCart/pc/catalog/
Disallow: /ProductCart/pc/advSrca.asp
Disallow: /ProductCart/pc/Affiliate
Disallow: /ProductCart/pc/advSearch_h.asp?
Disallow: /ProductCart/pc/prv_allreviews.asp?
Disallow: /ProductCart/pc/contact.asp
Disallow: /ProductCart/pc/checkout.asp
Disallow: /ProductCart/pc/custPref.asp
Disallow: /ProductCart/pc/custva.asp
Disallow: /ProductCart/pc/Custva.asp?
Disallow: /ProductCart/pc/custwl.asp
Disallow: /ProductCart/pc/default.asp
Disallow: /ProductCart/pc/tellafriend.asp?

Back to Top
 Post Reply Post Reply
  Share Topic   

Forum Jump Forum Permissions View Drop Down

Forum Software by Web Wiz Forums® version 12.04
Copyright ©2001-2021 Web Wiz Ltd.

This page was generated in 0.031 seconds.