Search Engine Optimization - Robots.txt and Supplemental Results

Print Page | Close Window

Robots.txt and Supplemental Results

Printed From: ProductCart E-Commerce Solutions
Category: ProductCart
Forum Name: Search Engine Optimization
Forum Description: Talk about ways to optimize your ProductCart store for search engines
URL: https://forum.productcart.com/forum_posts.asp?TID=156
Printed Date: 09-May-2024 at 8:10pm
Software Version: Web Wiz Forums 12.04 - http://www.webwizforums.com

Topic: Robots.txt and Supplemental Results

Posted By: watercrazed
Subject: Robots.txt and Supplemental Results
Date Posted: 28-March-2006 at 7:09pm

Here are some of the area's I have disallowed in my robots. These are areas that either I did not feel SE needed access to and somehow they showed up in my logs. Or they were the cause of contentless pages getting indexed, or causing duplicate content problems with google.

User-agent: *

Disallow: /ProductCart/calendar/
Disallow: /ProductCart/htmleditor/
Disallow: /ProductCart/ii/
Disallow: /ProductCart/pcadmin/
Disallow: /ProductCart/UPSLicense/
Disallow: /ProductCart/setup/
Disallow: /ProductCart/pc/New
Disallow: /ProductCart/pc/images/
Disallow: /ProductCart/pc/catalog/
Disallow: /ProductCart/pc/advSrca.asp
Disallow: /ProductCart/pc/Affiliate
Disallow: /ProductCart/pc/advSearch_h.asp?
Disallow: /ProductCart/pc/prv_allreviews.asp?
Disallow: /ProductCart/pc/contact.asp
Disallow: /ProductCart/pc/checkout.asp
Disallow: /ProductCart/pc/custPref.asp
Disallow: /ProductCart/pc/custva.asp
Disallow: /ProductCart/pc/Custva.asp?
Disallow: /ProductCart/pc/custwl.asp
Disallow: /ProductCart/pc/default.asp
Disallow: /ProductCart/pc/tellafriend.asp?

-------------
John

http://www.ultimatewatermassage.com - massagers, heat therapy, buckwheat pillows and more