How to tell crawlers that URI has been changed?
-
tanoha
-
Topic Author
-
Offline
-
New Member
-
Less
More
-
Posts: 3
-
Thank you received: 0
-
-
11 years 2 months ago - 11 years 2 months ago #1515
by tanoha
Dear Admin,
First of all, thank for your extension.
I've moved some articles to the new menu/category and after sometimes, GWT says that there are some duplicate title tag and duplicate meta description.
My correct new url:
mysite .com /new-menu/id-old_article
The duplicate is old URL:
mysite .com /id-category/id-old_article
(id is the number).
Please help me to write the correct rule pattern as an example.
In case I delete one of the old menu, how should I set the rule to tell robots to stop crawling and indexing?
Best regards,
Last edit: 11 years 2 months ago by tanoha.
Please Log in or Create an account to join the conversation.
Less
More
-
Posts: 3194
-
Thank you received: 441
-
-
11 years 2 months ago #1517
by admin
Hi,
if the robot still try to access to the old URL (e.g. this already exists on the web) you could redirect to new corresponding page. It should be possible to create one or few rules to redirect all old URLs but I need some examples to be sure the rule will match only pages to redirect. You can post here or send me an email at info(at)selfget.com.
Kind regards,
Luigi
The following user(s) said Thank You: tanoha
Please Log in or Create an account to join the conversation.
-
tanoha
-
Topic Author
-
Offline
-
New Member
-
Less
More
-
Posts: 3
-
Thank you received: 0
-
-
11 years 2 months ago #1520
by tanoha
Hi Luigi,
Here is one of the duplicate meta description and duplicate title tag:
/30-product/service/134-maintenance
/tech/30-product/service/134-maintenance
/Industrial/31-product/service/134-maintenance
/household/32-product/service/134-maintenance
/product/134-maintenance
The canonical is /service/134-maintenance
Also, today I see in the GWT there is hundred of duplicate meta description causes by Search Component, for example:
/component/search/
/component/search/?searchphrase=any&ordering=newest&limit=10&searchword=coliform
/component/search/?searchword=coliform
I am waiting for your instruction. Best Regards,
Please Log in or Create an account to join the conversation.
Less
More
-
Posts: 3194
-
Thank you received: 441
-
-
11 years 2 months ago #1522
by admin
The only common patter to all and only these duplicates is:
So you could create a rule like this and set the full canonical URL.
About the search, you could use the GWT options to specify variables to ignore (e.g. searchphrase) or build a Tag Meta rule for /component/search to enhance any search generated page with automatic meta info and have different pages for spiders...
Kind regards,
Luigi
The following user(s) said Thank You: tanoha
Please Log in or Create an account to join the conversation.
-
tanoha
-
Topic Author
-
Offline
-
New Member
-
Less
More
-
Posts: 3
-
Thank you received: 0
-
-
11 years 2 months ago #1523
by tanoha
Thank you Luigi for a helpful tip. I will have to set many rules like this for many articles.
The menu and category "product" has been deleted and I am thinking about this syntax:
URI: ^/*-product/
Robots: noindex, nofollow
Does that means all the URL contain /idnumber-product/ will no longer be indexed?
Please Log in or Create an account to join the conversation.
Less
More
-
Posts: 3194
-
Thank you received: 441
-
-
11 years 2 months ago #1524
by admin
Just a note about the regexp syntax. Tag Meta uses this:
dev.mysql.com/doc/refman/5.1/en/regexp.html
If you need to match all URLs containing /idnumber-product/ a better rule could be:
The caret ^ means "start with" and this doesn't seem your case.
Kind regards,
Luigi
The following user(s) said Thank You: tanoha
Please Log in or Create an account to join the conversation.
Time to create page: 0.152 seconds
