Get Paid to Participate - up to $1 per post!     Twitter     Facebook     Google+
Hosting Discussion
 

forgot password?



Reply


Old
  Post #1 (permalink)   11-18-2015, 06:49 PM
HD Newbie
 
Join Date: Nov 2010
Posts: 26

Status: Lincxu is offline
I have a website and recently when I check from webmaster center, I found the bot is crawling many old dead pages. I'm sure there's no way to find such pages on website anymore. But why googlebot still trying to crawl such non-exist pages? Because of this, it gives me lots of 404 errors from report.
__________________
www.WebHostPark.com
Best web host reviews & guidance
 
 


Old
  Post #2 (permalink)   11-19-2015, 03:32 AM
HD Community Advisor
 
SenseiSteve's Avatar
 
Join Date: Mar 2009
Location: Saint Louis
Posts: 4,975
Send a message via MSN to SenseiSteve

Status: SenseiSteve is offline
Have you updated your sitemap?
__________________
ProlimeHost- Dedicated Server Hosting & KVM SSD VPS
Three Datacenter Locations: Los Angeles, Denver & Singapore
SuperMicro Hardware | Multiple Bandwidth Providers | 24/7 On Site Engineers
 
 
 


Old
  Post #3 (permalink)   11-21-2015, 01:18 PM
HD Amateur
 
Join Date: Sep 2014
Posts: 81

Status: CarlC is offline
Your sitemap must be up to date. If you are running like a wp site there are plugins that you can get to keep it updated. Also we had a online shop that had a script that would update the sitemap at any interval you set it at ie. daily, weekly or monthly and of course you can also use your cron for setting the interval also.
__________________
Papas Hosting
Shared, Dedicated,
VPS & Reseller Hosting
 
 
 


Old
  Post #4 (permalink)   11-21-2015, 06:13 PM
HD Newbie
 
Join Date: Nov 2010
Posts: 26

Status: Lincxu is offline
Hi

Yes, sitemap is checked for sure. still no clue why the bot is trying to crawl those nonexist pages. Any other point should I check? Thanks for any help.
__________________
www.WebHostPark.com
Best web host reviews & guidance
 
 
 


Old
  Post #5 (permalink)   12-04-2015, 10:12 PM
Account Disabled
 
Join Date: May 2014
Posts: 26

Status: Prewebhost is offline
Please check the sitemap and then resubmit the website at google.
 
 
 
Reply

Thread Tools

New Post New Post   Old Post Old Post
Posting Rules:
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
vB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On
Sponsored By: