Weather-Watch.com
September 02, 2010, 05:49:00 PM *
Welcome, Guest. Please login or register.
Did you miss your activation email?

Login with username, password and session length
Members: 8,509  Posts: 362,031  Topics: 40,113
Please welcome lawrencerebeiro, our newest member.

Latest versions: WD - 10.37P  WDL - 6.05  MML - 1.03
 News:
Check out the new FAQs (Frequently Asked Questions) board for a growing list of hints, tips and diagnostic suggestions.
  Advanced Search
   Home   Bug Tracker Photo Gallery Wiki Chat Calendar Search Login Register Help  
Pages: [1]
  Print  |  « previous  |  next »  |  Go Down  
Author Topic: Errors on Carterlake/Saratoga/Webster type website  (Read 166 times)
0 Members and 1 Guest are viewing this topic.
johnbrush
johnbrush
Junior Forecaster
****
Offline Offline

Location: Auchterhouse, Angus, Scotland, UK
Station Type: Instromet
Posts: 61
Local Time: Thursday 17:49


WWW
« on: August 25, 2010, 06:23:23 PM »

My website seems to work really well, but I notice that certain people when they login generate errors which appear in my website host's log.  These errors are quite regular and the two most common ones are:
[Wed Aug 25 16:46:26 2010] [error] [client {client URL}] File does not exist: /home/myusername/public_html/404.shtml
[Wed Aug 25 16:46:26 2010] [error] [client {client URL}] File does not exist: /home/myusername/public_html/robots.txt

I've deleted the URL which caused the error in the above so as not to incriminate anyone and substituted {client URL} in each line.  I've also changed the name of the directory which causes it to "myusername". I'm not sure if it compromises security if I left the correct directory in the above or not so I have replaced it as a precaution. If I login to my website, I don't create the error. Does anyone know the reason for this and what does it signify? Generally speaking, these two errors appear together, in fact I think they always do.

My website URL is http://sidlawweather.co.uk.
If anyone can suggest the reason for this, I'll be very grateful.
Logged
BigOkie
Senior Forecaster
*
Online Online

Location: Tulsa, OK
Station Type: Honeywell/Irox TE923W
Posts: 436
Local Time: Thursday 13:49


WWW
« Reply #1 on: August 25, 2010, 06:35:21 PM »

My website seems to work really well, but I notice that certain people when they login generate errors which appear in my website host's log.  These errors are quite regular and the two most common ones are:
[Wed Aug 25 16:46:26 2010] [error] [client {client URL}] File does not exist: /home/myusername/public_html/404.shtml
[Wed Aug 25 16:46:26 2010] [error] [client {client URL}] File does not exist: /home/myusername/public_html/robots.txt

I've deleted the URL which caused the error in the above so as not to incriminate anyone and substituted {client URL} in each line.  I've also changed the name of the directory which causes it to "myusername". I'm not sure if it compromises security if I left the correct directory in the above or not so I have replaced it as a precaution. If I login to my website, I don't create the error. Does anyone know the reason for this and what does it signify? Generally speaking, these two errors appear together, in fact I think they always do.

My website URL is http://sidlawweather.co.uk.
If anyone can suggest the reason for this, I'll be very grateful.

Your first clue is the lack of a robots.txt file.  The Carterlake template doesn't provide for one.  Robots.txt is a standards file that spiders (search engine bots) use to get a map of your website.  Spiders first request the robots.txt file...if it can't find one, it starts traversing the website willy-nilly usually.

The 404.shtml file is likely another, or, your htaccess file has a rule pointing to 404.shtml as your default 404 (not found) page and it doesn't exist.  Nothing really to be alarmed with.  IMO.
Logged

johnbrush
johnbrush
Junior Forecaster
****
Offline Offline

Location: Auchterhouse, Angus, Scotland, UK
Station Type: Instromet
Posts: 61
Local Time: Thursday 17:49


WWW
« Reply #2 on: August 26, 2010, 07:22:30 AM »

Your first clue is the lack of a robots.txt file.  The Carterlake template doesn't provide for one.  Robots.txt is a standards file that spiders (search engine bots) use to get a map of your website.  Spiders first request the robots.txt file...if it can't find one, it starts traversing the website willy-nilly usually.

The 404.shtml file is likely another, or, your htaccess file has a rule pointing to 404.shtml as your default 404 (not found) page and it doesn't exist.  Nothing really to be alarmed with.  IMO.
OK thanks BigOkie.  Much is explained by your reply. I don't know how to create robots.txt in order to prevent this error, but, as you say it is perhaps not too important.  The 404.shtml error only seems to occur in conjunction with another error - it's as if it is looking for that file which might contain a list of errors.

John
Logged
ktrue
Junior Weather Controller
****
Offline Offline

Location: Saratoga, CA, USA 37:16:28N, 122:01:23W - Elev: 374ft.
Station Type: Davis VP1+ FARS, Boltek-PCI, NexStorm StormVue WASP2, GRLevel3, WXSIM
Posts: 3,906
Local Time: Thursday 09:49



WWW
« Reply #3 on: August 26, 2010, 10:11:01 PM »

A robots.txt file can be really simple like:

Code:
User-agent: *

Disallow: /cgi-bin/
Disallow: /wxwuhistory.php

Just create the file in a text editor and upload it.

The missing 404.shtml file just means you haven't created a custom error handler file for missing files.. no worries.. it's not required at all.

Best regards,
Ken
Logged

Ken True
Saratoga Weather
CWOP: CW1792
WeatherUnderground: KCASARAT1
Free weather website PHP scripts and WD website AJAX templates
Pages: [1]
  Print  |  « previous  |  next »  |  Go Up  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.11 | SMF © 2006-2009, Simple Machines LLC Valid XHTML 1.0! Valid CSS!