Weather and the Internet > Creating Weather Web Sites

sitemap.xml

(1/18) > >>

carterlake:
I think this needs its own thread.

Just like every website owner should have an favicon and should setup his or her robots.txt and .htaccess.

You should now also have a sitemap.

The sitemap Protocol allows you to inform search engines about URLs on your websites that are available for crawling. But more importantly, Google uses it to display sublinks for your site.

Just do a search on Google for sitemap.xml and you'll find tools and generators so you can create your own.

http://www.google.com/search?hl=en&q=sitemap.xml

Google also has free webmaster tools to allow you to validate your sitemap.

http://www.google.com/webmasters/

(One note, if you use www.mysite.com for everything, be sure to sign up your site with the www. or google will invalidate a lot of your sitemap links)

You should also add:

Sitemap: http://www.carterlake.org/sitemap.xml

to your robots.txt file so the major 3 search engines can find your sitemap.

Billw69:
Tom, Since I don't know what I am doing :?, I looked at my robots.txt file on my web site. I assume it should have keywords in it for search engines to find? or, is it supposed to thave web addresses for each of my web pages? Anyway, this is all thats in it at this time....
User-agent: *
Disallow: /log
Disallow: /xxx
I have no idea what it means.
Thanks,
Bill

niko:
One result of adding the sitemap is that Google search can display your site like this:

niko:

--- Quote from: Billw69 on August 30, 2008, 03:30:06 PM ---Tom, Since I don't know what I am doing :?, I looked at my robots.txt file on my web site. I assume it should have keywords in it for search engines to find? or, is it supposed to thave web addresses for each of my web pages? Anyway, this is all thats in it at this time....
User-agent: *
Disallow: /log
Disallow: /xxx
I have no idea what it means.
Thanks,
Bill

--- End quote ---

Robots.txt only contains instructions that tell the search engine where it can, and can't, look for content to index.

Yours is telling them not to index your log and xxx directories, and by default they can search anywhere else.

drobbins:
I have used the google sitemap generator and it works well. One note though, this week I added a page with the WU historical data, then I went to make a new sitemap. The generator wanted to map over 500 pages. I think it was trying to get all the info from WU, so I just manually added a WX13.php (the history page) to my existing sitemp.

Niko,
I think a site needs to have many pages that can be "categorized" in order to have the sitelinks as you showed.
--- Quote ---Google has not generated any sitelinks for your site. Sitelinks are completely automated, and we show them only if we think they'll be useful to the user.
--- End quote ---

Navigation

[0] Message Index

[#] Next page

Go to full version