Gotta admit I really enjoyed this article.
Most articles i read its the same ol' crap just rewritten to get the autor a backlink.

Whereas this one actually had something to say. Ive never seen an article this informative about something I didnt even know I knew nothing about!!
It's given me some ideas on helping my own indexing, but more importantly, it gave me a laugh when I found out the PC i was reading it on outstrips any one of googles servers!!!

It's pure speculation

But is probably quite accurate, or at least gives those thinking about it all a good grounding for how to think about their pages

The thing that really spoke to me in this article was about how google decide that the content might have changed on a page.

I always thought theyd compare whats already indexed against what they have just got hold of.

oooohhhh nooooo!!!

It seems its all about when the file was last modified/created using the servers dates.

Well, on all my sites, my files are dynamic, the content changes daily, sometimes hourly, but the new stuff just wasnt getting indexed. In my G stats i was seeing "we last indexed your homepage faaaaaaaaaaaarrrrrrr too long ago"

So, i deleted every homepage ive got, and dropped the backups in. The files are exactly the same though, just the content it drags outta the DB changes everyday.

All my homepages were last indexed yesterday.

So, im planning on doing this at least once a week. only takes a minute to go through them all and hopefully, that new content will get indexed abit more regularly. Hopefully, that'll help in rankings abit too.

yeah its pure speculation, and the time frames are way off too

4-12 weeks is obviously wrong - if you don't believe it try googling for the score of a football game minutes after its over or something like that

I know someone who has two versions of every page.
They have some script that changes them over every few days.
He gets high rankings.
So maybe we just re-upload our sites every week or so regardless of changes....(we old fashioned html types, that is!!)

Mind giving a link to the article or do I ignorantly miss it?

http://www.site-reference.com/articles/ … f-SEO.html

It used to be well documented, and publicly acknowledged by the SEs that the page was deemed to have changed if the  file size had changed by at least 1k.

Is there anything (that's not speculation) to suggest otherwise?

For example - a database driven site may have the same url and file but the data on the page may change with time (a new product in the catalog, for example). As G says it's getting better at crawling dynamic urls it must look at more than just date modified.

okay - stuff i don't know:
I'm assuming the server header contains the content length (ie file size) so the SE only needs to get this to know if the page has changed
I'm also not sure what date for last_mod the server would send for dynamic pages

If you have dynamic content on your website that is changing every day then try adding this meta tag to your dynamic pages-

<Meta name="Revisit-After" content="# days">

just change the hash to your number but I wouldn`t make it 1 day unless your content really does change or you will find your website dumped into googles supplemental pages.I made thta mistake and it takes some getting it back out,So I got my own search engine and started building my own indexed database follow the link below to add your website for crawling.

Good luck

Awagawag.co.uk

AWagawag wrote:

If you have dynamic content on your website that is changing every day then try adding this meta tag to your dynamic pages-
<Meta name="Revisit-After" content="# days">

If only it were that simple

The SEs take no notice of this tag. Dig around on their site and I'm sure you'll find reference to it

Hi!
How long have Se`s  been ignoring these tags? I didn`t know that they were next to useless ,maybe I will re introduce it into my search engine.Thanks for letting me know though,I can remove them off my pages now.

Steve

since for ever!

even the meta keywords and descrription are generally ignored

I know the meta tags and descriptions are not ignored it is a matter of how the are optimized they are used to weight the results and apply relevancy to a result although some engines may ignore them but not all.

Steve
Awagawag.co.uk

Meta keywords are pretty much ignored, but description tag and title are still very important.  The timelines are way off in the article because crawling times are truly different for everyone.  Google crawls some pages every other day and could index those changes immediately after.  Some pages with lower quality links pointing to them may get crawled weekly or monthly and updated even later.

Either way I would not worry to much about this and just make sure your in Google Sitemaps.

There are only 5 search engines. 3 of them worth getting ranked in

Google
Yahoo
MSN / Live
Ask / Teoma
A9 (Amazon)

None of them put any weight on meta keywords / description.

True, they use these tags - The description is sometimes used in the SERPs

They also penalise / filter results if the tags are too spammy or are the same on every page on the site

I think your right I have done a bit of snooping around today and I find not many people have keywords on their websites some don`t even have tags but yet they are ranked top for certain search words how do they manage it,Some are obviously sites that are hardly updated well not as often as some.I feel its like fighting a losing battle so yet again tommorrow I think I will try another tactic when I submit my pages to the search engines,after optimizing yet again.



Thanks
Awagawag ;D

Thanks Laurie, interesting reading as usual.

thegreatyo wrote:

Thanks Laurie, interesting reading as usual.

Isnt it just! Best article Ive read in ages tbh.

The "revist" tag is in every page of every site I own/run and I know that its ignored completely. I think its one of those things that was decided by the powers that be to be a good idea at the time, but the SEs decided it was to risky to trust.

I put just about every possible meta tag into every page i have though just incase one SE decides to take notice of it.