netsurf/content
John Mark Bell 78d194cb77 Rework handling of HTTP redirects -- we now count the number of redirects followed for a given item and abort if a fixed limit is reached. This fixes sites which have pages that redirect to themselves.
Redirect handling is now transparent to clients of fetchcache.

The new scheme works as follows:

1) Request content for URL (fetchcache()
2) Start fetch of content (fetchcache_go()
3) If no redirect, continue through LOADING, READY, DONE etc. states as before
   If redirect, receive NEWPTR for each redirect that occurs, then continue
   through LOADING, READY, DONE etc. states as before.

The upshot of this is that redirects result in extra contents being created. It also means that, until LOADING has been received, the content (and thus the URL being fetched) may change. Therefore, fetchcache clients should expect to have to deal with transient data prior to LOADING occurring.

As a necessary side-effect of this, the HTML object URLs and CSS @import URLs are no longer stored alongside the relevant contents. These URLs can be accessed by interrogating the url member of struct content anyway, so it was a rather redundant scheme before.

svn path=/trunk/netsurf/; revision=3787
2008-01-28 01:35:00 +00:00
..
fetchers Update all source code file headers to reflect GPL version 2 only and contain appropriate licence text 2007-08-08 16:16:03 +00:00
content.c Rework handling of HTTP redirects -- we now count the number of redirects followed for a given item and abort if a fixed limit is reached. This fixes sites which have pages that redirect to themselves. 2008-01-28 01:35:00 +00:00
content.h Rework handling of HTTP redirects -- we now count the number of redirects followed for a given item and abort if a fixed limit is reached. This fixes sites which have pages that redirect to themselves. 2008-01-28 01:35:00 +00:00
content_type.h Update all source code file headers to reflect GPL version 2 only and contain appropriate licence text 2007-08-08 16:16:03 +00:00
fetch.c Update all source code file headers to reflect GPL version 2 only and contain appropriate licence text 2007-08-08 16:16:03 +00:00
fetch.h Update all source code file headers to reflect GPL version 2 only and contain appropriate licence text 2007-08-08 16:16:03 +00:00
fetchcache.c Rework handling of HTTP redirects -- we now count the number of redirects followed for a given item and abort if a fixed limit is reached. This fixes sites which have pages that redirect to themselves. 2008-01-28 01:35:00 +00:00
fetchcache.h Update all source code file headers to reflect GPL version 2 only and contain appropriate licence text 2007-08-08 16:16:03 +00:00
urldb.c More work on cookie parser. Our junk value handling is now significantly closer to that of other browsers. 2008-01-19 01:51:39 +00:00
urldb.h Work on cookies to bring our behaviour closer to the spec and other browsers: 2008-01-17 20:00:55 +00:00