org.archive.modules.canonicalize.StripSessionIDs_en.utf8 Maven / Gradle / Ivy

Go to download

Show more of this group Show more artifacts with this name
Show all versions of heritrix-modules Show documentation

This project contains some of the configurable modules used within the Heritrix application to crawl the web. The modules in this project can be used in applications other than Heritrix, however.

There is a newer version: 3.5.0

Show newest version

description:
Strip known session IDs.  Use this rule to remove all of a set of known session 
IDs.  For example, this rule will strip JSESSIONID and its value from
'http://archive.org/index.html?JSESSIONID=DDDSSE233232333355FFSXXXXDSDSDS'.  
The resulting canonicalization returns 'http://archive.org/index.html'.
This rule strips JSESSIONID, ASPSESSIONID, PHPSESSID, and 'sid' session ids.