Mandatory, Optional and Problematic Response Headers

[CMCDragonkai]

Mandatory

1. Location

Optional

1. All the other headers

Problematic

1. Content-Length - This has a problem with gzip encoding. Is the Content-Length the original content-length, the length after scraping, the length after scraping in inserting into SnapSearch's JSON REST structure or the length of the encoded response after sending to the client. The easiest way, don't bother adding this header.
2. Content-Type - It will always be HTML, but the problem is, it could also be XHTML... etc.
3. Any header dealing with encoding such as transfer encoding.. etc.