ZOMDir > Blog

Sunday, 3 November 2013

HTTP Errors

Since the launch of ZOMDir at June 5, 2013 I add a regular base sites myself to the directory. This is great for discovering small "bugs".

In the past a time-out of 7 seconds, before the conclusion is drawn that the given site isn't responding. I discovered that a time-out of 12 seconds is better. Some sites are really slow ...

I also discovered that there are websites which show up in the browser. However when I try to fetch these websites, I get the result "None" and a HTTP error (code 403 and code 412). Very strange indeed.

According to the Hypertext Transfer Protocol these codes have the following meaning:

403 Forbidden
The request was a valid request, but the server is refusing to respond to it.

412 Precondition Failed
The server does not meet one of the preconditions that the requester put on the request.

I really don't understand why browsers correctly shows these websites and while ZOMDir is not able to fetch them correctly.

If you have a clue, please let me know.



Note: Recently I found a website with the status 300 Multiple choices. That one is also difficult to handle.

No comments:

Post a Comment