|
Thanks Sven.
> But both curl and browsers seem to keep on loading the page. So I would translate your issue as a request to be optionally more lenient when UTF-8 decoding. Agreed ?
> The question though is what to do in case of error ? The most flexible would probably be to allow the user to specify the custom behaviour.
Right. I should also have mentioned my use case which should be helpful. I'm trying to scrape the web page using Soup which uses Zinc. So having a way to make it more forgiving (be it a flag or some other way to specify custom behaviour) would be great. In most cases web servers should be expected to be configured correctly, but unfortunately when web scraping, we clients have to make do.
|
|
|
Priority: 4 – Would be nice
|
|
Status: Work Needed
|
|
Assigned to: Everyone
|
|
Milestone: Later
|
Go to Case
|
|