Patch release: fixes a crash on short inputs and closes a bunch of WHATWG/IANA alias gaps.
Bug Fixes
Fixed RuntimeError: pipeline must always return at least one result on ~2% of all possible two-byte inputs (e.g. b"\xf9\x92"). Multi-byte encodings like CP932 and Johab could score above the structural confidence threshold on very short inputs, but then statistical scoring would return nothing, leaving an empty result list instead of falling through to the fallback. (#367, #368, thanks @jasonwbarnett)
Improvements
Added ~90 encoding aliases from the WHATWG Encoding Standard and IANA Character Sets registry so that <meta charset> labels like x-cp1252, x-sjis, dos-874, csUTF8, and the cswindows* family all resolve correctly through the markup detection stage. Every alias was driven by a failing spec-compliance test, not speculative. (#366)
Added a spec-compliance test suite covering Python decode round-trips for all 86 registry encodings, WHATWG label resolution, IANA preferred MIME names, and Unicode/RFC conformance (BOM sniffing, UTF-8 boundary cases, UTF-16 surrogate pairs). This is the test suite that would have caught the 7.4.1 BOM bug before release. (#366)
This PR contains the following updates:
| Package | Update | Change |
|---|---|---|
| [chardet](https://github.com/chardet/chardet) ([changelog](https://chardet.readthedocs.io/en/latest/changelog.html)) | patch | `==7.4.1` → `==7.4.2` |
---
### Release Notes
<details>
<summary>chardet/chardet (chardet)</summary>
### [`v7.4.2`](https://github.com/chardet/chardet/releases/tag/7.4.2)
[Compare Source](https://github.com/chardet/chardet/compare/7.4.1...7.4.2)
Patch release: fixes a crash on short inputs and closes a bunch of WHATWG/IANA alias gaps.
#### Bug Fixes
- Fixed `RuntimeError: pipeline must always return at least one result` on \~2% of all possible two-byte inputs (e.g. `b"\xf9\x92"`). Multi-byte encodings like CP932 and Johab could score above the structural confidence threshold on very short inputs, but then statistical scoring would return nothing, leaving an empty result list instead of falling through to the fallback. ([#​367](https://github.com/chardet/chardet/issues/367), [#​368](https://github.com/chardet/chardet/issues/368), thanks [@​jasonwbarnett](https://github.com/jasonwbarnett))
#### Improvements
- Added \~90 encoding aliases from the WHATWG Encoding Standard and IANA Character Sets registry so that `<meta charset>` labels like `x-cp1252`, `x-sjis`, `dos-874`, `csUTF8`, and the `cswindows*` family all resolve correctly through the markup detection stage. Every alias was driven by a failing spec-compliance test, not speculative. ([#​366](https://github.com/chardet/chardet/issues/366))
- Added a spec-compliance test suite covering Python decode round-trips for all 86 registry encodings, WHATWG label resolution, IANA preferred MIME names, and Unicode/RFC conformance (BOM sniffing, UTF-8 boundary cases, UTF-16 surrogate pairs). This is the test suite that would have caught the 7.4.1 BOM bug before release. ([#​366](https://github.com/chardet/chardet/issues/366))
**Full Changelog**: <https://github.com/chardet/chardet/compare/7.4.1...7.4.2>
</details>
---
### Configuration
📅 **Schedule**: (in timezone America/Edmonton)
- Branch creation
- At any time (no schedule defined)
- Automerge
- At any time (no schedule defined)
🚦 **Automerge**: Disabled by config. Please merge this manually once you are satisfied.
♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
🔕 **Ignore**: Close this PR and you won't be reminded about this update again.
---
- [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check this box
---
This PR has been generated by [Renovate Bot](https://github.com/renovatebot/renovate).
<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiI0My4xMTEuMCIsInVwZGF0ZWRJblZlciI6IjQzLjExMS4wIiwidGFyZ2V0QnJhbmNoIjoibWFpbiIsImxhYmVscyI6W119-->
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
This PR contains the following updates:
==7.4.1→==7.4.2Release Notes
chardet/chardet (chardet)
v7.4.2Compare Source
Patch release: fixes a crash on short inputs and closes a bunch of WHATWG/IANA alias gaps.
Bug Fixes
RuntimeError: pipeline must always return at least one resulton ~2% of all possible two-byte inputs (e.g.b"\xf9\x92"). Multi-byte encodings like CP932 and Johab could score above the structural confidence threshold on very short inputs, but then statistical scoring would return nothing, leaving an empty result list instead of falling through to the fallback. (#367, #368, thanks @jasonwbarnett)Improvements
<meta charset>labels likex-cp1252,x-sjis,dos-874,csUTF8, and thecswindows*family all resolve correctly through the markup detection stage. Every alias was driven by a failing spec-compliance test, not speculative. (#366)Full Changelog: https://github.com/chardet/chardet/compare/7.4.1...7.4.2
Configuration
📅 Schedule: (in timezone America/Edmonton)
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
🔕 Ignore: Close this PR and you won't be reminded about this update again.
This PR has been generated by Renovate Bot.