CVE-2026-72818

NLTK TweetTokenizer URL Pattern Backtracks Catastrophically on Naked-Domain-Like Input

Published Aug 20, 2026 CVSS 4.0 · 8.7 High EPSS < 1% KEV · Not listed
Description
The URLS regular expression in nltk/tokenize/casual.py, compiled into TweetTokenizer.WORD_RE and applied by TweetTokenizer.tokenize, contains a naked-domain branch whose domain-label prefix [a-z0-9]+(?:[.\-][a-z0-9]+)* is unbounded. Input consisting of many alternating label separators can be partitioned in exponentially many ways, and because the branch also requires a trailing top-level domain that such input never supplies, the engine explores those partitions before failing at each offset. A few kilobytes of input therefore consumes seconds to minutes of single-threaded CPU, and the HANG_RE substitution performed before matching does not collapse the pattern. TweetTokenizer is intended for tokenizing untrusted social-media text, so any service that applies it, or the module-level casual_tokenize, to submitted text can be stalled per request without authentication. Version 3.10.1 bounds the label repetition.

Remediation

No solution or workaround provided in the CVE record

Tracking

Sign in to view the affected projects.

Advisories

Source ID Title
Github GHSA Github GHSA GHSA-qx2g-xrx7-vfh8 NLTK TweetTokenizer vulnerable to denial of service through catastrophic regex backtracking
History
Type Values Removed Values Added
Metrics ssvc

{'options': {'Automatable': 'yes', 'Exploitation': 'poc', 'Technical Impact': 'partial'}, 'version': '2.0.3'}

Type Values Removed Values Added
Description The URLS regular expression in nltk/tokenize/casual.py, compiled into TweetTokenizer.WORD_RE and applied by TweetTokenizer.tokenize, contains a naked-domain branch whose domain-label prefix [a-z0-9]+(?:[.\-][a-z0-9]+)* is unbounded. Input consisting of many alternating label separators can be partitioned in exponentially many ways, and because the branch also requires a trailing top-level domain that such input never supplies, the engine explores those partitions before failing at each offset. A few kilobytes of input therefore consumes seconds to minutes of single-threaded CPU, and the HANG_RE substitution performed before matching does not collapse the pattern. TweetTokenizer is intended for tokenizing untrusted social-media text, so any service that applies it, or the module-level casual_tokenize, to submitted text can be stalled per request without authentication. Version 3.10.1 bounds the label repetition.
Title NLTK TweetTokenizer URL Pattern Backtracks Catastrophically on Naked-Domain-Like Input
First Time appeared Nltk
Nltk nltk
Weaknesses CWE-1333
CPEs cpe:2.3:a:nltk:nltk:3.6.5:*:*:*:*:*:*:*
cpe:2.3:a:nltk:nltk:3.6.6:*:*:*:*:*:*:*
cpe:2.3:a:nltk:nltk:3.6.7:*:*:*:*:*:*:*
cpe:2.3:a:nltk:nltk:3.7:*:*:*:*:*:*:*
cpe:2.3:a:nltk:nltk:3.8.1:*:*:*:*:*:*:*
cpe:2.3:a:nltk:nltk:3.8:*:*:*:*:*:*:*
cpe:2.3:a:nltk:nltk:3.9.1:*:*:*:*:*:*:*
cpe:2.3:a:nltk:nltk:3.9.2:*:*:*:*:*:*:*
cpe:2.3:a:nltk:nltk:3.9.3:*:*:*:*:*:*:*
cpe:2.3:a:nltk:nltk:3.9:*:*:*:*:*:*:*
cpe:2.3:a:nltk:nltk:3.9:beta1:*:*:*:*:*:*
Vendors & Products Nltk
Nltk nltk
References
Metrics cvssV3_1

{'score': 7.5, 'vector': 'CVSS:3.1/AV:N/AC:L/PR:N/UI:N/S:U/C:N/I:N/A:H'}

cvssV4_0

{'score': 8.7, 'vector': 'CVSS:4.0/AV:N/AC:L/AT:N/PR:N/UI:N/VC:N/VI:N/VA:H/SC:N/SI:N/SA:N'}

Weaknesses

Sources

Status
PUBLISHED
Assigner
VulnCheck
Published
Updated
Sep 24, 2026, 2:18 PM
Reserved
Aug 10, 2026, 3:12 PM
Status
Awaiting Analysis
Published
Aug 20, 2026, 10:18 PM
Modified
Oct 26, 2026, 10:10 AM
Severity
Important
Public date
Aug 20, 2026, 9:57 PM