CVE-2024-8939

Vllm: denials of service in vllm json web api

Published Sep 17, 2024 CVSS 3.1 · 6.2 Medium EPSS < 1% KEV · Not listed
Description
A vulnerability was found in the ilab model serve component, where improper handling of the best_of parameter in the vllm JSON web API can lead to a Denial of Service (DoS). The API used for LLM-based sentence or chat completion accepts a best_of parameter to return the best completion from several options. When this parameter is set to a large value, the API does not handle timeouts or resource exhaustion properly, allowing an attacker to cause a DoS by consuming excessive system resources. This leads to the API becoming unresponsive, preventing legitimate users from accessing the service.

Remediation

Vendor Workaround

Mitigation for this issue is either not available or the currently available options do not meet the Red Hat Product Security criteria comprising ease of use and deployment, applicability to widespread installation base or stability.

Tracking

Sign in to view the affected projects.

Advisories

Source ID Title
EUVD EUVD EUVD-2024-2887 A vulnerability was found in the ilab model serve component, where improper handling of the best_of parameter in the vllm JSON web API can lead to a Denial of Service (DoS). The API used for LLM-based sentence or chat completion accepts a best_of parameter to return the best completion from several options. When this parameter is set to a large value, the API does not handle timeouts or resource exhaustion properly, allowing an attacker to cause a DoS by consuming excessive system resources. This leads to the API becoming unresponsive, preventing legitimate users from accessing the service.
Github GHSA Github GHSA GHSA-wc36-9694-f9rf vLLM Denial of Service via the best_of parameter
History
Type Values Removed Values Added
Metrics epss

{'score': 0.00015}

epss

{'score': 0.00016}

Type Values Removed Values Added
Metrics ssvc

{'options': {'Automatable': 'no', 'Exploitation': 'none', 'Technical Impact': 'partial'}, 'version': '2.0.3'}

Type Values Removed Values Added
Description No description is available for this CVE. A vulnerability was found in the ilab model serve component, where improper handling of the best_of parameter in the vllm JSON web API can lead to a Denial of Service (DoS). The API used for LLM-based sentence or chat completion accepts a best_of parameter to return the best completion from several options. When this parameter is set to a large value, the API does not handle timeouts or resource exhaustion properly, allowing an attacker to cause a DoS by consuming excessive system resources. This leads to the API becoming unresponsive, preventing legitimate users from accessing the service.
Title vllm: Denials of Service in vllm JSON web API Vllm: denials of service in vllm json web api
First Time appeared Redhat
Redhat enterprise Linux Ai
CPEs cpe:/a:redhat:enterprise_linux_ai:1
Vendors & Products Redhat
Redhat enterprise Linux Ai
References
Type Values Removed Values Added
Description No description is available for this CVE.
Title vllm: Denials of Service in vllm JSON web API
Weaknesses CWE-400
References
Metrics threat_severity

None

cvssV3_1

{'score': 6.2, 'vector': 'CVSS:3.1/AV:L/AC:L/PR:N/UI:N/S:U/C:N/I:N/A:H'}

threat_severity

Moderate

Weaknesses

Sources

Status
PUBLISHED
Assigner
redhat
Published
Updated
Nov 20, 2025, 8:57 PM
Reserved
Sep 17, 2024, 8:06 AM
Status
Deferred
Published
Sep 17, 2024, 5:15 PM
Modified
Jun 17, 2026, 8:23 AM
Severity
Moderate
Public date
Sep 17, 2024, 12:00 AM