CVE-2024-8939
Vllm: denials of service in vllm json web api
We use these services and cookies to improve your user experience. You may opt out if you wish, however, this may limit some features on this site.
Please see our statement on Data Privacy.
Vllm: denials of service in vllm json web api
A vulnerability was found in the ilab model serve component, where improper handling of the best_of parameter in the vllm JSON web API can lead to a Denial of Service (DoS). The API used for LLM-based sentence or chat completion accepts a best_of parameter to return the best completion from several options. When this parameter is set to a large value, the API does not handle timeouts or resource exhaustion properly, allowing an attacker to cause a DoS by consuming excessive system resources. This leads to the API becoming unresponsive, preventing legitimate users from accessing the service.
Reserved 2024-09-17 | Published 2024-09-17 | Updated 2024-11-25 | Assigner redhatUncontrolled Resource Consumption
| 2024-09-17: | Reported to Red Hat. |
| 2024-09-17: | Made public. |
Red Hat would like to thank Thibault Guittet for reporting this issue.
access.redhat.com/security/cve/CVE-2024-8939
bugzilla.redhat.com/show_bug.cgi?id=2312782 (RHBZ#2312782)
Support options
