Xelera Silva provides best-in-class throughput and latency for XGBoost, LightGBM and CatBoost inference.
22M inferences/s XGBoost inference throughput.
Microseconds query latency without jitter.
Bring your own model.
Concurrent execution of multiple XGBoost / LightGBM models.
Machine learning based on gradient boosting frameworks such as XGBoost and LightGBM is increasingly used in many application domains, such as algorithmic trading systems, recommender systems, bioscience, or ransomware and DDoS detection systems.
Xelera Silva overcomes the latency drawback or throughput limitations of machine learning algorithms: It enables users to take advantage of in-loop machine learning inference with ultra-low latency or to eliminate throughput bottlenecks. Xelera Silva is available in a latency- and throughput-optimized accelerator mode.
Benchmark:
Test setup:
High Frequency Traders use decision algorithms to automate trading instructions. The automated decisions are increasingly made by XGBoost and LightGBM models. A low latency is key for these systems. Silva overcomes the latency disadvantage of machine learning algorithms: Inference of XGBoost and LightGBM models is performed with a latency of a few microseconds. This enables customer to make better decisions and win speed races.
The turn-key accelerator connects to the software-based trading system and offloads the XGBoost/ LightGBM inference to a PCIe-attached AMD Alveo accelerator card (PCIe transfer included in round-trip latency).
The network is the first instance that must be protected to secure the enterprise IT system. Firewalls using Gradient Boosting Decision Trees perform inspection of the network flow data to detect suspicious patterns (e.g., a DDOS attack). Silva provides the necessary inference speed to ensure that the computationally intensive classification of network flows can be performed at the required bandwidth to avoid slowing down the network system.
Xelera Silva connects to the data analytics pipeline of a real-time database or instrument. The accelerator performs XGBoost inference on a 3.9 TB data set in a 10-minutes window.
Sign-Up for our quarterly newsletter to get insights on Xelera Silva!
If you have any questions, our Team will be happy to help you out. Take advantage of our expertise and get in touch with us now!