Enterprise‑Ready Agentic Inference Gets New Reliability Features in PyTorch and vLLM
Curious about how to make enterprise agentic inference production-ready with PyTorch and vllm_project & to learn more about the PyTorch Landscape?
No matches.
↑↓ navigate↵ openesc close
Curious about how to make enterprise agentic inference production-ready with PyTorch and vllm_project & to learn more about the PyTorch Landscape?
Biologists use specialized open-source models for tasks like modeling the structure of molecular systems, designing drug-like molecules, and predicting the effects of genetic mutations.
NVFP4 KV in SGLang packs ~1.78× more context into GPU memory and speeds up long-context decode by up to 78%.
🚀 New blog: Cosmos3 in RLinf: 3.33× End-to-End Evaluation Throughput with SGLang RLinf is an open-source framework designed for embodied intelligence & AI agents.
We’ve shared details on how AI agents in our research environment sent training and evaluation data to third-party services when they shouldn’t have.
After the Hugging Face incident, we committed to conducting a much broader review of actions taken by our models during training and evaluation and to being transparent about our findings.
We’re demonstrating how frontier models have continued to improve in realistic mental health conversations with MentalHealthBench.
Moving AI from pilot to production shouldn't mean replacing your infrastructure.
OpenWorker -- an open source agent that doesn't just chat but completes tasks on your laptop -- just released a new version with many features for security workflows.
Enterprise AI must continuously serve inference, orchestrate agents and connect with enterprise data and applications.