跳到正文
NVIDIA 官方博客· Hannah Coutand·· 4 小时前精选AI 评分60

NVIDIA 发布 Vera CPU,主打智能体吞吐与能效

Vera Delivers the Best of Both Worlds: Highest Throughput and Fastest Agents

AI 导读

NVIDIA 发布面向 AI 智能体负载的 Vera CPU,称在 100 兆瓦数据中心对比中,单颗 Vera 同时优于最快的 x86 CPU 和最节能的 x86 CPU。

推荐理由

原文给出 Vera 与两类 x86 CPU 的对比数据及多家早期采用者的生产测试结果,可据此判断智能体负载的能效取舍。

正文 · 原文

AI agents do more than generate answers. They search for information, query databases, write and test code and take action. 

Each of those steps relies on a CPU, with agents moving between GPU reasoning and CPU execution throughout a task. 

As businesses put more agents to work, AI factories need CPUs that can execute those steps quickly and support many agents at once, all within the limits of available power.

What this means: AI infrastructure providers need to support more agents without making each one wait longer to get work done. And critically, AI factories are power limited. This means operators need to choose infrastructure that maximizes the work done for every watt. 

Why it matters: NVIDIA Vera delivers both fast agent performance and high capacity per watt within a single CPU. That gives providers one CPU for a range of agent workloads, rather than having to mix and match fast and dense x86 parts to balance speed and capacity.

The data that proves it: In a 100-megawatt data center comparison, NVIDIA found that a single Vera CPU performs better than the fastest x86 CPU and the most energy-efficient x86 CPU.

  • Vera delivers industry-leading agent speed while enabling 1.6x more agents per watt versus the fastest x86 CPU.
  • Vera delivers 2x faster agent speed with leading energy efficiency compared with the most energy-efficient x86 CPU.

Partners are already putting Vera to work. Early adopters see the same exceptional performance in production-style tests:

  • Perplexity: Ran agentic coding tasks 1.5x faster with Vera than on traditional CPUs. Perplexity plans to deploy Vera in an upcoming production system.
  • DeepInfra: Delivered up to 2.2x speed of the best x86 processor on agentic orchestration for its production agent workload, achieving the fastest of the four architectures tested.
  • ClickHouse: Its standard binary, with no Vera-specific tuning, scaled near-linearly across 176 cores and topped the ClickBench hardware leaderboard.
  • DuckLabs: Achieved about 1.5x the median TPC-H SF1000 performance of an Intel Xeon 6 baseline.
  • Daytona: Brought 1,000 agent sandboxes online in 10.8 seconds, and achieved 12.7 completed jobs per second at 2,000 concurrent sandboxes, using Vera versus 88.4 seconds with x86.
  • Modal: Achieved up to 2x sandbox throughput per core versus comparable x86 hardware, with gains that grow under heavy load.

Learn more about the NVIDIA Vera CPU.

来源:NVIDIA 官方博客 · blogs.nvidia.com