Technology intelligence
Back to AI
AIreport

Day 0 support for Reflection’s Beam on Google Cloud: 5x faster perf with llm-d and NVIDIA Dynamo

Publisher update

The brief

Google Cloud has published deployment recipes for Reflection's open-weight Beam model, using llm-d or NVIDIA Dynamo to serve multi-turn coding agents. The configurations route requests toward cached context and separate prompt processing from token generation. Google reports up to fivefold throughput and eightfold lower latency from customer benchmarks; those gains compare optimized and baseline setups on matching hardware, not independent tests or a comparison between the two platforms.

AI-assisted brief

Source Google Cloud

Read original source

More in AI

From Working Group to SIG Architecture: spotlight on AI Conformance

From the publisher

In this SIG Architecture spotlight we talked with Janet Kuo (Google) and Yuan Tang (TensorScale AI) about the journey of AI Conformance in Kubernetes, from the initial Working Group to the integration SIG Architecture as a subproject. Introductions Frederico Muñoz and Kirti Goyal (FK): Hi Janet, Yuan, and thank you for the opportunity to learn a bit more about AI Conformance. Can you tell us a bit about yourselves and how you got involved in Kubernetes? Janet Kuo: I'm a Senior Staff Software Engineer at Google and have been a Kubernetes maintainer since 2015, joining the community just as we were racing toward the 1.0 launch. I started my journey writing the core workload controllers that standardized how applications are orchestrated on Kubernetes. Today, I lead SIG Apps as a Co-chair & TL, and also lead the AI Conformance program.

Source KubernetesCC BY 4.0 · Publisher excerpt shortened and converted to plain text. Original source license applies.

Read original source

Agents, Workers - Cloudflare Computer now helps agents recover from interruptions and wait for approval

From the publisher

@cloudflare/computer ↗︎ gives your agent a workspace to run code in. From v0.7.0, that code can resume after a deploy or crash, and pause on an external action, for example to approve a tool call. Resume interrupted runs Set onInterrupt: "replay" on WorkerJavaScriptBackend, or on a single run.

Source Cloudflare DevelopersCC BY 4.0 · Publisher excerpt shortened and converted to plain text. Original source license applies.

Read original source

Agents, Workers AI, AI Gateway - createAI replaces workers-ai-provider and ai-gateway-provider

From the publisher

The Agents SDK has a new createAI function for the AI SDK and Pi AI. It unifies what workers-ai-provider and ai-gateway-provider did: Workers AI models, AI Gateway catalog models, dynamic routes, and vendor models, through the AI binding or an account id and API token. workers-ai-provider and ai-gateway-provider are now feature frozen and marked as deprecated. Please migrate at your convenience.

Source Cloudflare DevelopersCC BY 4.0 · Publisher excerpt shortened and converted to plain text. Original source license applies.

Read original source