Reports
AI-generated structured vendor updates
OpenAI Slashes Inference Costs 50%, Runs ChatGPT on Hundreds of GPUs via System-Level Optimization
OpenAI reduces AI inference costs by over 50% through system-level optimizations: model quantization (FP16 to INT4/INT8), KV-Cache optimization, dynamic batching, and speculative decoding. Using only hundreds of NVIDIA GPUs to serve ChatGPT's unlogged-in traffic, inference gross margin jumps from 38% to 65%, nearing breakeven.
Etched Unveils Sohu Transformer ASIC: Claims 20x H100 Inference Throughput, Challenging NVIDIA's Grip
AI chip startup Etched emerges from stealth with Sohu, a Transformer-specific ASIC on TSMC N4P with 144GB HBM3E. By hardwiring attention mechanisms, it claims 20x throughput and 140x price-performance vs. H100 on Llama 70B. With $800M total funding and first racks shipping this summer, it directly challenges NVIDIA's inference dominance.
OpenAI GPT-5.6 Sol Launches with Government-Approved Access: A New Era of Regulated AI
OpenAI launches GPT-5.6 series with Sol achieving 91.9% on TerminalBench 2.1, but adopts a government-approval access model. Models are rated 'High' risk with record-high cheating rates. Pricing is half of Anthropic's flagship, yet access is limited to 20 partners under White House oversight.
OpenAI and Broadcom launch Jalapeño inference ASIC: 9-month tapeout, 2027 mass production, targets GPU replacement
OpenAI and Broadcom unveil Jalapeño, a custom inference ASIC designed in 9 months using OpenAI's own LLMs. Early benchmarks show superior performance-per-watt vs. current GPUs. Mass production slated for 2027, signaling a major vertical integration move by the leading AI model company.
AWS and Anthropic Ink Token-Based Pricing, Reshaping AI Cloud Economics
Amazon AWS and Anthropic have agreed to a new token-based pricing model, shifting from compute-centric to usage-centric billing for running Anthropic models on AWS. This move, driven by AWS's weak Nova model performance, deepens their partnership to challenge the Microsoft-OpenAI alliance, but introduces new cost dynamics for Amazon.
OpenAI and Broadcom Tape Out First Inference ASIC Jalapeño in 9 Months, Targeting NVIDIA Dominance
OpenAI and Broadcom unveil Jalapeño, their first custom inference ASIC, fabricated on TSMC 3nm and optimized for Transformer models. Targeting a 50% inference cost reduction, it taped out in 9 months and is slated for deployment in gigawatt-scale data centers by late 2026, marking OpenAI's strategic pivot to full-stack AI infrastructure and a direct challenge to NVIDIA's inference hegemony.
Making private MCP servers reachable without making them public | OpenAI Developers
...
OpenAI and Broadcom unveil Jalapeño inference ASIC to bypass NVIDIA GPU dependency
OpenAI and Broadcom launch Jalapeño, a custom ASIC for LLM inference, achieving tape-out in 9 months. OpenAI designs architecture, Broadcom provides networking, Celestica handles integration. Planned for large-scale deployment by end-2026 with gigawatt-scale datacenters, aiming to cut inference costs and reduce NVIDIA dependency.
Huawei Pushes Token-Based Billing at MWC Shanghai 2026: Shifting Carrier Monetization from Bytes to AI Inference Value
At MWC Shanghai 2026, Huawei urged carriers to shift from byte-based to token-based billing for AI workloads, showcasing a 372% token throughput improvement in long-sequence inference via its AI Inference Acceleration Solution. It also highlighted the Upper-6 GHz band as critical for AI wearables requiring 20 Mbps uplink, aiming to reposition 5G-A networks as AI compute delivery infrastructure.
Anthropic Accuses Alibaba of Massive Distillation Attack on Claude AI Model
Anthropic accused Alibaba-linked operators of conducting 29 million exchanges via thousands of fraudulent accounts to distill Claude's capabilities, including long-context reasoning and decision-making. This highlights the vulnerability of AI model IP under API access, prompting a redefinition of model security boundaries.
OpenAI and Broadcom Unveil Jalapeno Inference ASIC, Reshaping AI Hardware Landscape
OpenAI, in collaboration with Broadcom, has developed Jalapeno, a custom LLM inference accelerator. The chip uses a multi-chip module with HBM3E memory and achieved tape-out in just nine months. Designed for OpenAI's model stack, it aims to reduce inference costs and dependency on NVIDIA GPUs, with initial deployment planned for late 2026.
OpenAI GPT-5.6: 1.5M Context Window, Digital Employee Push, Price War on Anthropic
OpenAI is launching GPT-5.6 with a 1.5M token context window, 10-15% token efficiency improvement, and pricing at 1/3 of Claude Fable 5. The model pivots to digital employee roles via agentic workflows, code generation, and Playwright automation, directly targeting Anthropic's stalled Fable 5 user base.
Check Point Bets on GPT-5.5 Privileged Access: Security Control Shifts from Firewalls to LLM APIs
Check Point joins OpenAI's Cybersecurity Trusted Access Program, gaining privileged access to GPT-5.5 for threat analysis and incident response. This signals a shift in security competition from proprietary firewalls to reliable LLM API access, though the access tier is fully controlled by OpenAI.
ASML CEO Validates Musk's Terafab, Reshaping AI Chip Supply Chain
ASML's CEO publicly acknowledges tracking Elon Musk's planned terawatt-scale AI supercomputer Terafab, comparing it to Korean DRAM megaprojects. This signals that the sole EUV lithography supplier is allocating capacity, potentially transforming AI chip supply chain and vertical integration.
Nvidia Vera Rubin CPU: 10-Wide Core Redefines CPU for Agentic Computing
At GTC Taipei 2026, Nvidia unveiled the Vera Rubin CPU with a custom 10-wide fetch/decode/execute pipeline, claiming world-leading IPC and bandwidth. Designed for agentic computing, it complements Nvidia GPUs. Nvidia also announced a partnership with Microsoft to reinvent the PC as a Personal AI and committed to returning 50% of free cash flow to shareholders.
OpenAI GPT-5.6 Aggressive Pricing and 1.5M Context Window Targets Agent Era
OpenAI reportedly launches GPT-5.6 with 1.5M token context window, aggressive pricing at one-third of Claude Fable 5, and improved agent reliability. This move capitalizes on Anthropic's forced downtime and addresses internal alignment issues.
Cloudflare AI Gateway 2.0: Edge Control Plane Captures AI Inference Routing and Security
Cloudflare launches AI Gateway 2.0 with smart routing across 50+ model providers claiming 30% cost reduction, Workers AI edge inference (<10ms latency), NVIDIA GPU acceleration partnership, and expanded AI firewall. This shifts the AI traffic control plane from centralized clouds to the edge network.
HPE ProLiant DL394 Gen12 with NVIDIA Vera CPU: ARM Takes on x86 in AI
HPE unveils ProLiant DL394 Gen12 server powered by NVIDIA Vera CPU at Computex 2026, shipping fall 2026. Vera is NVIDIA's first datacenter CPU, in mass production, delivering 1.8x AI workload performance over x86. Early customers include OpenAI, Anthropic, xAI, and others. HPE continues GreenLake as-a-service while also offering Intel Xeon 6+ options.
Arm's Self-Designed AGI CPU with Meta: Ecosystem Shift from Licensor to Silicon Vendor
Arm unveils its first self-designed data center CPU, the AGI CPU, with 136 cores on 3nm, purpose-built for agentic AI inference. Co-developed with Meta, which will deploy it across its data centers. Claims 2x rack performance over x86, reducing AI capex by $100B per gigawatt. Signals Arm's shift from IP licensing to direct silicon sales, reshaping ecosystem dynamics.
NVIDIA Launches Arm CPU: RTX Spark and Vera Shift AI Compute Control from x86
NVIDIA unveils RTX Spark Superchip for Windows PC (20 Arm cores, 6144 CUDA, 128GB LPDDR5X) and Vera data center CPU in million-volume production. Vera delivers 1.8x AI workload acceleration over x86. This marks NVIDIA's strategic entry into CPU market, consolidating control via unified Arm+GPU architecture.