Categories
Artificial Intelligence Hardware What I’m Up To

Specs for NVIDIA’s GB10 chip, which powers HP’s ZGX Nano G1n AI workstation

I’m currently working with Kforce as a developer relations consultant for HP’s new tiny desktop AI powerhouse, the ZGX Nano (also known as the ZGX Nano G1n). If you’ve wondered about the chip powering this machine, this article’s for you!

The chip powering the ZGX Nano is NVIDIA’s GB10, a combination CPU and GPU where “GB” stands for “Grace Blackwell.” The chip’s two names stand for each of its parts…

Grace: The CPU

The part named “Grace” is an ARM CPU with 20 cores, arranged in ARM’s big.LITTLE (DynamIQ) architecture, which is a mix of different kinds of cores for a balance of performance and efficiency:

    • 10 Cortex-X925 cores. These are the “performance” cores, which are also sometimes called the “big cores.” They’re designed for maximum single-thread speed, higher clock frequencies, and aggressive out-of-order execution, their job is to handle bursty, compute-intensive workloads such as gaming and rendering, and on the ZGX Nano, they’ll be used for AI inference.
    • 10 Cortex-A725 cores. These are the “efficiency” cores, which are sometimes called the “little cores.” They’re designed for sustained performance per watt, running at lower power and lower clock frequencies. Their job is to handle background tasks, low-intensity threads, or workloads where power efficiency and temperature control matter more than peak speed.

Blackwell: The GPU

The part named “Blackwell’ is NVIDIA’s GPU, which has the following components:

    • 6144 neural shading units, which act as SIMD (single-instruction, multiple data) processors that act as “generalists,” switching between standard graphics math and AI-style operations. They’re useful for AI models where the workloads aren’t uniform, or with irregular matrix operations that don’t map neatly into 16-by-16 blocks.
    • 384 tensor cores, which are specialized matrix-multiply-accumulate (MMA) units. They perform the most common operation in deep learning, C = A × B + C, across thousands of small matrix tiles in parallel. They do so using mixed-precision arithmetic, where there are different precisions for inputs, products, and accumulations.
    • 384 texture mapping units (TMUs). These can quickly sample data from memory and do quick processing on that data. In graphics, these capabilities are use to resize, rotate, and transform bitmap images, and then paint them onto 3D objects. When used for AI, these capabilities are used to perform bilinear interpolation (used by convolutional neural network layers and transformers) and sample AI data.
    • 48 render output units (ROPs). In a GPU, the ROPs are the final stage in the graphics pipeline — they convert computed fragments into final pixels stored in VRAM. When used for AI, ROPs provide a way to quickly write the processing results to memory and perform fast calculations of weighted sums (which is an operation that happens with all sorts of machine learning).

128 GB of unified RAM

There’s 128GB of LPDDR5X-9400 RAM built into the chip, a mobile-class DRAM type designed for high bandwidth and energy efficiency:

  • The “9400” in the name refers to its memory bandwidth (the speed at which the CPU/GPU can move data between memory and on-chip compute units) of 9.4 Gb/s per pin. Across a 256-bit bus, this provides almost 300 GB/s peak bandwidth

  • LPDDR5X is more power-efficient than HBM but slower; it’s ideal for compact AI systems or edge devices (like the ZGX Nano!) rather than full datacenter GPUs.

As unified memory, the RAM is shared by both the Grace (CPU) and Blackwell (GPU) portions of the chip. That’s enough memory for:

  • Running large-language-model inference up to 200 billion parameters with 4-bit weights

  • Medium-scale training or fine-tuning tasks

  • Data-intensive edge analytics, vision, or robotics AI

Because the memory is unified, it means that the CPU and GPU share a single physical pool of RAM, which eliminates explicit data copies.

The RAM is linked to the CPU and GPU sections using NVIDIA’s C2C (chip-to-chip) NVLINK , their low-power interconnector that lets CPU/GPU memory traffic move at up to 600 GB/s aggregate. That’s faster than PCIe 5! This improves latency and bandwidth for workloads that constantly exchange data between CPU preprocessing and GPU inference/training kernels.

Double the power with ConnectX

If the power of a single ZGX Nano wasn’t enough, there’s NVIDIA’s ConnectX technology, which is based on a NIC that provides a pair of 200 GbE ports, enabling the chaining/scaling out of workload across  two GB10-based units. The doubles the processing power, allowing you to run models with up to 400 billion parameters!

The GB10-powered ZGX Nano is a pretty impressive beast, and I look forward to getting my hands on it!

 

Categories
Artificial Intelligence Hardware

HP’s ZGX Nano G1n AI workstation: A sneak peek!

I’ll be talking about HP’s upcoming ZGX Nano G1n AI workstation soon, but in the meantime, here’s HP’s Brian Allen providing a sneak preview of the ZGX Nano at last week’s HP event in New York.

Categories
Hardware What I’m Up To

The room where it happens

Joey de Villa’s home office. It has a shiny hardwood floor, two desks in an L-shaped configuration, monitors, keyboards, synthesizers, and other gear. A large octopus art piece looms over the back wall.
Tap to view at full size.

For the curious, here’s a recent pic of my home office, a.k.a. “The Fortress of Amplitude.” The gear configuration changes every now and then, but it generally looks like this. It’s where the magic happens!

Categories
Artificial Intelligence Hardware What I’m Up To

Quick announcement: I’m doing developer relations for HP’s new ZGX Nano AI computer!

Just so you know: today’s my first day at Kforce doing developer relations for HP! More specifically, for HP’s ZGX Nano, a tiny computer designed specifically for running large AI models right on your desktop…and not on someone else’s computers!

The ZGX Nano packs a ridiculous amount of power into a tiny space…

Powered by NVIDIA’s GB10 GPU and a 20-core ARM CPU sharing 128GB of RAM, the ZGX Nano performs at 1,000 teraflops (1 petaflop), which is 1015 floating-point operations per second. It’ll support an AI model taking in 200 billion parameters — 400 billion if you connect two ZGX Nanos together.

I’m getting set up for day one on the job as I write this, so I’m keeping this post short and ending with this gem from a little while back: HP’s Rules of the Garage:

Categories
Hardware What I’m Up To

My travel setup

I’m away from home over the next several days, which means I’m currently using my travel workstation setup!

It includes:

  • My MacBook Pro (refurbed 2021 model, M1 with 32GB RAM; if it’s good enough from Tampa Bay’s most notorious Python programmer, it’s probably good enough for you)
  • Not one, but two portable monitors (one I bought, one’s a freebie from an old workplace)
  • Small Bluetooth keyboard (Logitech K380, still the best travel keyboard) and mouse (Logitech M325S; nice and small, but not too small)
  • External webcam (Logitech Brio) and microphone (Blue Yeti; a Christmas present from Anitra from years back that still works like a charm)
  • Donner M-25 MIDI keyboard and good ol’ GarageBand for Mac (I’m working on some videos)
  • Sony MDR-V500 headphones that my deadbeat ex-housemate left behind back in 2001, and which I use only when traveling

I’ve also using books I left here as laptop and monitor stands:

For the smaller monitor, Volume I of 101 Windows Phone 7 Apps from my time as a Microsoft developer evangelist and Windows Phone community champ.

For the bigger monitor, the old “Holy Trinity” from the Apple Technical Library from back in 1992: Inside Macintosh Overview, Macintosh Toolbox Essentials, and More Macintosh Toolbox, which were essential reading if you wanted to write applications for the Mac during the days of System 7.

And for the MacBook, I’m propping them up with the Software Engineering Classics box with Debugging the Development Process, Dynamics of Software Development, and Software Project Survival Guide, topped off with a copy of the original Dive Into Python autographed by the author, Mark Pilgrim, as a thank you for the review I wrote in Slashdot all those years ago.

Categories
Hardware What I’m Up To

The stickers on my Windows laptop

Joey de Villa’s 2020 Acer Nitro 5 laptop, which is covered with stickers.After seeing my previous post about laptop stickers, a couple of people noted that they thought I was a Windows guy. I’m more of an “anything programmable” guy, and I do have a Windows machine that I use regularly (in fact, there’s an interesting story behind how I bought it).

Pictured above are the stickers on my Windows laptop.

Categories
Hardware What I’m Up To

The stickers on my 2014 MacBook Pro

Joey de Villa’s 2014 MacBook Pro, which has a grey case and is covered with stickers.I’m helping out at a Tampa Bay Python workshop for people who are new to Python programming as I write this. It often helps to bring a spare laptop to events like this, so I brought my 2014 MacBook Pro.

Even after all this time, it’s still useful as a spare computer for workshops. It’s also a handy computer for travel; if it gets stolen or damaged, it’s no great loss.