Nvidia-backed mini-data centers at homes: A power grid solution or just a concept?

Nvidia has endorsed an innovative effort to place compact data centers next to residential homes, disguised as HVAC units. This strategy addresses a critical challenge in expanding data center capacity—not the availability of funds or chips, but the need to upgrade the electrical grid to meet rising power demands.

The concept, introduced by Span, a California-based smart utility box company, proposes utilizing the excess electricity allocated to households. According to Span, the average home uses only about 42% of its allotted electricity and rarely reaches peak consumption. Span’s smart utility boxes identify this unused capacity and redirect it to GPUs housed within a "node" installed beside the home. These nodes resemble HVAC units and contain:

• 16 Nvidia GPUs
• 4 AMD CPUs
• 4 terabytes of memory
• A dedicated cooling system

When deployed at scale, these nodes could form a network to handle distributed computing tasks. In return for hosting a node, Span covers a significant portion of the homeowner’s electricity and broadband bills. Additionally, Span suggests that placing compute power closer to end users could enhance performance for AI services like chatbots.

While the idea is promising on paper, it remains largely untested in real-world conditions. Span has developed prototypes but has not yet installed any units at actual homes.

CNBC asked Chris Lander, Vice President of Span, whether the company has conducted technical studies to validate the system’s ability to handle real AI workloads efficiently. Lander responded,

"We’ve done a bunch of technical studies internally [and] a bunch of modeling for different kinds of workloads, both from the business point of view [and] the product point of view and from the technical architecture point of view."

Span is collaborating with Pulte Homes, an Atlanta-based homebuilder, to integrate these nodes into new residential developments. However, Pulte Homes confirmed to CNBC that only one Span unit has been installed next to a home thus far.

Lander noted,

"I will say that we’ve been collaborating with Pulte amongst others to test the latest proof of concept design, the latest prototype that we have."

Span plans to deploy upwards of 100 nodes of an advanced prototype in a pilot project "later this year," though specific locations and timelines remain undisclosed.

A major concern surrounding new data centers—whether centralized or distributed—is the potential for increased electricity costs in the surrounding area. Higher power demand could strain transformers and other infrastructure, leading to faster degradation and elevated bills. However, Lander disputes this concern, stating that Span’s approach will not contribute to these issues.