Hardware FixRecommendedDevice not working? Your driver may be the problemCheck updates for common hardware issues.Fix DriversOctober DealsAmazon USOctober deal check: compare before you payAmazon US: current deals, useful picks and tech finds.Check DealsWindows FixRecommendedWindows errors stealing your time? Find the fix fastScan stability, cleanup and performance issues.Fix Now×
Skip to content
The Finance Base
The Money Desk · Blog
Re:

Tesla Dojo at Hot Chips 34: Inside the Custom AI Supercomputer

Tesla’s Hot Chips 34 presentation described a custom training system built from D1 dies, modular tiles, TTP networking and host-side data-ingestion resources. Its figures were design disclosures, not independent benchmarks.
From TheFinanceBase Team6 min to read
Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

At Hot Chips 34 in August 2022, Tesla outlined Dojo as a custom, highly scalable machine-learning training system built for workloads such as video-heavy autonomy training. Its design combined D1 compute dies, modular training tiles, a proprietary interconnect and host-side data-ingestion resources. Those disclosures describe an architecture and scaling plan—not proof that Tesla had already deployed every projected configuration or independently benchmarked it against commercial GPU clusters.

What Tesla presented at Hot Chips 34

HC34 means Hot Chips 34, the 2022 semiconductor and computer-architecture conference. Tesla’s program included sessions on Dojo’s microarchitecture and system scaling, as well as a keynote on system integration. The conference program lists the sessions and speakers: Hot Chips 34 program.

Tesla described Dojo as an in-house supercomputer for machine-learning training, designed to scale and adapt to different algorithms while focusing on Tesla’s own requirements. The microarchitecture presentation is available in Tesla’s HC34 slides. Dojo was not presented as a retail accelerator or general-purpose cloud service.

Why build a system around training video models?

Tesla’s stated use case centered on neural networks for autonomy. Training systems must do more than perform matrix operations: they also need to ingest and process training data, move it to compute units, synchronize work across those units and keep the system supplied with memory bandwidth. For video-heavy workloads, the data pipeline can be a significant part of the design problem.

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
#1 Best Overall
WildWell Full Body Kit Compatible with 2017-2023 Tesla Model 3
  • Perfect Fitment Specifically designed for the 2017-2023 model 3, (*Won't Fit Highland Model*) ensuring that all components perfectly match your vehicle. We recommend professional installation to achieve the best results.
  • Optimized Aerodynamic Performance: The kit is designed with airflow optimization in mind, significantly improving the aerodynamic performance of the Tesla Model 3. The front lip and rear diffuser effectively reduce air resistance, enhancing vehicle stability, especially at high speeds.
  • High-Quality Materials: Each component is crafted from premium ABS plastic or composite materials, offering exceptional durability and impact resistance. These materials can withstand everyday wear, scratches, and harsh weather conditions, ensuring long-lasting appearance and performance over time.
  • Enhanced Sporty and Aggressive Appearance: The design of this kit not only focuses on performance but also aims to give your Tesla Model 3 a more sporty and aggressive look. The sharper, more dynamic lines of the front lip, rear diffuser, and side skirts make the vehicle’s profile more pronounced, adding a unique sporty flair and giving the car an instant aggressive stance with a strong visual impact.
  • Complete Kit Includes All Necessary Parts: This kit includes five essential components: Rear Diffuser, Rear Spoiler, Front Lip, Fog Light Trims, and Side Skirt. The kit also comes with installation screws, 3M adhesive tape, and adhesion promoter to ensure all components are securely mounted for a perfect modification result.

Tesla’s argument was therefore a system-level one. It designed compute, memory, networking, host interfaces, packaging, power and cooling around its intended workloads rather than treating Dojo as simply a collection of accelerator chips. Tesla’s public overview of its AI work is at Tesla AI and Robotics.

How Dojo’s architecture was organized

From compute die to system

Tesla presented a hierarchy of CPU → die → module → board → rack → cabinet → system. In general, communication tends to become slower and more constrained as it crosses farther-out levels of a system. Dojo’s design sought to keep important communication close to its compute fabric while still allowing the system to expand.

It is important to distinguish three levels. A D1 die was a custom compute chip; a training tile combined multiple D1 dies into a module; and the Dojo system encompassed many tiles plus interface processors, hosts, networking, memory, storage, software, power and cooling. The design drew on system-on-wafer ideas, but describing the deployed architecture simply as “a wafer” obscures its modular organization.

Rank #2
WWZMDiB Mini DIY Tesla Coil Kit Practice Soldering Project Electronic Kit for Adults which can Sing, wirelessly Transmit Electricity, Light Fluorescent Lamps, and Have Wonderful arcs.
  • 💎【Magical Tesla Coil】:The magical Tesla coil generates high temperature and high pressure plasma, which can sing, wirelessly transmit electricity, light fluorescent lamps, and have wonderful arcs.
  • ⚡【Supply voltage】:DC 15-24v, current 2A, DC5.5 interface/pin header
  • 🎵【Audio input】: 3.5 Jack, can connect mobile phone, mp3, computer audio
  • 🥇【Tesla's arc generation function】: After the power is turned on, the wire at the tail will generate an arc, which is beautiful.
  • 🥈【Tesla lighting function in space】: After the Tesla coil is powered on, it can light up fluorescent lamps in space!

The 25-die training tile

Tesla’s later Hot Chips material describes a training tile made from a 5×5 array of 25 D1 chips. The tile integrated power delivery, cooling and mechanical and electrical connections, and was intended to link directly with neighboring tiles. Tesla’s presentation listed 15 kW for tile power delivery; that is a tile figure, not the power consumption of an entire Dojo system. See the Tesla TTPoE presentation.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

How tiles communicated: TTP and Ethernet

Tesla’s proprietary Tesla Transport Protocol (TTP) was designed for communication across the high-performance Dojo fabric. Tesla’s presentation listed approximately 4.5 TB/s of off-tile bandwidth per edge. These are company-disclosed design figures, not independent measurements of end-to-end model-training performance.

Custom protocol did not mean Ethernet was absent. Tesla also described TTP over Ethernet (TTPoE), using Ethernet infrastructure to extend the fabric. In its 2024 presentation, Tesla characterized TTPoE as a lossy, exascale fabric intended to reduce complexity and software overhead associated with traditional lossless fabrics. The practical idea was to combine specialized communication inside the system with Ethernet-based scale-out.

Rank #3
ISolderStore DIY Mini Tesla Coil Kit 15W Electronic DIY Kits Mini Music Tesla Coil Plasma Speaker Soldering Practice Kit DIY Soldering Project for Soldering Skill Practice
  • 1. Learn & Create High-Voltage Magic – Assemble your own mini Tesla coil to produce impressive 1-2 inch arcs and wireless lighting effects. A fun STEM project that demonstrates real electrical resonance.
  • 2. Ideal Beginner Soldering Kit – Clear PCB labels, well-spaced through-hole components, and detailed English instructions. Perfect for students, hobbyists, or anyone wanting to practice DC soldering skills.
  • 3. Plug & Play Arc Display – Once assembled, powered by 18V 2A DC adapter to generate visible high-frequency sparks, corona discharge, and even light up fluorescent tubes without contact.
  • 4. Safe Low-Voltage Input – Despite the high-voltage output, the kit runs on standard low-voltage DC input (18V recommended). Designed with basic safety features for educational environments.
  • 5. Great Gift for Future Engineers – Comes with all electronic parts (PCB, transistors, resistors, coils). Nothing else needed except basic tools and a power source. Ideal for birthdays, science fairs, or electronics class projects.

What the Dojo Interface Processor did

The Dojo Interface Processor was a custom PCIe card connecting host systems to training tiles. Tesla’s later presentation listed 32 GB of high-bandwidth memory, approximately 800 GB/s of memory bandwidth, a 900 GB/s TTP interface and a 32 GB/s PCIe Gen4 interface. These are Tesla’s presentation specifications, not independent benchmark results.

ServeTheHome reported that a first-generation host could use up to five interface cards, for up to 4.5 TB/s of aggregate bandwidth to training tiles. The interface processor helped separate the compute fabric from host-side work, including data loading and video ingestion. That separation matters because a training workload can be constrained by getting data ready and delivered, not only by the accelerator’s arithmetic capacity. See ServeTheHome’s HC34 report.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Scaling beyond a tile—and feeding the compute

ServeTheHome reported that Tesla presented an exascale design capable of scaling to approximately 3,000 accelerators and planned “Exapod” units containing 120 tiles. These were presented plans, not evidence that Tesla operated a full 3,000-accelerator configuration at HC34. The proposed system was also disaggregated: compute, memory and input/output resources could be expanded separately.

Rank #4
1/35 BC-005 Tesla Tank GlueFree Gun Turret Movable w/Tesla lamp Assembly Plastics Model kit
  • English Instructions included
  • Glue and paint not included
  • Ready-to-assemble plastic model kit
  • Photo-etched parts included

Tesla’s TTPoE material described “Mojo” hosts for variable input ingestion, separation of forward-pass data ingestion from backward-pass all-reduce traffic, and the ability to add processing capacity for video or data loading independently. The intent was to present a more uniform system view across compute and communication while allowing data-pipeline resources to scale with need. These details help explain why Dojo was more than a custom chip or a tile-to-tile bandwidth figure: its pitch depended on coordinating data movement and computation.

How the HC34 concept differed from a conventional GPU cluster

Area Conventional GPU cluster HC34 Dojo concept
Compute Commercial GPUs with host CPUs Tesla-designed D1 compute dies
Packaging GPU servers connected through a network fabric Modular training tiles with integrated power and cooling
Interconnect Often Ethernet, InfiniBand or vendor-specific links TTP for the specialized fabric, with TTPoE for Ethernet-based extension
Scaling unit Commonly a server, GPU node or rack Tiles, interface processors and hosts, assembled into larger systems
Workload emphasis Broad AI and HPC workloads Video-heavy Tesla autonomy training, with flexibility claimed for other algorithms
Memory approach GPU memory plus host and system memory Emphasis on on-chip SRAM alongside HBM on interface processors
Availability Commercial systems and cloud instances are available from vendors No evidence that Dojo was sold as a standalone commercial system

The comparison describes design approaches, not a performance ranking. High theoretical bandwidth does not establish higher training throughput, and HC34 did not provide an apples-to-apples independent benchmark proving that Dojo was faster, cheaper or more efficient than NVIDIA-based systems.

Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

What the disclosed numbers do—and do not—show

Terms such as “exascale” need context. An aggregate operation-rate figure depends on precision and workload assumptions; it does not automatically mean a system achieved a particular general-purpose supercomputer ranking. Tesla’s later TTPoE presentation also described a 4× exaflop BF16/FP16 engineering system. That later engineering-system figure should not be read as proof of production performance or confused with the HC34 scaling plan.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Best Value
Revell 85-5810 SR-71 Blackbird 1:72 Scale 66-Piece Skill Level 4 Model Airplane Building Kit
  • Revell Model Kit #85-5810, Skill Level 4, Contains 66-Parts, Recommended for ages 12 and up
  • Accurate surface details
  • Includes GTD-21 surveillance drone with cart
  • Decals with authentic U.S. Air Force markings
  • Molded in black and clear. Paint and glue required(not included).
  • A D1 die, a 25-die training tile and a full system are different units; a figure for one cannot be applied to another.
  • Bandwidth specifications describe potential data movement, not measured end-to-end model-training speed.
  • The public HC34 material establishes what Tesla presented, but does not by itself verify that every planned configuration reached production.
  • Dojo was primarily framed as a training system. It should not be conflated with Tesla’s automotive inference chips or later AI5 and AI6 discussions.

What happened to Dojo after HC34?

The original HC34 architecture and the later Dojo 3 effort are not interchangeable. Bloomberg reported in August 2025 that Tesla disbanded the Dojo team. In January 2026, Bloomberg reported that Elon Musk said work on Dojo 3 would restart after progress on AI5: Bloomberg’s August 2025 report and Bloomberg’s January 2026 report.

Tesla’s Q1 2026 investor materials said Cortex 2 was online and running training workloads while the company continued custom-silicon development with Dojo 3 to reduce training costs. The filing places Dojo within a broader compute strategy; it does not establish that the 2022 D1-based design remained Tesla’s sole or dominant training platform. See Tesla’s Q1 2026 investor update filed with the SEC.

Why Dojo’s engineering ambition carried risks

Custom silicon can be attractive when a company has a distinctive workload and enough scale to justify tailoring hardware to it. But a custom system also requires coordinated investment in chips, packaging, networking, software, power and cooling. A design that looks compelling at tile level can encounter software, synchronization, thermal, reliability or data-ingestion challenges at cluster scale.

The approach also creates software and supply-chain dependencies. Compilers, kernels, libraries, scheduling, debugging and model-porting tools must support the architecture; advanced manufacturing, packaging, HBM and power-delivery components must be available. Those execution demands, combined with fast-moving AI workloads and commercial accelerators, are part of the context for Dojo’s changing status after 2022.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Quick Recap

Bestseller No. 2
WWZMDiB Mini DIY Tesla Coil Kit Practice Soldering Project Electronic Kit for Adults which can Sing, wirelessly Transmit Electricity, Light Fluorescent Lamps, and Have Wonderful arcs.
WWZMDiB Mini DIY Tesla Coil Kit Practice Soldering Project Electronic Kit for Adults which can Sing, wirelessly Transmit Electricity, Light Fluorescent Lamps, and Have Wonderful arcs.
⚡【Supply voltage】:DC 15-24v, current 2A, DC5.5 interface/pin header; 🎵【Audio input】: 3.5 Jack, can connect mobile phone, mp3, computer audio
$8.99
Bestseller No. 4
1/35 BC-005 Tesla Tank GlueFree Gun Turret Movable w/Tesla lamp Assembly Plastics Model kit
1/35 BC-005 Tesla Tank GlueFree Gun Turret Movable w/Tesla lamp Assembly Plastics Model kit
English Instructions included; Glue and paint not included; Ready-to-assemble plastic model kit
$75.00
Bestseller No. 5
Revell 85-5810 SR-71 Blackbird 1:72 Scale 66-Piece Skill Level 4 Model Airplane Building Kit
Revell 85-5810 SR-71 Blackbird 1:72 Scale 66-Piece Skill Level 4 Model Airplane Building Kit
Accurate surface details; Includes GTD-21 surveillance drone with cart; Decals with authentic U.S. Air Force markings
$25.75

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

More post from the Money Desk

  1. The Money DeskBlogTheFinanceBase09 OCT 267 minMortgage Escrow FAQs: Taxes, Insurance, Shortages, and Refunds
  2. The Money DeskBlogTheFinanceBase09 OCT 265 minHow Mortgage Escrow Accounts Work and What Homeowners Pay For
  3. The Money DeskBlogTheFinanceBase09 OCT 265 minHow to Read a Stock Chart, Volume and Market-Cap Data
Recommended PC Tool
Recommended PC Tool
PC Slower Than It Used to Be?Free scan - under a minute
Outdated Drivers Are Slowing You DownFree scan - exact matches

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.