Driver FixRecommendedSound, Wi-Fi or graphics acting up? Check drivers firstFind missing or outdated drivers fast.Check DriversHalloween DealsAmazon USHalloween week deals: useful picks before month-endAmazon US: current deals, useful picks and tech finds.Check DealsPC HealthRecommendedCrashes, freezes, slowdowns? Check your PC nowSpot repairable issues before they interrupt work.Check PC×
Skip to the guide
THE FINANCEBASE List yours

Guide

Bolmo’s “99% Cheaper” Claim: What Ai2’s Byteification Method Actually Saves

By TheFinanceBase Team 6 min read

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Bolmo is a real Ai2 model release, but “99% cheaper” does not mean AI training or ownership costs fall by 99%. The figure refers to the extra token budget used to convert an already-trained subword model into a byte-level one: Ai2 says its byteification approach can use less than 1% of a typical pretraining-token budget. The original model still had to be trained, and the claim is not a dollar-cost or inference-cost guarantee.

What Ai2 released

Bolmo stands for Bolmo: Byteifying the Next Generation of Language Models. Ai2 announced the open byte-level model family in December 2025. Rather than training byte-level models from scratch, Bolmo adapts existing Olmo models: Bolmo-1B is based on OLMo 2 1B, and Bolmo-7B is based on Olmo 3 7B. Ai2’s repository lists their exact sizes as 1.5 billion and 7.6 billion parameters, respectively.

As an Amazon Associate I earn from qualifying purchases.

Ai2 describes Bolmo as a way to preserve much of a pretrained model’s capability while giving it byte-level input and output. The code, checkpoints, paper, and release information are available through the official repository and Ai2’s announcement. Check the license attached to each artifact before using it commercially; open availability alone does not establish unrestricted rights for every component.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

What “99% cheaper” means—and what it does not

The claim is about byteification’s additional training-token budget, compared with a typical pretraining-token budget for training a comparable byte-level model from scratch. Ai2’s paper says the conversion can take less than 1% of that typical budget. It is not a claim that every AI training project costs 99% less, or that Bolmo costs 99% less to run.

#1 Best Overall
Arduino® UNO™ Q 4GB [ABX00173]- Hybrid Board, Qualcomm Dragonwing QRB2210 microprocessor (MPU) & STM32U585 Microcontroller(MCU), AI Vision, Voice, IoT, Robotics, Linux Debian OS, Wi-Fi 5, USB-C
  • Dual-Brain Hybrid Power: Combines the Qualcomm Dragonwing QRB2210 MPU (Quad-core Arm Cortex-A53 @ 2.0 GHz CPU, Adreno GPU, AI acceleration) and the real-time, low-power STM32U585 MCU for advanced applications like object recognition, voice commands, and motion detection.
  • AI & Linux Capabilities: Unlocks AI-powered vision and sound solutions; runs Linux Debian OS for coding in Python and supports the Arduino ecosystem with libraries and Sketches; quick start with Arduino App Lab.
  • Advanced Features: Equipped with 4 GB LPDDR4 RAM, 32 GB eMMC built-in storage, ideal for single-board computer (SBC) mode, running multiple simultaneous high-level processes, more complex AI or ML models, extensive logs. Dual-band Wi-Fi 5 (2.4/5 GHz), Bluetooth 5.1, and high-speed headers for vision, audio, and display peripherals.
  • Seamless Expansion & Connectivity: Features the classic UNO form factor for shields compatibility, an 8x13 LED matrix, and a Qwiic connector for easy expansion with Modulino nodes; power and connect via the USB-C connector.
  • Intended Use & Development: The perfect platform for prototyping robotics or IoT projects, empowering innovators with a unified development experience to mix Arduino Sketches, Python scripts, and containerized AI models in a single interface.
  • Conversion versus training from scratch: Bolmo starts with an existing pretrained subword model and adds byte-level capabilities. That reuse is the basis of the saving.
  • Conversion versus total model development: The original Olmo backbone still required its own training investment. A team starting without a suitable checkpoint does not avoid that cost.
  • Token budget versus dollars: Fewer training tokens can reduce compute under comparable conditions, but tokens alone do not account for hardware, utilization, energy, data handling, engineering, evaluation, or failed runs. The cited claim does not establish a 99% dollar saving.
  • Training versus inference: The figure concerns training budget, not a 99% reduction in serving cost or latency.

For the reported Bolmo 7B conversion, Ai2 describes two stages: about 9.8 billion tokens in the first, then 39.3 billion additional tokens in the second—approximately 49.1 billion tokens total. These stage counts describe the reported conversion procedure; they do not make “less than 1%” a fixed ratio for every model, dataset, or target.

Why model bytes instead of subword tokens?

Most language models read text as subword units created by a tokenizer. That vocabulary lets the model process common words efficiently, but rare names, misspellings, code identifiers, unusual strings, and some scripts may be split into awkward sequences. Byte-level models instead work directly with UTF-8 bytes, avoiding dependence on a fixed subword vocabulary and retaining fine-grained character structure.

That can be useful when exact spelling or arbitrary text matters—for example, handling noisy input, rare words, mixed-language text, or code. It does not automatically make a model multilingual or better at ordinary language tasks. Raw byte sequences are longer than subword sequences, so byte-level modeling can demand more computation; subword models remain effective for many workloads.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

How Bolmo turns bytes into model input

Bolmo is not simply an Olmo transformer with its tokenizer removed. It adds a learned hierarchy that groups byte sequences before the global transformer processes them:

Rank #2
Arduino® UNO™ Q 2GB[ABX00162] - Hybrid Board, Qualcomm Dragonwing QRB2210 microprocessor (MPU) & STM32U585 Microcontroller(MCU), AI Vision, Voice, IoT, Robotics, Linux Debian OS, Wi-Fi 5, USB-C
  • Dual-Brain Hybrid Power: Combines the Qualcomm Dragonwing QRB2210 MPU (Quad-core Arm Cortex-A53 @ 2.0 GHz CPU, Adreno GPU, AI acceleration) and the real-time, low-power STM32U585 MCU for advanced applications like object recognition, voice commands, and motion detection.
  • AI & Linux Capabilities: Unlocks AI-powered vision and sound solutions; runs Linux Debian OS for coding in Python and supports the Arduino ecosystem with libraries and Sketches; quick start with Arduino App Lab.
  • Advanced Features: Equipped with 2 GB LPDDR4 RAM, 16 GB eMMC built-in storage, ideal to develop in PC-connected mode, running the OS, Python scripts, and basic network services (SSH) without a demanding GUI or heavy multitasking; great for lightweight AI and memory-optimized TinyML applications, needing local storage for basic OS and core libraries. Dual-band Wi-Fi 5 (2.4/5 GHz), Bluetooth 5.1, and high-speed headers for vision, audio, and display peripherals.
  • Seamless Expansion & Connectivity: Features the classic UNO form factor for shields compatibility, an 8x13 LED matrix, and a Qwiic connector for easy expansion with Modulino nodes; power and connect via the USB-C connector.
  • Intended Use & Development: The perfect platform for prototyping robotics or IoT projects, empowering innovators with a unified development experience to mix Arduino Sketches, Python scripts, and containerized AI models in a single interface.
  1. Raw UTF-8 bytes are embedded.
  2. A local mLSTM-based encoder builds contextual representations for the bytes.
  3. A learned, non-causal boundary predictor identifies where variable-length patches should begin and end.
  4. The byte representations are pooled into patches for the Olmo transformer backbone.
  5. The model’s representations are mapped back toward byte positions, and a local decoder and language-model head predict the next byte and boundary.

Patch size is a compression control: grouping more bytes can help reduce the sequence burden, while changing how much byte-level detail the global model handles. It is a trade-off, not a free speed improvement.

How the two conversion stages work

Stage 1: teach byte components to imitate the source model

Ai2 freezes the original Olmo transformer and trains the added local encoder, local decoder, boundary predictor, and language-model head. The reported stage uses about 9.8 billion tokens, or roughly 43 billion bytes. This gives the newly added components a way to reproduce useful behavior from the pretrained subword model.

Stage 2: train the whole model end to end

Ai2 then unfreezes the full model and trains for about 39.3 billion more tokens, approximately 173 billion bytes in the reported setup. This lets Bolmo learn directly from byte-level information rather than only imitating the source model. The two token counts should not be confused with byte counts: they are different units, and the figures belong to this reported setup.

Free tools Windows power users keep installed

One-click scans. No signup required.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Does Bolmo perform as well as a subword model?

Ai2 reports that Bolmo 7B stays close to Olmo 3 7B on broad evaluations while substantially improving character-focused performance. The announcement also reports favorable comparisons with other byte-level models of similar scale, including BLT 7B, TFree-Hat 7B, and EvaByte 6.5B. Results vary by benchmark and task; the findings do not show that Bolmo universally beats subword models or that it will match them on a particular organization’s data.

Rank #3
EC Buying Luckfox Pico Mini B Linux AI Development Board RV1103 Micro Board Module Integrate ARM Cortex-A7/RISC-V MCU/NPU/ISP Processors 64MB DDR2 0.5TOPS Support int4 int8 int16 NPU with 128MB Flash
  • Single core ARM Cortex-A7 32-bit core, integrated with NEON and FPU
  • Built in Micro's self-developed 4th generation NPU, with high computational accuracy and support for mixed quantization of int4, int8, and int16. Among them, int8 has a computing power of 0.5 TOPS and int4 has a computing power of up to 1.0 TOPS
  • Built in self-developed 3rd generation ISP3.2, supports 4 million pixels, and supports various image enhancement and correction algorithms such as HDR, WDR, and multi-level denoisin
  • It has powerful encoding performance, supports intelligent encoding, adapts to save bit rates according to the scene, and saves more than 50% of the bit rate compared to conventional CBR mode, making the captured images high-definition, smaller in size, and doubling the storage space
  • The design with built-in RISC-V MCU supports low-power fast startup, 250ms fast capture, and simultaneous loading of AI model library, enabling facial recognition to be completed within 1 second

The practical case is strongest for workloads where character structure matters and a team can evaluate the model on its own tasks. Benchmark results do not establish equal production latency, memory use, reliability, safety behavior, or cost per generated answer in a specific deployment.

What Ai2’s speed figure says

In its reported comparison, Ai2 gives decoding throughput of about 125 bytes per second for Bolmo versus about 150 bytes per second for the corresponding subword model. This is a setup-specific result, not a general speed guarantee. Real throughput depends on hardware, batch and sequence lengths, precision, implementation, serving framework, workload, and patch-compression settings. Byte-level processing may be a worthwhile trade if character behavior matters more than maximum throughput, but teams should measure it on their intended stack.

Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

Can existing instruction tuning carry over?

Ai2 reports a weight-merging experiment that transferred post-training from an Olmo 3 checkpoint to Bolmo without an additional post-training run. On IFEval, the reported scores were 31.1% for base Bolmo, 35.4% for the original Olmo 3 counterpart, 67.4% for post-trained Bolmo after merging, and 66.9% for the original post-trained Olmo 3.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Here, “zero-cost” means avoiding another post-training run in this demonstrated experiment—not that transfer takes no engineering, validation, or deployment effort. Ai2 says compatibility depends on properties such as embedding-reset behavior; this result for the Olmo family is not evidence that arbitrary fine-tunes can be transferred between arbitrary model families.

Rank #4
LAFVIN AI Chatbot Kit for ESP32-S3, Preloaded OpenAI & Deepseek Voice Assistant Projects, Voice Wake-up & Real-time Interruption, Suitable for Learning AI and IoT Projects.
  • 【POWERFUL ESP32‑S3 CONTROLLER】Built‑in Xtensa 32‑bit LX7 dual‑core processor, 512KB SRAM, 8MB PSRAM, 16MB Flash for stable AI voice computing and multitask processing.
  • 【Preloaded Dual AI Platforms】Comespre-installed with complete Deepseek and OpenAI voice dialogue projects.Experience intelligent voice interaction instantly. (Note: OpenAI functionality requires your own API key.)
  • 【STABLE WIRELESS & CLEAR AUDIO】Integrated 2.4GHz Wi‑Fi + Bluetooth 5 (LE); dedicated audio decoding module for natural, responsive voice interaction.
  • 【USER‑FRIENDLY VISUAL & PLUG‑AND‑PLAY】2” TFT‑SPI color screen shows real‑time chat; modular design, no extra wiring, ready to use after setup.
  • 【FULL LEARNING SUPPORT】45 programmable GPIOs, rich interfaces, online web tutorials, free technical support for beginners & developers.

How developers can try Bolmo

Ai2’s repository links to Bolmo-1B and Bolmo-7B checkpoints. Its documented setup uses Python 3.12.12 and uv:

git clone https://github.com/allenai/bolmo-core.git
cd bolmo-core
uv venv --python 3.12.12
. .venv/bin/activate
uv sync --frozen --extra xlstm --extra wandb

The repository also documents an editable pip installation:

pip install -e '.[xlstm,wandb]'

Optional dependencies include flash-attn, TransformerEngine, xlstm, and Liger-Kernel for particular functions or performance paths. Ai2 says it tested installation on Ubuntu 24.04 and Rocky Linux 8.10; that does not guarantee every machine will work without additional configuration.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

For converting a native checkpoint to Hugging Face format, the repository documents:

python3 src/examples/huggingface/convert_checkpoint_to_hf.py 
  -i /path/to/bolmo/checkpoint 
  -o /path/to/bolmo/checkpoint/in/hf/format 
  -s 65536 
  --dtype float32 
  --skip-validation

As described in the repository, conversion back from Hugging Face format to native olmo-core format is not implemented. Teams should confirm current repository instructions, artifact licenses, and workflow compatibility before committing to an integration.

Who should consider it?

Potentially suitable

  • Researchers studying byte-level modeling or character-sensitive tasks.
  • Teams with an existing compatible Olmo checkpoint that want to explore byte-level behavior without pretraining a byte model from scratch.
  • Open-model developers comfortable with specialized dependencies, checkpoint conversion, and their own evaluation and deployment work.

Potentially a poor fit

  • Teams that need mature, standard tokenizer-based tooling or turnkey serving and support.
  • Workloads where conventional text generation and predictable latency matter more than character-level handling.
  • Projects without a suitable source checkpoint, or buyers seeking a managed API with established pricing and an SLA. The cited release material does not establish an official Ai2 hosted Bolmo API or subscription price.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

Leave a comment

Your email address will not be published. Required fields are marked *

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

More guides

Recommended PC Tool
Recommended PC Tool
PC Slower Than It Used to Be?Free scan - under a minute
Outdated Drivers Are Slowing You DownFree scan - exact matches

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.