Inferos takes over the hardware and runs models directly on it.
It boots, drives the GPU, and serves an OpenAI-compatible API,
on a Raspberry Pi or an x86 mini-PC.
UEFI or bare-metal handoff. Inferos takes the CPU, starts the other cores, and owns the machine. There is nothing underneath it.
Its own USB, FAT32, framebuffer and networking — drivers written from scratch for each board, and GPU kernels hand-written for the Intel Gen11 and VideoCore VI.
Transformers and diffusion, in fp16 and int8, accelerated on the integrated GPU. Talk to it over an OpenAI-compatible API, or from the on-screen console.