Tiny Corp's four-GPU AI workstation packs serious AMD Epyc power, but buying one isn't straightforward

Tiny Corp, the company founded by George Hotz, has revamped its Tinybox deep-learning workstation with a new configuration system. Unlike its earlier fixed-configuration machines, the latest Tinybox allows customers to select their preferred memory, storage and GPUs, including the option to purchase a system without graphics cards.

The new Tinybox configurator lists a G4 platform with PCIe 4.0 connectivity, a water-cooled 32-core AMD Epyc processor, a server-grade motherboard with a baseboard management controller (BMC) and support for up to four GPUs. The baseline specifications also include 32 GB of DDR4 memory, a 1 TB boot SSD and a 1,700 W power supply. You can configure the machine with up to 128 GB of RAM and 16 TB (1 TB boot SSD + 4x 4 TB drives) of storage with RAID. Meanwhile, the G5 platform upgrades the CPU to an unspecified Epyc Genoa platform and the memory to DDR5. The minimum and maximum amount of storage is identical across both platforms, but the newer Genoa CPU can be configured with up to 192 GB of memory.

The TinyBox has four GPU slots with full-fabric PCIe connectivity. Connectivity includes 16 DisplayPort outputs across the four GPUs. Of course, that number will differ based on how many GPUs you put in the machine  Five RJ45 Ethernet ports, two USB Type-A ports and a VGA output are also included.  One of the Ethernet ports may be dedicated to remote server management. 

GPU options range between four AMD Radeon RX 9070 XT GPUs and one/two Nvidia RTX Pro 6000 GPUs; the generation isn’t specified, but given its $19,000 price tag, it is likely Blackwell. Alternatively, you can buy the barebones machine with no GPU and use your hardware. It will set you back by $7,000, while the most you can spend on the machine with 192 GB RAM, two RTX Pro 600 GPUs, 16 TB storage, and an Epyc Genoa CPU comes to an eye-watering $64,000.

Tiny Corp's approach to selling hardware is markedly different from that of conventional workstation manufacturers. Customers must order through its website, and bank transfers are the only accepted payment method. Payment must be completed within five days of order confirmation to guarantee an order.

All new Tinybox systems are built to order, with estimated shipping times ranging from one to eight weeks. International delivery is available through UPS, but only to countries supported at checkout. Import duties, taxes and other charges are the customer's responsibility. Returns are permitted within 30 days of receipt, although Tiny Corp charges a 20% restocking fee and requires buyers to cover return shipping.

If that wasn’t enough, there are additional restrictions for Nvidia-equipped configurations. Tiny Corp warns that customers may need to complete Know Your Customer (KYC) and compliance documentation detailing the intended use and installation location of their GPUs. US export regulations could also prevent Nvidia-equipped systems from being delivered to certain countries. More information is available on Tiny Corp's FAQ page.