If you're truly anti-bloat, there's a whole subgenre of dainty, low-bloat computers out there for  The PalmPilot and Windows CE handheld devices.
There are many options for low-bloat computers available.