from 16 to 4). 4-8× smaller memory footprint, 2-3× faster inference, ~1-2% quality loss.
The bench this belongs to
AI automationThe repetitive half of your week, handed to software that does not get bored. Inbox triage, follow-ups, reporting, data entry between tools that were never meant to talk.
