Grinders with precision-aligned burr chamber