Can I charge the charging case without the earbuds inside?

Yes, the earbud case has its own battery that can be charged separately from the wireless earbuds. The case can be charged by itself and the battery can then be used to charge the earbuds. (Page 17)