There are a number of supermarkets in the centre of Reykjavík if youre self-catering. Try 10-11 on Austurstræti, Bónus, on Laugavegur, and Hagkaup, which is a lot larger, at Kringlan Mall (see above).