A note about using Goo Gone, what I do is get a paper towel a little wet with Goo Gone rather than applying it straight to the box. It might take a little longer, but it's less likely to stain the box that way.

This method will also take grease pencil off a label without messing the label up.