Rosemary is indestructible and good for cooking. For ornamental plants, I would try some small succulents. I'm partial to Echeveria, aloe and agave (though agave can get REALLY big if you give them a big enough pot, and they can be painful when they get larger).
