Maybe you were, maybe you weren't. I think the phrase has a plethora of levels. My kids are often 'literally starving' but, to me, those emaciated images of people from war torn and drought ridden countries are only time that the phrase is truly applicable.
I think, on this one, maybe I might be the expert on my own experiences. And given what I do for a living, I happen to choose my words with a laser-focused accuracy, so ‘literally starving’ here does mean exactly that.