Yes, that's about where I'm at, even down to having the girlfriend who knows names and faces for me. I didn't realize how bad I was until a newspaper did an article on it, wherein they had pictures of lots of celebrities with everything but the face cropped, which meant no clues from context or hair (of course, as they were celebrities, I didn't know half of them anyway). I really can fail to recognize someone if they significantly change their hair, and there are lots of other cues I use. If I see someone out of context, say someone from work in a non-work-related situation, it can briefly throw me until I can work out their normal context.
I also read an article about failure to distinguish people of different races, which implies, from the number of people who have this problem, that a lot of people rely primarily on cues other than face recognition alone. Not that all [insert ethnic type]s look the same, but that one differentiates people who look different in a different way, as it were, by different means. I wish I could remember where I'd seen it.