Ah yes, pygmies. There are a number of ethnic groups with unusually short average heights, averaging at around 4' 11'' or less.
I looked up the pygmies, and (from the wikipedia description) I don't think that's the one I was hearing about. I think it was midgetville, because I just asked the person I heard the rumor from.