The term has always made me ponder who might say it and why. God is not from earth and being 'not of earth' would naturally call people "earthlings".

But because the term "earthlings" was not used as such until the cartoon age (and only in English), 'Ben haAdam' or son of the earth (son of man) were the correct way for a non-earthling beings to speak about the men of earth.