The deffinition of "up" is a relationship to the body exerting the greatest gravity to the observer. So to look up from both earth and the moon wpuld be to look 180 degrees from center mass.

Now technicaly you dont always have to look up to view the moon and likewise the earth from the moon. You can, when the relative possition is right, look forword