The only reason nodes normally keep blocks around is to give them to other nodes that haven't seen them (i.e. new nodes being setup for the first time). In the case of lite nodes, they won't have the older blocks, so nodes will need to get them from non-lite nodes.