This happens all the time. It's sort of like if they think your IQ and/or experience is above menial work you won't apply yourself or will leave the job shortly.

Whereas if someone struggles at something they would need to apply themselves better and they'd be more tired and less likely to have time or will to move on.