I think they just aren't old enough. Grafted trees are often on dwarfing rootstock that stunts their growth but also causes them to fruit at a younger age. I suspect since these trees are from seed they just need a few more years. I think I have heard that 7 years is not uncommon.