That is mullein leaf! And I think it is a good idea to try to grow Ginkgo from seed, i have heard they take a while to germinate - worth a try though!! Do you have a place to get ginkgo seeds?
You may be able to find ginkgo in a nursery, I have seen them sold as ornamental plants.