grandmother said if a fungus can be eaten by insect or a caterpillar, the fungus is not poisonous.

this is not correct, my friend.

iD is Schizophyllum_commune: https://en.wikipedia.org/wiki/Schizophyllum_commune

due to its toughness, considered inedible - tho it is nonpoisonous.