Thanks a lot for the feedback.

I was only using Hive Engine API.
So will update my script to get the missing data