Sadly ads by certain applications which use "Airpush notifications" can't be blocked. I use two of them, Textra and Aptoide, but have only enabled internet access for one of them (Aptoide) which plays an ad with sound in fullscreen even if the app isn't displayed.
RE: Block Destructive Ads on Your Android Devices with AdAway