I'd try to give you my own explanation of this, but this video is way better than anything I could make...

From what I could tell, this content used the same notation as this book/website which is a super nice resource as well:
http://neuralnetworksanddeeplearning.com/chap2.html