I've heard if you don't read the books it gets a little hard to follow as the time jumps around quite a bit, but some of the characters don't age or age really slowly, so it makes it hard to understand what "time" you're in if you're not paying close attention.