From watching your performance there appears to be a lot of upward movement on your right hand. It seems you are plucking up more than plucking across the string. I think making an adjustment to plucking across the strings will likely make the right hand execution of this piece much easier to perform.

Here's a link to Segovia playing a technical piece emphasizing the right hand. His performance is crazy fast but you can get a good idea of how to hold your right hand and and how little movement it takes to pluck each note