When you open your hardware wallet and gaze at the price of your 5 BTC do you get all warm and fuzzy? Do you start to think about being a millionaire from these 5 BTC by 2020? It is only natural to start to think of the USD value in your wallet is just like your online bank account; however, have you tested your bank to see if they will accept a wire from coinbase?
If you are in the US, how would you feel if the funds in you wallet were not accessible or you knew that you were going to pay %50 in taxes? It would be disappointing to say the least.
Start spending it. That's what it was created to do.