You can take the canopy off and add something into the arm within where a screw and nut can likely be attached. There are often a few screws to remove before it pops right off. Do you hear anything rattling inside (potentially the previous arm)?