I think most potted plants are okay to be moved, if we're mindful of the different conditions. If a plant gets moved from full sunlight to only a little bit of light per day, or the other way around, it can trigger stress or flowering at the wrong time, or it might just up and die. Drastic temperature differences can shock plants too, of course. But as long as I'm gentle with them, moving them around (to take advantage of some gorgeous sunlight for a few hours for example) is fine.