You mention that you've done some work in the Color page, but you are asking a question in the Fusion section. There's not much interaction in that sense between the Fusion and Color pages.
Depending on how much movement (in 3D space) there is you can work with a clean plate, but if the movement is too big 3D wise you'll probably need to do some reconstruction/reprojection of your clean scene to effectively replace the violins on the shelf. How long is the footage and can you share it? That will help us help you better.