The useful things ARE the decoration
In Japanese tea ceremony, when a tray of sweets is passed around, you choose your sweet in a way that leaves a pleasing arrangment behind. The next person then considers the balance of empty spaces, and chooses hers. Around the room it goes, with eveyone contributing to the artwork.
They arrange towels so there is a pleasing gradation from light to dark. Light at the top, of course, because its light.
Arrange your bottles in 'families' of colors, textures. Soon the practical things will be providing all the decoration. The figurines, pictures in frames, the cute thingumys will all just not feel at home. They will move on.