Cleaning guppy decor

The decor in my new guppy tank is starting to look dirty. How would you clean the decor? Would you remove it and wash it with hot water & a brush? Would you get a snail/algae eater? Any other suggestions?