This is why it's so useful that many sex toys now come with their own storage pouches. These are perfect, because they prevent your favourite vibe or butt plug from rubbing together in the draw or box. Plus it helps keep them dust free. These little bags also look totally conspicuous, so if you leave one out on the side accidentally, that nosy friend won't really be any the wiser.
If a sex toy doesn't come with a pouch, then get inventive: you could use an unwanted sock, or keep it in the box it came it. If you're feeling particularly crafty you could make your own with any spare fabric that's kicking around. The main point is if you have a variety of sex toys all made from different materials, it's best to keep them from touching each other.
It's just little considerations like this that means your toy box will stay happier for longer. Ace.