I started with some semi-modular (4 Neutrons) to complement my digital piano and Nord Wave, got hooked and then gradually branched into modular as I wanted to try new things, learning as I went. Part of that was regularly trying out and selling modules when they weren't quite what I was looking for - I think I've sold at least 70 modules. I see people constantly asking what they need for their rack and I don't really relate to that very well because to me you should just start with enough to make some noise and then when you want to do or try something but can't, that'll inform what you want/need real quick. My "rack" so to speak (it's really more of a sprawling mess haha) is pretty large now, but as you said, the point is not to use it all at once - it's like having a bunch of guitars/pedals, it just gives you more options when trying to find whatever sound you're looking for in a given instance. Mine grew to its current size over the course of 4 or 5 years, I couldn't possibly have planned it all out in advance. But I did have a strong vision for my music, I think that's what a lot of people are missing and maybe what makes the journey more confusing for a lot of people.