Speakers make more impact than for instance a DAC. Your room actually makes the most impact. And you can measure that with REW and a mic.
You can exchange different DAC’s in your system and the frequency response doesn’t change all that much.
You can change speakers and you’ll get a major difference in the frequency response.
But also yes, crappy recorded music sounds crap on $100 systems and on $10.000 systems so in that case the recorded source is also important. But you can only get as good of a source as the original mastering.
I can highly recommend Scansonics if you’re budget is not up to Raidhos. They are not on the same level, but are under the same umbrella.
I’m listening to them now, and they sound amazing!