I see, basically I must first hear what each scale is telling then experience the effect that the modes have on them?
Personally, I think that’s a good way to approach them.
But it’s not so much that you need to interpret the mode relative to the base scale. It’s more that having the instinctive “feel” of the base scale using solfa gives you the structure and framework to explore the modes in an enjoyable way.
Without that, I found that it was just a bunch of arbitrary different scales and I found it hard to identify a character or meaning for any of them (apart from the base major, Aeolian and to some extent the Dorian).