Maybe I misunderstand, but if you are patching the VCO outs directly into the delay, you probably won't get much -- just some weird phasing effect mostly. Sounds like what you are getting.

Put the an amp envelope between the VCO and the delay and see what happens. The VCA out of the M32 will probably do the trick.