You'd be surprised, honestly.
If you want to just set a drum rhythm going and that's it you won't need many, but as soon as you want to modulate the drums - change an 808 drive amount over time or whatever - the VCA usage starts stacking up!