As you write… Altering the velocity triggers a different sample and will change the sound a bit. Just use the velocity when you want to change how the drums are played. When you have found what you are looking for then use volume automation to match the volume of the drums with the rest of the music.

I have actually never tried to change velocity of several different clips at once so I wouldn’t know how