Only half the solution you want.
When you open the controller you will notice two motors connected to half moon type weights. removing these will remove the rumble.
a) remove the weights and leave motor, it will spin, but is balanced, therefore, no rumble.
b) just remove the motors and wires completely, which will also make the conversion easier too.