That would depend on your installation. The upgrade instructions say:
If you have transferred all custom modules, or had none, and you are satisfied your site is working OK, you may now (optionally) remove the no-longer used “modules_v3” folder and all it’s contents. If you don’t feel any need to remove it now, it will be automatically removed as part of the next upgrade in a couple of months time.