I used both extensively but the both are faster than term or shell.
Vterm is the fastest and most correct about handling key events.
Maybe term will get similar improvement as vterm in the future. This is such a basic thing that most other IDEs also seem to support properly.