https://vim.fandom.com/wiki/Make_mouse_drag_not_select_text_or_go_into_visual_mode
:set mouse-=a
Yep, having the mouse do anything within VIM itself irritates me to no end. I discovered that to completely disable the mouse, at least in VIM 8.2, place this in your .vimrc file:
set mouse=