There's a setting on Settings > Control switching based on mouse movement > When disabled via Scroll Lock toggle
If you enable that checkbox, you can press Scroll Lock to stop the mouse from moving to another computer.
Side note, would love all of these hard coded hotkeys for switching (Ctrl x 3, Scroll Lock, etc) to be user definable.