One keyboard / mouse for 2 desktops, how?

I have 2 desktops, one monitor that has the ability to switch between HDMI ports from on-screen display, a keyboard, and a mouse.

How can I use the keyboard and the mouse with both desktops seamlessly?