Ubuntu mouse scroll moves cursor instead of entire view

When I use the mouse scroll in a window which has a cursor (such as a text editor), the scroll controls the cursor position instead of the scrollbar on the right. Similarly, when I'm in a window which has some kind of list (ex. drop-down), the scroll controls the selection of that list. In order to scroll entire window I need to press and hold a control key (which I find aoying).

In other operating systems (Windows, Mac OS) the scroll always controls the scroll bar of entire window. Can I configure Ubuntu to behave like that?