Windows - two printers with different formats

I've run into a weird problem. We have a computer with two printers installed from server; one standard A4 and one which prints small labels.

When printing from Inteet Explorer to the default A4-printer it comes out sized like the labels from the label printer. When I open the print dialog once more it prints as it should. Both printers have their respective drivers, and this problem occurs on another computer which has a locally installed printer in addition to the label printer.

Any feedback is appreciated.