in right top corner of view you can change "preferences" in that you can set your email address which will be shown as from address

That didn't work. But the solution was in Settings -> Configuration -> General Settings -> Email -> Alias Domain. There I had configured the server name as alias domain, when I changed it to be the mail domain it works. Maybe it would have worked if I left it empty too, but if it ain't broken...