This does not and can not work. It would be something like "I want to have an accounting system, but I want to have only one account" :-)
You should make yourself familiar with the Odoo communication concept, see https://www.odoo.com/page/discuss and https://www.odoo.com/documentation/user/10.0/discuss.html. Basically, you may set up Odoo with one catchall "physical" email address and all kind of communications concerning users, partners, documents, and workflows are handled with email aliases. These are necessary to properly assign communications and to ensure proper follow-up.
If you want to have only one email address in external communications, you should cut all external communication in Odoo and do it manually outside Odoo. This does not make very much sense.