No, you can't, the ammount of the invoice is calculated from the invoice lines and the taxes. If you need to alter it for a reason not linked to the lines nor the taxes, you must find the way to reflect that on accounting, like sending the unpaid ammount to a profit/loss account or linking it to some discount/penalty.

If you look in youtube the Odoo OpenDays presentations there is one about accounting where this case is presented.