Only if you are the HR and/or you have made all the necessary arrangements for leave calculations, reporting, payments and other actions, then only:
1- Go to time off app
2-Go to time off type
3- Click on allocation 
4- Select the time off allocation you want to remove
5- Click on action and select "Archive"

This action will automatically remove the time off allocation from the dashboard of the concerned employee.