It is better to mark the products as Inactive (Active = False).

That way they won't show up anymore, but will still be in the system.

If these products are part of an inventory, orderpoint, sale order, purchase order, incoming shipment, delivery order, manufacturing order, procurement order, invoice, timesheet or expense - you won't be able to delete them without first deleting the other records (documents) that depend on them.