Hi Swetha,
You can only delete a inactive employee.
So first fill 'Date of leaving' in Employment Details.
Then delete employee from Ex-Employees list.
You can see the deleted employee in Administration module. (Administration – Deleted Employees)
Regards,
Rincy