Deleting a policy is not a permanent action. The policy record and its associated source document are simply moved to the Trash Bin, where it may be retrieved later.
To delete a policy, simply click the red "X" icon () at the end of the policy's row. You will be asked to confirm the deletion before it is done.