If you choose to leave placeholder shortcuts, you can configure Enterprise Vault to delete archived files when their placeholders are deleted.

See How the 'Delete archived file when placeholder is deleted' feature works.

See Configuring the deletion of archived files on placeholder deletion.