Can the test be deleted permanently?

Yes, but only suspended tests can be deleted permanently.
To see how to suspend and then delete a test permanently, follow the steps in this article.