This task uses the OOB Package Deployer bindings of 2 minutes as a timeout. For large solutions, deleting the holding solution times out with the following in the logs:
The request channel timed out while waiting for a reply after 00:02:00. Increase the timeout value passed to the call to Request or increase the SendTimeout value on the Binding. The time allotted to this operation may have been a portion of a longer timeout.
The package deployer task should use the Timeout property under the Control Options of the task for the timeout setting.