We are having an issue where a deployment will occasionally hang on one machine in the environment (not specific to the machine) during the package download. In looking through the logs, I cannot determine when a specific tentacle completed the package download. Is this possible?
Would it be possible to enhance the deployment log such that a verbose entry is added when the tentacle completes the download? That is first place I looked, and would probably be the ideal location for it.
Here is the redacted section from the log detailing the package download.
I can tell that all packages finished download at 07:55:34, but I cannot tell what happened between 07:36:36 and 07:55:34.
I would like to know when each individual server finished the download. These deployments usually take less than 2 minutes, so that 20 minute delay is extreme.
| Success: Acquire packages
07:36:02 Info | Downloading packages
07:36:02 Info | Making a list of packages to download
07:36:02 Verbose | The following packages will be downloaded by the Octopus Server:
07:36:02 Verbose | The following packages will be downloaded directly by Tentacles:
07:36:02 Verbose | - MyPackage 2014.11.12.8 (feed: MyFeed)
07:55:34 Info | All packages have been downloaded
|
| Success: Download package MyPackage 2014.11.12.8 from NuGet feed MyFeed on applicable machines
07:36:02 Verbose | Starting Acquire package MyPackage.2014.11.12.8
07:55:34 Verbose | Verifying that the same package was downloaded on all machines
07:55:34 Verbose | The package hash on all machines matched
|
| Success: Download MyPackage on https://WebServer-01:10933/
07:36:02 Verbose | Starting Download MyPackage on https://WebServer-01:10933/
07:36:09 Verbose | Checking package cache for package MyPackage 2014.11.12.8
07:36:09 Info | Downloading NuGet package MyPackage 2014.11.12.8 from feed: 'https://MyNugetServer.MyDomain.com/nuget'
07:36:09 Verbose | Downloaded packages will be stored in: D:\Octopus\Applications\.Tentacle\Packages\feeds-MyFeed
07:36:09 Verbose | Finding package (attempt 1 of 5)
07:36:10 Verbose | Found package MyPackage version 2014.11.12.8
07:36:31 Verbose | Downloading to: D:\Octopus\Applications\.Tentacle\Packages\feeds-MyFeed\MyPackage.2014.11.12.8_26235190020D0A439F13A88E4C80436B.nupkg
07:36:31 Verbose | A direct download is possible; bypassing the NuGet machine cache
07:36:36 Verbose | SHA1 hash of package is: d34c91ceb97813f27a9fa70a19b91a3d20134606
|
| Success: Download MyPackage on https://WebServer-02:10933/
07:36:02 Verbose | Starting Download MyPackage on https://WebServer-02:10933/
07:36:03 Verbose | Checking package cache for package MyPackage 2014.11.12.8
07:36:03 Info | Downloading NuGet package MyPackage 2014.11.12.8 from feed: 'https://MyNugetServer.MyDomain.com/nuget'
07:36:03 Verbose | Downloaded packages will be stored in: D:\Octopus\Applications\.Tentacle\Packages\feeds-MyFeed
07:36:03 Verbose | Finding package (attempt 1 of 5)
07:36:10 Verbose | Found package MyPackage version 2014.11.12.8
07:36:10 Verbose | Downloading to: D:\Octopus\Applications\.Tentacle\Packages\feeds-MyFeed\MyPackage.2014.11.12.8_E712FBF23C057A45A7BA05734812B3CA.nupkg
07:36:10 Verbose | A direct download is possible; bypassing the NuGet machine cache
07:36:16 Verbose | SHA1 hash of package is: d34c91ceb97813f27a9fa70a19b91a3d20134606
|
| Success: Download MyPackage on https://WebServer-03:10933/
07:36:02 Verbose | Starting Download MyPackage on https://WebServer-03:10933/
07:36:03 Verbose | Checking package cache for package MyPackage 2014.11.12.8
07:36:03 Info | Downloading NuGet package MyPackage 2014.11.12.8 from feed: 'https://MyNugetServer.MyDomain.com/nuget'
07:36:03 Verbose | Downloaded packages will be stored in: D:\Octopus\Applications\.Tentacle\Packages\feeds-MyFeed
07:36:03 Verbose | Finding package (attempt 1 of 5)
07:36:11 Verbose | Found package MyPackage version 2014.11.12.8
07:36:11 Verbose | Downloading to: D:\Octopus\Applications\.Tentacle\Packages\feeds-MyFeed\MyPackage.2014.11.12.8_7D8DF7CFDBCA9B4C8DDEF760664C1A30.nupkg
07:36:11 Verbose | A direct download is possible; bypassing the NuGet machine cache
07:36:16 Verbose | SHA1 hash of package is: d34c91ceb97813f27a9fa70a19b91a3d20134606
|
| Success: Download MyPackage on https://WebServer-04:10933/
07:36:02 Verbose | Starting Download MyPackage on https://WebServer-04:10933/
07:36:03 Verbose | Checking package cache for package MyPackage 2014.11.12.8
07:36:03 Info | Downloading NuGet package MyPackage 2014.11.12.8 from feed: 'https://MyNugetServer.MyDomain.com/nuget'
07:36:03 Verbose | Downloaded packages will be stored in: D:\Octopus\Applications\.Tentacle\Packages\feeds-MyFeed
07:36:03 Verbose | Finding package (attempt 1 of 5)
07:36:10 Verbose | Found package MyPackage version 2014.11.12.8
07:36:10 Verbose | Downloading to: D:\Octopus\Applications\.Tentacle\Packages\feeds-MyFeed\MyPackage.2014.11.12.8_93EC0B5A9FA695469C1374580060AD42.nupkg
07:36:10 Verbose | A direct download is possible; bypassing the NuGet machine cache
07:36:16 Verbose | SHA1 hash of package is: d34c91ceb97813f27a9fa70a19b91a3d20134606
Thanks for getting in touch! Sorry about the delay in a response.
We don’t really have any settings that can be turned on here to find out what is going wrong.
I am also going to have to assume that you have copied all the relevant parts of the log - based on that assumption, there does appear to be a 20 min gap there.
What might point me in the right direction here would be a copy of the Tentacle logs c:\Octopus\logs\OctopusTentacle.txt etc
If we can find why it might be hanging on receiving the package this might determine the gap.