Deployment hangs - Another process is using the deployment journal

Legacy Execution
1

Hi,

Yesterday, some of our deployments have started to hang. We were using 2018.4.3. This morning I upgraded to 2018.6.12, but the issue is still present. The last log entry is Another process is using the deployment journal. I have rebooted the machines but that did not help.

We are using SSH connections for the deployment targets.

I have created a simple deployment project to show the issue that just echos “Hello World”. The log files are:

Task ID:        ServerTasks-62657
Task status:    Executing
Task queued:    Wednesday, July 4, 2018 8:27:38 AM
Task started:   Wednesday, July 4, 2018 8:27:38 AM
Task duration:  7 minutes
Server version: 2018.6.12+Branch.master.Sha.e78bdbd1f670618ec8f2da3f199bffe0c1777bab
Server node:    M1-OCTAPP-001
                    | == Running: Deploy Deployment Test release 0.0.1 to Development ==
08:27:38   Verbose  |   Guided failure is not enabled for this task
                    | 
                    |   == Running: Step 1: Echo Hello ==
                    |   
                    |     Running: p16-d-api-001
08:27:38   Verbose  |       Octopus Server version: 2018.6.12+Branch.master.Sha.e78bdbd1f670618ec8f2da3f199bffe0c1777bab
08:27:38   Verbose  |       Environment Information:
                    |       OperatingSystem: Microsoft Windows NT 10.0.14393.0
                    |       OsBitVersion: x64
                    |       Is64BitProcess: True
                    |       CurrentUser: NT AUTHORITY\SYSTEM
                    |       MachineName: M1-OCTAPP-001
                    |       ProcessorCount: 4
                    |       CurrentDirectory: C:\Windows\system32
                    |       TempDirectory: C:\Windows\TEMP\
                    |       HostProcessName: Octopus.Server
                    |       PID: 95548
08:27:38   Verbose  |       Executing Echo Hello (type Run a Script) on p16-d-api-001
08:27:38   Verbose  |       Using Calamari 4.7.21
08:27:38   Verbose  |       Requesting upload...
08:27:38   Verbose  |       Establishing SSH connection...
08:27:39   Verbose  |       SSH connection established
08:27:39   Verbose  |       Beginning streaming transfer of command.sh to $HOME\.octopus\OctopusServer\Work\20180704082738-62657-83
08:27:39   Verbose  |       Establishing SFTP connection...
08:27:41   Verbose  |       SSFTP connection established
08:27:42   Verbose  |       Stream transfer complete
08:27:43   Verbose  |       Requesting upload...
08:27:43   Verbose  |       Beginning streaming transfer of Variables.secret to $HOME\.octopus\OctopusServer\Work\20180704082738-62657-83
08:27:44   Verbose  |       Stream transfer complete
08:27:46   Verbose  |       Octopus Deploy: Calamari version 4.7.21
08:27:46   Verbose  |       Environment Information:
08:27:46   Verbose  |       OperatingSystem: Unix 4.4.0.130
08:27:46   Verbose  |       OsBitVersion: x64
08:27:46   Verbose  |       Is64BitProcess: True
08:27:46   Verbose  |       Running on Mono: True
08:27:46   Verbose  |       CurrentUser: deployuser
08:27:46   Verbose  |       MachineName: p16-d-api-001.us16.kexpress.net
08:27:46   Verbose  |       ProcessorCount: 4
08:27:46   Verbose  |       CurrentDirectory: /home/deployuser/.octopus/OctopusServer/Work/20180704082738-62657-83
08:27:46   Verbose  |       TempDirectory: /tmp/
08:27:46   Verbose  |       HostProcessName: Calamari
08:27:46   Verbose  |       Executing '/home/deployuser/.octopus/OctopusServer/Work/20180704082738-62657-83/Script.sh'
08:27:46   Verbose  |       Bash Environment Information:
08:27:46   Verbose  |       OperatingSystem: Linux p16-d-api-001.us16.kexpress.net 4.4.0-130-generic #156-Ubuntu SMP Thu Jun 14 08:53:28 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
08:27:46   Verbose  |       CurrentUser: deployuser
08:27:46   Verbose  |       HostName: p16-d-api-001.us16.kexpress.net
08:27:46   Verbose  |       ProcessorCount: 4
08:27:46   Verbose  |       CurrentDirectory: /home/deployuser/.octopus/OctopusServer/Work/20180704082738-62657-83
08:27:46   Verbose  |       TempDirectory: /tmp
08:27:46   Verbose  |       HostProcessID: 28289
08:27:46   Info     |       Hello, world!
08:27:49   Verbose  |       Another process is using the deployment journal
                    |     
                    |     Running: p16-d-api-002
08:27:38   Verbose  |       Octopus Server version: 2018.6.12+Branch.master.Sha.e78bdbd1f670618ec8f2da3f199bffe0c1777bab
08:27:38   Verbose  |       Environment Information:
                    |       OperatingSystem: Microsoft Windows NT 10.0.14393.0
                    |       OsBitVersion: x64
                    |       Is64BitProcess: True
                    |       CurrentUser: NT AUTHORITY\SYSTEM
                    |       MachineName: M1-OCTAPP-001
                    |       ProcessorCount: 4
                    |       CurrentDirectory: C:\Windows\system32
                    |       TempDirectory: C:\Windows\TEMP\
                    |       HostProcessName: Octopus.Server
                    |       PID: 95548
08:27:38   Verbose  |       Executing Echo Hello (type Run a Script) on p16-d-api-002
08:27:38   Verbose  |       Using Calamari 4.7.21
08:27:38   Verbose  |       Requesting upload...
08:27:38   Verbose  |       Establishing SSH connection...
08:27:39   Verbose  |       SSH connection established
08:27:40   Verbose  |       Beginning streaming transfer of command.sh to $HOME\.octopus\OctopusServer\Work\20180704082738-62657-84
08:27:40   Verbose  |       Establishing SFTP connection...
08:27:42   Verbose  |       SSFTP connection established
08:27:42   Verbose  |       Stream transfer complete
08:27:43   Verbose  |       Requesting upload...
08:27:44   Verbose  |       Beginning streaming transfer of Variables.secret to $HOME\.octopus\OctopusServer\Work\20180704082738-62657-84
08:27:44   Verbose  |       Stream transfer complete
08:27:46   Verbose  |       Octopus Deploy: Calamari version 4.7.21
08:27:46   Verbose  |       Environment Information:
08:27:46   Verbose  |       OperatingSystem: Unix 4.4.0.130
08:27:46   Verbose  |       OsBitVersion: x64
08:27:46   Verbose  |       Is64BitProcess: True
08:27:46   Verbose  |       Running on Mono: True
08:27:46   Verbose  |       CurrentUser: deployuser
08:27:46   Verbose  |       MachineName: p16-d-api-002.us16.kexpress.net
08:27:46   Verbose  |       ProcessorCount: 4
08:27:46   Verbose  |       CurrentDirectory: /home/deployuser/.octopus/OctopusServer/Work/20180704082738-62657-84
08:27:46   Verbose  |       TempDirectory: /tmp/
08:27:46   Verbose  |       HostProcessName: Calamari
08:27:46   Verbose  |       Executing '/home/deployuser/.octopus/OctopusServer/Work/20180704082738-62657-84/Script.sh'
08:27:47   Verbose  |       Bash Environment Information:
08:27:47   Verbose  |       OperatingSystem: Linux p16-d-api-002.us16.kexpress.net 4.4.0-130-generic #156-Ubuntu SMP Thu Jun 14 08:53:28 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
08:27:47   Verbose  |       CurrentUser: deployuser
08:27:47   Verbose  |       HostName: p16-d-api-002.us16.kexpress.net
08:27:47   Verbose  |       ProcessorCount: 4
08:27:47   Verbose  |       CurrentDirectory: /home/deployuser/.octopus/OctopusServer/Work/20180704082738-62657-84
08:27:47   Verbose  |       TempDirectory: /tmp
08:27:47   Verbose  |       HostProcessID: 8653
08:27:47   Info     |       Hello, world!
08:27:50   Verbose  |       Another process is using the deployment journal

Thanks,
Andy

2

I have managed to resolve this issue. The issue was the /tmp directory permissions were changed to 755 by a different process. This meant that the user used for deployment was unable to write a temporary file to this location. It looks like a temporary DeploymentJournal.xml is created in /tmp then moved to the correct location.

Once the folder permissions were changed back to 777, the deployment runs successfully.

4

Hi Andy,

Thanks for getting in touch! I’m glad to hear that you have resolved your issue!

Please don’t hesitate to get in touch if you have any other questions or run into any further issues. :slight_smile:

Best regards,
Daniel

5

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.