Calamari Update Not Working

Our Octopus server version is: v2021.1 (build 7622). We have over 600 deployment targets. The tentacle version on all of them is up-to-date and the same, version: 6.1.670. However, ~190 of these targets show that a Calamari update is needed. All these are targets are Windows server. Some 2016 and some 2019. I’ve run the update multiple times. It finishes the update successfully, no errors. However, the same number of deployment targets (or sometimes even more) still show that Calamari needs to be updated. This includes some 2016 and some 2019 servers.

The Calamari version on the machines that show as needing Calamari updated is: Calamari Version: 18.1.3 I can’t find how to see the Calamari version on targets that don’t show a need for upgrading Calamari.

Why does Octopus show that Calamari still needs to be updated after the update appears to have run successfully?

Here’s an example: the health check output:

Task ID: ServerTasks-5318503
Related IDs: Machines-5479, Spaces-1
Task status: Success
Task queued: Monday, 23 August 2021 2:48:36 PM +00:00
Task started: Monday, 23 August 2021 2:48:36 PM +00:00
Task completed: Monday, 23 August 2021 2:48:37 PM +00:00
Task duration: 1 second
Server version: 2021.1.7622+Branch.release-2021.1.Sha.39b078a79acb886339204ac0a98553baf720ae75
Server node: EC2AMAZ-V9LR1F2

                | == Success: Check RateServer-PROD-F-i-08a057f3a5c05ebc3 health ==

14:48:36 Info | Starting health check for a limited set of machines.
14:48:36 Verbose | Health check was requested for 1 machine
14:48:36 Verbose | Found 1 matching machine
14:48:36 Info | Performing health check on 1 machine.
14:48:37 Verbose | Checking for Tentacles to update
|
| == Success: Check deployment target: RateServer-PROD-F-i-08a057f3a5c05ebc3 ==
14:48:36 Verbose | Performing health check on machine
14:48:36 Verbose | Executable directory is C:\Windows\system32\WindowsPowershell\v1.0
14:48:36 Verbose | Executable name or full path: C:\Windows\system32\WindowsPowershell\v1.0\PowerShell.exe
14:48:36 Verbose | No user context provided. Running as current user.
14:48:36 Verbose | Starting C:\Windows\system32\WindowsPowershell\v1.0\PowerShell.exe in working directory ‘D:\Octopus\Work\20210823144836-5318503-25’ using ‘OEM United States’ encoding running as ‘NT AUTHORITY\SYSTEM’ with the same environment variables as the launching process
14:48:37 Verbose | Process C:\Windows\system32\WindowsPowershell\v1.0\PowerShell.exe in D:\Octopus\Work\20210823144836-5318503-25 exited with code 0
14:48:37 Verbose | Exit code: 0
14:48:37 Verbose | Executable directory is C:\Windows\system32\WindowsPowershell\v1.0
14:48:37 Verbose | Executable name or full path: C:\Windows\system32\WindowsPowershell\v1.0\PowerShell.exe
14:48:37 Verbose | No user context provided. Running as current user.
14:48:37 Verbose | Starting C:\Windows\system32\WindowsPowershell\v1.0\PowerShell.exe in working directory ‘D:\Octopus\Work\20210823144837-5318503-26’ using ‘OEM United States’ encoding running as ‘NT AUTHORITY\SYSTEM’ with the same environment variables as the launching process
14:48:37 Info | Host Name: IP-0A0053F5
14:48:37 Info | Running As: WORKGROUP\SYSTEM (Local Administrator: True)
14:48:37 Info | Running Tentacle version 6.1.670
14:48:37 Info | Tentacle communication uses a ‘sha256RSA’ certificate
14:48:37 Info | Drive C: has 104 GB available
14:48:37 Info | Drive D: has 1023 GB available
14:48:37 Verbose | Process C:\Windows\system32\WindowsPowershell\v1.0\PowerShell.exe in D:\Octopus\Work\20210823144837-5318503-26 exited with code 0
14:48:37 Verbose | Exit code: 0
14:48:37 Verbose | Checking if Calamari should be installed or updated
14:48:37 Verbose | Recording health check results
|
| == Success: Summary ==
14:48:37 Info | Online:
14:48:37 Info | - RateServer-PROD-F-i-08a057f3a5c05ebc3 at https://10.0.83.245:10933/, running version 6.1.670
|

Same machine, after health check shows Calamari update needed (see attached file).

Again, after the health check, running the Calamari update: here’s the output from that tasks run:
Task ID: ServerTasks-5318516
Related IDs: Machines-5479, Spaces-1
Task status: Success
Task queued: Monday, 23 August 2021 2:52:03 PM +00:00
Task started: Monday, 23 August 2021 2:52:03 PM +00:00
Task completed: Monday, 23 August 2021 2:52:05 PM +00:00
Task duration: 2 seconds
Server version: 2021.1.7622+Branch.release-2021.1.Sha.39b078a79acb886339204ac0a98553baf720ae75
Server node: EC2AMAZ-V9LR1F2

                | == Success: Update Calamari on RateServer-PROD-F-i-08a057f3a5c05ebc3 ==

14:52:03 Verbose | Cleaning up completed UpdateCalamari tasks. Deleting 0 finished tasks…
14:52:03 Info | 1 machine will have Calamari updated to the latest version.
14:52:05 Verbose | Checking for Tentacles to update
|
| == Success: RateServer-PROD-F-i-08a057f3a5c05ebc3 ==
14:52:03 Verbose | Updating Calamari
14:52:03 Verbose | Executable directory is C:\Windows\system32\WindowsPowershell\v1.0
14:52:03 Verbose | Executable name or full path: C:\Windows\system32\WindowsPowershell\v1.0\PowerShell.exe
14:52:03 Verbose | No user context provided. Running as current user.
14:52:03 Verbose | Starting C:\Windows\system32\WindowsPowershell\v1.0\PowerShell.exe in working directory ‘D:\Octopus\Work\20210823145203-5318516-29’ using ‘OEM United States’ encoding running as ‘NT AUTHORITY\SYSTEM’ with the same environment variables as the launching process
14:52:04 Verbose | Process C:\Windows\system32\WindowsPowershell\v1.0\PowerShell.exe in D:\Octopus\Work\20210823145203-5318516-29 exited with code 0
14:52:04 Verbose | Using Calamari.win-x64 18.1.3
14:52:04 Verbose | Executable directory is C:\Windows\system32\WindowsPowershell\v1.0
14:52:04 Verbose | Executable name or full path: C:\Windows\system32\WindowsPowershell\v1.0\PowerShell.exe
14:52:04 Verbose | No user context provided. Running as current user.
14:52:04 Verbose | Starting C:\Windows\system32\WindowsPowershell\v1.0\PowerShell.exe in working directory ‘D:\Octopus\Work\20210823145204-5318516-30’ using ‘OEM United States’ encoding running as ‘NT AUTHORITY\SYSTEM’ with the same environment variables as the launching process
14:52:04 Verbose | Calamari Version: 18.1.3
14:52:04 Verbose | Process C:\Windows\system32\WindowsPowershell\v1.0\PowerShell.exe in D:\Octopus\Work\20210823145204-5318516-30 exited with code 0
14:52:04 Verbose | Exit code: 0
14:52:04 Verbose | Performing health check on machine
14:52:04 Verbose | Executable directory is C:\Windows\system32\WindowsPowershell\v1.0
14:52:04 Verbose | Executable name or full path: C:\Windows\system32\WindowsPowershell\v1.0\PowerShell.exe
14:52:04 Verbose | No user context provided. Running as current user.
14:52:04 Verbose | Starting C:\Windows\system32\WindowsPowershell\v1.0\PowerShell.exe in working directory ‘D:\Octopus\Work\20210823145204-5318516-31’ using ‘OEM United States’ encoding running as ‘NT AUTHORITY\SYSTEM’ with the same environment variables as the launching process
14:52:04 Verbose | Process C:\Windows\system32\WindowsPowershell\v1.0\PowerShell.exe in D:\Octopus\Work\20210823145204-5318516-31 exited with code 0
14:52:04 Verbose | Exit code: 0
14:52:05 Verbose | Executable directory is C:\Windows\system32\WindowsPowershell\v1.0
14:52:05 Verbose | Executable name or full path: C:\Windows\system32\WindowsPowershell\v1.0\PowerShell.exe
14:52:05 Verbose | No user context provided. Running as current user.
14:52:05 Verbose | Starting C:\Windows\system32\WindowsPowershell\v1.0\PowerShell.exe in working directory ‘D:\Octopus\Work\20210823145204-5318516-32’ using ‘OEM United States’ encoding running as ‘NT AUTHORITY\SYSTEM’ with the same environment variables as the launching process
14:52:05 Info | Host Name: IP-0A0053F5
14:52:05 Info | Running As: WORKGROUP\SYSTEM (Local Administrator: True)
14:52:05 Info | Running Tentacle version 6.1.670
14:52:05 Info | Tentacle communication uses a ‘sha256RSA’ certificate
14:52:05 Info | Drive C: has 104 GB available
14:52:05 Info | Drive D: has 1023 GB available
14:52:05 Verbose | Process C:\Windows\system32\WindowsPowershell\v1.0\PowerShell.exe in D:\Octopus\Work\20210823145204-5318516-32 exited with code 0
14:52:05 Verbose | Exit code: 0
14:52:05 Verbose | Checking if Calamari should be installed or updated
14:52:05 Verbose | Recording health check results
|
| == Success: Summary ==
14:52:05 Info | Online:
14:52:05 Info | - RateServer-PROD-F-i-08a057f3a5c05ebc3 at https://10.0.83.245:10933/, running version 6.1.670

Hi Bob,

Thank you for reaching out to us.

It looks like this is a known issue that has already been passed to our engineering team:

The bug is purely with the upgrade notification as the Calamari updates do complete successfully. You can safely ignore the update prompts until a fix is developed.

I hope this is helpful. Please let me know if you have any questions.

Best Regards,

Charles

1 Like

ok, thanks for getting back to me Charles!

1 Like

This topic was automatically closed 31 days after the last reply. New replies are no longer allowed.