Octopus.Server.exe The process was terminated due to an unhandled exception

I am running Octopus Deploy 2.6.4.951. About once a week, the Octopus Web Portal is unavailable and the Octopus Manager shows that the Octopus Windows Service is stopped. I can get the Octopus Web Portal back online by just starting the Windows Service, but this is a recurring issue. I see in the Event Viewer two exceptions that were thrown at the time I was trying to visit the Octopus Web Portal. Here are the exceptions…

Log Name: Application
Source: .NET Runtime
Date: 7/31/2015 7:57:00 AM
Event ID: 1026
Task Category: None
Level: Error
Keywords: Classic
User: N/A
Computer: XXXXXXXXXXXXXXXXXXXX
Description:
Application: Octopus.Server.exe
Framework Version: v4.0.30319
Description: The process was terminated due to an unhandled exception.
Exception Info: System.Reflection.TargetInvocationException
Stack:
at System.RuntimeMethodHandle.InvokeMethod(System.Object, System.Object[], System.Signature, Boolean)
at System.Reflection.RuntimeMethodInfo.UnsafeInvokeInternal(System.Object, System.Object[], System.Object[])
at System.Delegate.DynamicInvokeImpl(System.Object[])
at System.ExecutionContextLightup.Run(System.ExecutionContextLightup, System.Action1<System.Object>, System.Object) at System.Runtime.CompilerServices.AsyncMethodBuilderCore+MoveNextRunner.Run() at Microsoft.Runtime.CompilerServices.TaskAwaiter.RunNoException(System.Action) at Microsoft.Runtime.CompilerServices.TaskAwaiter+<>c__DisplayClassa.<OnCompletedInternal>b__4(System.Threading.Tasks.Task) at System.Threading.Tasks.Task.Execute() at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object, Boolean) at System.Threading.ExecutionContext.Run(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object, Boolean) at System.Threading.Tasks.Task.ExecuteWithThreadLocal(System.Threading.Tasks.Task ByRef) at System.Threading.Tasks.Task.ExecuteEntry(Boolean) at System.Threading.Tasks.ThreadPoolTaskScheduler.TryExecuteTaskInline(System.Threading.Tasks.Task, Boolean) at System.Threading.Tasks.TaskScheduler.TryRunInline(System.Threading.Tasks.Task, Boolean) at System.Threading.Tasks.TaskContinuation.InlineIfPossibleOrElseQueue(System.Threading.Tasks.Task, Boolean) at System.Threading.Tasks.Task.FinishContinuations() at System.Threading.Tasks.Task1[[System.__Canon, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089]].TrySetResult(System.__Canon)
at System.Runtime.CompilerServices.AsyncTaskMethodBuilder1[[System.__Canon, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089]].SetResult(System.__Canon) at Raven.Client.LinqExtensions+<FirstOrDefaultAsync>d__2e1[[System.__Canon, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089]].MoveNext()
at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object, Boolean)
at System.Threading.ExecutionContext.Run(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object, Boolean)
at System.Threading.ExecutionContext.Run(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
at System.Runtime.CompilerServices.AsyncMethodBuilderCore+MoveNextRunner.Run()
at System.Runtime.CompilerServices.TaskAwaiter.RunNoException(System.Action)
at System.Runtime.CompilerServices.TaskAwaiter+<>c__DisplayClassa.b__4(System.Threading.Tasks.Task)
at System.Threading.Tasks.Task.Execute()
at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object, Boolean)
at System.Threading.ExecutionContext.Run(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object, Boolean)
at System.Threading.Tasks.Task.ExecuteWithThreadLocal(System.Threading.Tasks.Task ByRef)
at System.Threading.Tasks.Task.ExecuteEntry(Boolean)
at System.Threading.Tasks.ThreadPoolTaskScheduler.TryExecuteTaskInline(System.Threading.Tasks.Task, Boolean)
at System.Threading.Tasks.TaskScheduler.TryRunInline(System.Threading.Tasks.Task, Boolean)
at System.Threading.Tasks.TaskContinuation.InlineIfPossibleOrElseQueue(System.Threading.Tasks.Task, Boolean)
at System.Threading.Tasks.Task.FinishContinuations()
at System.Threading.Tasks.Task.Finish(Boolean)
at System.Threading.Tasks.Task.ExecuteWithThreadLocal(System.Threading.Tasks.Task ByRef)
at System.Threading.Tasks.Task.ExecuteEntry(Boolean)
at System.Threading.ThreadPoolWorkQueue.Dispatch()

Event Xml:



1026
2
0
0x80000000000000

704881
Application
XXXXXXXXXXXXXXXXXXXX



Application: Octopus.Server.exe
Framework Version: v4.0.30319
Description: The process was terminated due to an unhandled exception.
Exception Info: System.Reflection.TargetInvocationException
Stack:
at System.RuntimeMethodHandle.InvokeMethod(System.Object, System.Object[], System.Signature, Boolean)
at System.Reflection.RuntimeMethodInfo.UnsafeInvokeInternal(System.Object, System.Object[], System.Object[])
at System.Delegate.DynamicInvokeImpl(System.Object[])
at System.ExecutionContextLightup.Run(System.ExecutionContextLightup, System.Action1&lt;System.Object&gt;, System.Object) at System.Runtime.CompilerServices.AsyncMethodBuilderCore+MoveNextRunner.Run() at Microsoft.Runtime.CompilerServices.TaskAwaiter.RunNoException(System.Action) at Microsoft.Runtime.CompilerServices.TaskAwaiter+&lt;&gt;c__DisplayClassa.&lt;OnCompletedInternal&gt;b__4(System.Threading.Tasks.Task) at System.Threading.Tasks.Task.Execute() at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object, Boolean) at System.Threading.ExecutionContext.Run(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object, Boolean) at System.Threading.Tasks.Task.ExecuteWithThreadLocal(System.Threading.Tasks.Task ByRef) at System.Threading.Tasks.Task.ExecuteEntry(Boolean) at System.Threading.Tasks.ThreadPoolTaskScheduler.TryExecuteTaskInline(System.Threading.Tasks.Task, Boolean) at System.Threading.Tasks.TaskScheduler.TryRunInline(System.Threading.Tasks.Task, Boolean) at System.Threading.Tasks.TaskContinuation.InlineIfPossibleOrElseQueue(System.Threading.Tasks.Task, Boolean) at System.Threading.Tasks.Task.FinishContinuations() at System.Threading.Tasks.Task1[[System.__Canon, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089]].TrySetResult(System.__Canon)
at System.Runtime.CompilerServices.AsyncTaskMethodBuilder1[[System.__Canon, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089]].SetResult(System.__Canon) at Raven.Client.LinqExtensions+&lt;FirstOrDefaultAsync&gt;d__2e1[[System.__Canon, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089]].MoveNext()
at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object, Boolean)
at System.Threading.ExecutionContext.Run(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object, Boolean)
at System.Threading.ExecutionContext.Run(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
at System.Runtime.CompilerServices.AsyncMethodBuilderCore+MoveNextRunner.Run()
at System.Runtime.CompilerServices.TaskAwaiter.RunNoException(System.Action)
at System.Runtime.CompilerServices.TaskAwaiter+<>c__DisplayClassa.<OnCompletedInternal>b__4(System.Threading.Tasks.Task)
at System.Threading.Tasks.Task.Execute()
at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object, Boolean)
at System.Threading.ExecutionContext.Run(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object, Boolean)
at System.Threading.Tasks.Task.ExecuteWithThreadLocal(System.Threading.Tasks.Task ByRef)
at System.Threading.Tasks.Task.ExecuteEntry(Boolean)
at System.Threading.Tasks.ThreadPoolTaskScheduler.TryExecuteTaskInline(System.Threading.Tasks.Task, Boolean)
at System.Threading.Tasks.TaskScheduler.TryRunInline(System.Threading.Tasks.Task, Boolean)
at System.Threading.Tasks.TaskContinuation.InlineIfPossibleOrElseQueue(System.Threading.Tasks.Task, Boolean)
at System.Threading.Tasks.Task.FinishContinuations()
at System.Threading.Tasks.Task.Finish(Boolean)
at System.Threading.Tasks.Task.ExecuteWithThreadLocal(System.Threading.Tasks.Task ByRef)
at System.Threading.Tasks.Task.ExecuteEntry(Boolean)
at System.Threading.ThreadPoolWorkQueue.Dispatch()


Log Name: Application
Source: Application Error
Date: 7/31/2015 7:57:01 AM
Event ID: 1000
Task Category: (100)
Level: Error
Keywords: Classic
User: N/A
Computer: XXXXXXXXXXXXXXXXXXXX
Description:
Faulting application name: Octopus.Server.exe, version: 2.6.4.951, time stamp: 0x5507bc85
Faulting module name: KERNELBASE.dll, version: 6.3.9600.17415, time stamp: 0x54505737
Exception code: 0xe0434352
Fault offset: 0x0000000000008b9c
Faulting process id: 0x27c
Faulting application start time: 0x01d0c81da8f288ab
Faulting application path: D:\Program Files\Octopus Deploy\Octopus\Octopus.Server.exe
Faulting module path: C:\Windows\system32\KERNELBASE.dll
Report Id: 4021c710-377b-11e5-80ea-005056bb6512
Faulting package full name:
Faulting package-relative application ID:
Event Xml:



1000
2
100
0x80000000000000

704882
Application
XXXXXXXXXXXXXXXXXXXX



Octopus.Server.exe
2.6.4.951
5507bc85
KERNELBASE.dll
6.3.9600.17415
54505737
e0434352
0000000000008b9c
27c
01d0c81da8f288ab
D:\Program Files\Octopus Deploy\Octopus\Octopus.Server.exe
C:\Windows\system32\KERNELBASE.dll
4021c710-377b-11e5-80ea-005056bb6512





I did see a thread at http://help.octopusdeploy.com/discussions/problems/23371-octopus-crashing, which seems to be covering a similar issue, but the thread seems to have been abandoned and does not metion a resolution.

Hi,

Thanks for getting in touch. This crash is currently a known issue on 2.6 that seems to target only a handful of users, and for which we haven’t found a fix unfortunately. The current official fix is to upgrade to Octopus 3.0, which no longer uses the 2 technologies that were causing this issue and others (RavenDB and Lucene).

We’ve heard of users that were able to workaround this issue by following the instructions of the doc below. Still, it didn’t work on all cases unfortunately.

Sorry for the inconveniences

Dalmiro

I have tried visiting the link you provided, but none of the credentials I know works to get me past the login prompt.

Hi Mball,
Our apologies, but you should be able to access the documentation from the following link instead http://docs.octopusdeploy.com/display/OD2/Switch+from+single-threaded+workstation+GC+to+concurrent+server+GC
It is available in the area specifically focused on Octopus Deploy 2.x. Please let us know if you continue to have problems accessing the site.
Thanks
Robert