Auto-deploy trigger issues

HELP! this just started happening with upgrade to 2019.3.1 from 2019.3.0. Not sure if thats related. We have elastic environments using AWS autoscaling groups. on machine boot, tentacles are installed,registered, and autodeploy is supposed to kick off.

Server logs yield this:

Error when running scheduled task: Octopus.Server.Schedules.RunOnAScheduleAdapter`1[Octopus.Server.Schedules.ProcessAutoDeployments] System.ArgumentException: An item with the same key has already been added.
   at System.ThrowHelper.ThrowArgumentException(ExceptionResource resource)
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at System.Linq.Enumerable.ToDictionary[TSource,TKey,TElement](IEnumerable`1 source, Func`2 keySelector, Func`2 elementSelector, IEqualityComparer`1 comparer)
   at Octopus.Server.Schedules.AutoDeployments.MachineFilters.ProjectTenantedDeploymentModeMachineFilter..ctor(ILog log, IReadOnlyList`1 projects)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployMachineFiltererFactory.Create(IReadOnlyList`1 projects)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployItemBuilder.Build(IReadOnlyList`1 autoDeployTriggers, IReadOnlyList`1 latestSuccessfulDeployments, IReadOnlyList`1 projects, IReadOnlyList`1 autoDeployMachines)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployTriggerDeploymentCreator.ProcessEventsInSpace(IReadOnlyList`1 projects, IReadOnlyList`1 machines)
   at Octopus.Core.Spaces.SpaceContextSwitcherExtensions.<>c__DisplayClass0_0`1.<PerformInSpaceContext>b__0(TDependency dependency)
   at Octopus.Server.Web.Infrastructure.Spaces.SpaceContextSwitcher.PerformInSpaceContext[TDependency,TReturn](SpacePartitionsDefinition definition, Func`2 action)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployTriggerProcessor.ProcessEvents(Nullable`1 lastPassEventAutoId, Int64 upToEventAutoId)
   at Octopus.Server.Schedules.ProcessAutoDeployments.Trigger()
   at Octopus.Server.Schedules.Scheduler.RunTask(IRunOnASchedule schedule)
April 12th 2019 02:45:57Error
Error when running scheduled task: Octopus.Server.Schedules.RunOnAScheduleAdapter`1[Octopus.Server.Schedules.ProcessAutoDeployments] System.ArgumentException: An item with the same key has already been added.
   at System.ThrowHelper.ThrowArgumentException(ExceptionResource resource)
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at System.Linq.Enumerable.ToDictionary[TSource,TKey,TElement](IEnumerable`1 source, Func`2 keySelector, Func`2 elementSelector, IEqualityComparer`1 comparer)
   at Octopus.Server.Schedules.AutoDeployments.MachineFilters.ProjectTenantedDeploymentModeMachineFilter..ctor(ILog log, IReadOnlyList`1 projects)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployMachineFiltererFactory.Create(IReadOnlyList`1 projects)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployItemBuilder.Build(IReadOnlyList`1 autoDeployTriggers, IReadOnlyList`1 latestSuccessfulDeployments, IReadOnlyList`1 projects, IReadOnlyList`1 autoDeployMachines)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployTriggerDeploymentCreator.ProcessEventsInSpace(IReadOnlyList`1 projects, IReadOnlyList`1 machines)
   at Octopus.Core.Spaces.SpaceContextSwitcherExtensions.<>c__DisplayClass0_0`1.<PerformInSpaceContext>b__0(TDependency dependency)
   at Octopus.Server.Web.Infrastructure.Spaces.SpaceContextSwitcher.PerformInSpaceContext[TDependency,TReturn](SpacePartitionsDefinition definition, Func`2 action)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployTriggerProcessor.ProcessEvents(Nullable`1 lastPassEventAutoId, Int64 upToEventAutoId)
   at Octopus.Server.Schedules.ProcessAutoDeployments.Trigger()
   at Octopus.Server.Schedules.Scheduler.RunTask(IRunOnASchedule schedule)
April 12th 2019 02:46:27Error
Error when running scheduled task: Octopus.Server.Schedules.RunOnAScheduleAdapter`1[Octopus.Server.Schedules.ProcessAutoDeployments] System.ArgumentException: An item with the same key has already been added.
   at System.ThrowHelper.ThrowArgumentException(ExceptionResource resource)
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at System.Linq.Enumerable.ToDictionary[TSource,TKey,TElement](IEnumerable`1 source, Func`2 keySelector, Func`2 elementSelector, IEqualityComparer`1 comparer)
   at Octopus.Server.Schedules.AutoDeployments.MachineFilters.ProjectTenantedDeploymentModeMachineFilter..ctor(ILog log, IReadOnlyList`1 projects)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployMachineFiltererFactory.Create(IReadOnlyList`1 projects)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployItemBuilder.Build(IReadOnlyList`1 autoDeployTriggers, IReadOnlyList`1 latestSuccessfulDeployments, IReadOnlyList`1 projects, IReadOnlyList`1 autoDeployMachines)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployTriggerDeploymentCreator.ProcessEventsInSpace(IReadOnlyList`1 projects, IReadOnlyList`1 machines)
   at Octopus.Core.Spaces.SpaceContextSwitcherExtensions.<>c__DisplayClass0_0`1.<PerformInSpaceContext>b__0(TDependency dependency)
   at Octopus.Server.Web.Infrastructure.Spaces.SpaceContextSwitcher.PerformInSpaceContext[TDependency,TReturn](SpacePartitionsDefinition definition, Func`2 action)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployTriggerProcessor.ProcessEvents(Nullable`1 lastPassEventAutoId, Int64 upToEventAutoId)
   at Octopus.Server.Schedules.ProcessAutoDeployments.Trigger()
   at Octopus.Server.Schedules.Scheduler.RunTask(IRunOnASchedule schedule)
April 12th 2019 02:46:57Error
Error when running scheduled task: Octopus.Server.Schedules.RunOnAScheduleAdapter`1[Octopus.Server.Schedules.ProcessAutoDeployments] System.ArgumentException: An item with the same key has already been added.
   at System.ThrowHelper.ThrowArgumentException(ExceptionResource resource)
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at System.Linq.Enumerable.ToDictionary[TSource,TKey,TElement](IEnumerable`1 source, Func`2 keySelector, Func`2 elementSelector, IEqualityComparer`1 comparer)
   at Octopus.Server.Schedules.AutoDeployments.MachineFilters.ProjectTenantedDeploymentModeMachineFilter..ctor(ILog log, IReadOnlyList`1 projects)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployMachineFiltererFactory.Create(IReadOnlyList`1 projects)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployItemBuilder.Build(IReadOnlyList`1 autoDeployTriggers, IReadOnlyList`1 latestSuccessfulDeployments, IReadOnlyList`1 projects, IReadOnlyList`1 autoDeployMachines)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployTriggerDeploymentCreator.ProcessEventsInSpace(IReadOnlyList`1 projects, IReadOnlyList`1 machines)
   at Octopus.Core.Spaces.SpaceContextSwitcherExtensions.<>c__DisplayClass0_0`1.<PerformInSpaceContext>b__0(TDependency dependency)
   at Octopus.Server.Web.Infrastructure.Spaces.SpaceContextSwitcher.PerformInSpaceContext[TDependency,TReturn](SpacePartitionsDefinition definition, Func`2 action)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployTriggerProcessor.ProcessEvents(Nullable`1 lastPassEventAutoId, Int64 upToEventAutoId)
   at Octopus.Server.Schedules.ProcessAutoDeployments.Trigger()
   at Octopus.Server.Schedules.Scheduler.RunTask(IRunOnASchedule schedule)
April 12th 2019 02:47:27Error
Error when running scheduled task: Octopus.Server.Schedules.RunOnAScheduleAdapter`1[Octopus.Server.Schedules.ProcessAutoDeployments] System.ArgumentException: An item with the same key has already been added.
   at System.ThrowHelper.ThrowArgumentException(ExceptionResource resource)
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at System.Linq.Enumerable.ToDictionary[TSource,TKey,TElement](IEnumerable`1 source, Func`2 keySelector, Func`2 elementSelector, IEqualityComparer`1 comparer)
   at Octopus.Server.Schedules.AutoDeployments.MachineFilters.ProjectTenantedDeploymentModeMachineFilter..ctor(ILog log, IReadOnlyList`1 projects)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployMachineFiltererFactory.Create(IReadOnlyList`1 projects)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployItemBuilder.Build(IReadOnlyList`1 autoDeployTriggers, IReadOnlyList`1 latestSuccessfulDeployments, IReadOnlyList`1 projects, IReadOnlyList`1 autoDeployMachines)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployTriggerDeploymentCreator.ProcessEventsInSpace(IReadOnlyList`1 projects, IReadOnlyList`1 machines)
   at Octopus.Core.Spaces.SpaceContextSwitcherExtensions.<>c__DisplayClass0_0`1.<PerformInSpaceContext>b__0(TDependency dependency)
   at Octopus.Server.Web.Infrastructure.Spaces.SpaceContextSwitcher.PerformInSpaceContext[TDependency,TReturn](SpacePartitionsDefinition definition, Func`2 action)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployTriggerProcessor.ProcessEvents(Nullable`1 lastPassEventAutoId, Int64 upToEventAutoId)
   at Octopus.Server.Schedules.ProcessAutoDeployments.Trigger()
   at Octopus.Server.Schedules.Scheduler.RunTask(IRunOnASchedule schedule)
April 12th 2019 02:47:58Error
Error when running scheduled task: Octopus.Server.Schedules.RunOnAScheduleAdapter`1[Octopus.Server.Schedules.ProcessAutoDeployments] System.ArgumentException: An item with the same key has already been added.
   at System.ThrowHelper.ThrowArgumentException(ExceptionResource resource)
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at System.Linq.Enumerable.ToDictionary[TSource,TKey,TElement](IEnumerable`1 source, Func`2 keySelector, Func`2 elementSelector, IEqualityComparer`1 comparer)
   at Octopus.Server.Schedules.AutoDeployments.MachineFilters.ProjectTenantedDeploymentModeMachineFilter..ctor(ILog log, IReadOnlyList`1 projects)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployMachineFiltererFactory.Create(IReadOnlyList`1 projects)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployItemBuilder.Build(IReadOnlyList`1 autoDeployTriggers, IReadOnlyList`1 latestSuccessfulDeployments, IReadOnlyList`1 projects, IReadOnlyList`1 autoDeployMachines)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployTriggerDeploymentCreator.ProcessEventsInSpace(IReadOnlyList`1 projects, IReadOnlyList`1 machines)
   at Octopus.Core.Spaces.SpaceContextSwitcherExtensions.<>c__DisplayClass0_0`1.<PerformInSpaceContext>b__0(TDependency dependency)
   at Octopus.Server.Web.Infrastructure.Spaces.SpaceContextSwitcher.PerformInSpaceContext[TDependency,TReturn](SpacePartitionsDefinition definition, Func`2 action)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployTriggerProcessor.ProcessEvents(Nullable`1 lastPassEventAutoId, Int64 upToEventAutoId)
   at Octopus.Server.Schedules.ProcessAutoDeployments.Trigger()
   at Octopus.Server.Schedules.Scheduler.RunTask(IRunOnASchedule schedule)
April 12th 2019 02:48:28Error
Error when running scheduled task: Octopus.Server.Schedules.RunOnAScheduleAdapter`1[Octopus.Server.Schedules.ProcessAutoDeployments] System.ArgumentException: An item with the same key has already been added.
   at System.ThrowHelper.ThrowArgumentException(ExceptionResource resource)
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at System.Linq.Enumerable.ToDictionary[TSource,TKey,TElement](IEnumerable`1 source, Func`2 keySelector, Func`2 elementSelector, IEqualityComparer`1 comparer)
   at Octopus.Server.Schedules.AutoDeployments.MachineFilters.ProjectTenantedDeploymentModeMachineFilter..ctor(ILog log, IReadOnlyList`1 projects)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployMachineFiltererFactory.Create(IReadOnlyList`1 projects)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployItemBuilder.Build(IReadOnlyList`1 autoDeployTriggers, IReadOnlyList`1 latestSuccessfulDeployments, IReadOnlyList`1 projects, IReadOnlyList`1 autoDeployMachines)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployTriggerDeploymentCreator.ProcessEventsInSpace(IReadOnlyList`1 projects, IReadOnlyList`1 machines)
   at Octopus.Core.Spaces.SpaceContextSwitcherExtensions.<>c__DisplayClass0_0`1.<PerformInSpaceContext>b__0(TDependency dependency)
   at Octopus.Server.Web.Infrastructure.Spaces.SpaceContextSwitcher.PerformInSpaceContext[TDependency,TReturn](SpacePartitionsDefinition definition, Func`2 action)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployTriggerProcessor.ProcessEvents(Nullable`1 lastPassEventAutoId, Int64 upToEventAutoId)
   at Octopus.Server.Schedules.ProcessAutoDeployments.Trigger()
   at Octopus.Server.Schedules.Scheduler.RunTask(IRunOnASchedule schedule)
April 12th 2019 02:48:58Error
Error when running scheduled task: Octopus.Server.Schedules.RunOnAScheduleAdapter`1[Octopus.Server.Schedules.ProcessAutoDeployments] System.ArgumentException: An item with the same key has already been added.
   at System.ThrowHelper.ThrowArgumentException(ExceptionResource resource)
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at System.Linq.Enumerable.ToDictionary[TSource,TKey,TElement](IEnumerable`1 source, Func`2 keySelector, Func`2 elementSelector, IEqualityComparer`1 comparer)
   at Octopus.Server.Schedules.AutoDeployments.MachineFilters.ProjectTenantedDeploymentModeMachineFilter..ctor(ILog log, IReadOnlyList`1 projects)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployMachineFiltererFactory.Create(IReadOnlyList`1 projects)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployItemBuilder.Build(IReadOnlyList`1 autoDeployTriggers, IReadOnlyList`1 latestSuccessfulDeployments, IReadOnlyList`1 projects, IReadOnlyList`1 autoDeployMachines)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployTriggerDeploymentCreator.ProcessEventsInSpace(IReadOnlyList`1 projects, IReadOnlyList`1 machines)
   at Octopus.Core.Spaces.SpaceContextSwitcherExtensions.<>c__DisplayClass0_0`1.<PerformInSpaceContext>b__0(TDependency dependency)
   at Octopus.Server.Web.Infrastructure.Spaces.SpaceContextSwitcher.PerformInSpaceContext[TDependency,TReturn](SpacePartitionsDefinition definition, Func`2 action)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployTriggerProcessor.ProcessEvents(Nullable`1 lastPassEventAutoId, Int64 upToEventAutoId)
   at Octopus.Server.Schedules.ProcessAutoDeployments.Trigger()
   at Octopus.Server.Schedules.Scheduler.RunTask(IRunOnASchedule schedule)
April 12th 2019 02:49:28Error
Error when running scheduled task: Octopus.Server.Schedules.RunOnAScheduleAdapter`1[Octopus.Server.Schedules.ProcessAutoDeployments] System.ArgumentException: An item with the same key has already been added.
   at System.ThrowHelper.ThrowArgumentException(ExceptionResource resource)
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at System.Linq.Enumerable.ToDictionary[TSource,TKey,TElement](IEnumerable`1 source, Func`2 keySelector, Func`2 elementSelector, IEqualityComparer`1 comparer)
   at Octopus.Server.Schedules.AutoDeployments.MachineFilters.ProjectTenantedDeploymentModeMachineFilter..ctor(ILog log, IReadOnlyList`1 projects)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployMachineFiltererFactory.Create(IReadOnlyList`1 projects)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployItemBuilder.Build(IReadOnlyList`1 autoDeployTriggers, IReadOnlyList`1 latestSuccessfulDeployments, IReadOnlyList`1 projects, IReadOnlyList`1 autoDeployMachines)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployTriggerDeploymentCreator.ProcessEventsInSpace(IReadOnlyList`1 projects, IReadOnlyList`1 machines)
   at Octopus.Core.Spaces.SpaceContextSwitcherExtensions.<>c__DisplayClass0_0`1.<PerformInSpaceContext>b__0(TDependency dependency)
   at Octopus.Server.Web.Infrastructure.Spaces.SpaceContextSwitcher.PerformInSpaceContext[TDependency,TReturn](SpacePartitionsDefinition definition, Func`2 action)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployTriggerProcessor.ProcessEvents(Nullable`1 lastPassEventAutoId, Int64 upToEventAutoId)
   at Octopus.Server.Schedules.ProcessAutoDeployments.Trigger()
   at Octopus.Server.Schedules.Scheduler.RunTask(IRunOnASchedule schedule)
April 12th 2019 02:49:59Error
Error when running scheduled task: Octopus.Server.Schedules.RunOnAScheduleAdapter`1[Octopus.Server.Schedules.ProcessAutoDeployments] System.ArgumentException: An item with the same key has already been added.
   at System.ThrowHelper.ThrowArgumentException(ExceptionResource resource)
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at System.Linq.Enumerable.ToDictionary[TSource,TKey,TElement](IEnumerable`1 source, Func`2 keySelector, Func`2 elementSelector, IEqualityComparer`1 comparer)
   at Octopus.Server.Schedules.AutoDeployments.MachineFilters.ProjectTenantedDeploymentModeMachineFilter..ctor(ILog log, IReadOnlyList`1 projects)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployMachineFiltererFactory.Create(IReadOnlyList`1 projects)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployItemBuilder.Build(IReadOnlyList`1 autoDeployTriggers, IReadOnlyList`1 latestSuccessfulDeployments, IReadOnlyList`1 projects, IReadOnlyList`1 autoDeployMachines)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployTriggerDeploymentCreator.ProcessEventsInSpace(IReadOnlyList`1 projects, IReadOnlyList`1 machines)
   at Octopus.Core.Spaces.SpaceContextSwitcherExtensions.<>c__DisplayClass0_0`1.<PerformInSpaceContext>b__0(TDependency dependency)
   at Octopus.Server.Web.Infrastructure.Spaces.SpaceContextSwitcher.PerformInSpaceContext[TDependency,TReturn](SpacePartitionsDefinition definition, Func`2 action)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployTriggerProcessor.ProcessEvents(Nullable`1 lastPassEventAutoId, Int64 upToEventAutoId)
   at Octopus.Server.Schedules.ProcessAutoDeployments.Trigger()
   at Octopus.Server.Schedules.Scheduler.RunTask(IRunOnASchedule schedule)
April 12th 2019 02:50:29Error
Error when running scheduled task: Octopus.Server.Schedules.RunOnAScheduleAdapter`1[Octopus.Server.Schedules.ProcessAutoDeployments] System.ArgumentException: An item with the same key has already been added.
   at System.ThrowHelper.ThrowArgumentException(ExceptionResource resource)
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at System.Linq.Enumerable.ToDictionary[TSource,TKey,TElement](IEnumerable`1 source, Func`2 keySelector, Func`2 elementSelector, IEqualityComparer`1 comparer)
   at Octopus.Server.Schedules.AutoDeployments.MachineFilters.ProjectTenantedDeploymentModeMachineFilter..ctor(ILog log, IReadOnlyList`1 projects)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployMachineFiltererFactory.Create(IReadOnlyList`1 projects)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployItemBuilder.Build(IReadOnlyList`1 autoDeployTriggers, IReadOnlyList`1 latestSuccessfulDeployments, IReadOnlyList`1 projects, IReadOnlyList`1 autoDeployMachines)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployTriggerDeploymentCreator.ProcessEventsInSpace(IReadOnlyList`1 projects, IReadOnlyList`1 machines)
   at Octopus.Core.Spaces.SpaceContextSwitcherExtensions.<>c__DisplayClass0_0`1.<PerformInSpaceContext>b__0(TDependency dependency)
   at Octopus.Server.Web.Infrastructure.Spaces.SpaceContextSwitcher.PerformInSpaceContext[TDependency,TReturn](SpacePartitionsDefinition definition, Func`2 action)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployTriggerProcessor.ProcessEvents(Nullable`1 lastPassEventAutoId, Int64 upToEventAutoId)
   at Octopus.Server.Schedules.ProcessAutoDeployments.Trigger()
   at Octopus.Server.Schedules.Scheduler.RunTask(IRunOnASchedule schedule)
April 12th 2019 02:51:00Error
Error when running scheduled task: Octopus.Server.Schedules.RunOnAScheduleAdapter`1[Octopus.Server.Schedules.ProcessAutoDeployments] System.ArgumentException: An item with the same key has already been added.
   at System.ThrowHelper.ThrowArgumentException(ExceptionResource resource)
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at System.Linq.Enumerable.ToDictionary[TSource,TKey,TElement](IEnumerable`1 source, Func`2 keySelector, Func`2 elementSelector, IEqualityComparer`1 comparer)
   at Octopus.Server.Schedules.AutoDeployments.MachineFilters.ProjectTenantedDeploymentModeMachineFilter..ctor(ILog log, IReadOnlyList`1 projects)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployMachineFiltererFactory.Create(IReadOnlyList`1 projects)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployItemBuilder.Build(IReadOnlyList`1 autoDeployTriggers, IReadOnlyList`1 latestSuccessfulDeployments, IReadOnlyList`1 projects, IReadOnlyList`1 autoDeployMachines)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployTriggerDeploymentCreator.ProcessEventsInSpace(IReadOnlyList`1 projects, IReadOnlyList`1 machines)
   at Octopus.Core.Spaces.SpaceContextSwitcherExtensions.<>c__DisplayClass0_0`1.<PerformInSpaceContext>b__0(TDependency dependency)
   at Octopus.Server.Web.Infrastructure.Spaces.SpaceContextSwitcher.PerformInSpaceContext[TDependency,TReturn](SpacePartitionsDefinition definition, Func`2 action)
   at Octopus.Server.Schedules.AutoDeployments.AutoDeployTriggerProcessor.ProcessEvents(Nullable`1 lastPassEventAutoId, Int64 upToEventAutoId)
   at Octopus.Server.Schedules.ProcessAutoDeployments.Trigger()
   at Octopus.Server.Schedules.Scheduler.RunTask(IRunOnASchedule schedule)
April 12th 2019 02:51:30Error
Error when running scheduled task: Octopus.Server.Schedules.RunOnAScheduleAdapter`1[Octopus.Server.Schedules.ProcessAutoDeployments] System.ArgumentException: An item with the same key has already been added.
   at System.ThrowHelper.ThrowArgumentException(ExceptionResource resource)
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue .....................................

Hi @JayClark

Sorry that you’ve run into an issue, unfortunately this is something that was introduced in 2019.3.1.

We have opened an issue for it here and will ship a patch as soon as we can. The work around for now would be disable all but one auto-deploy trigger (as it is multiple triggers that is causing the issue to appear at this point).

Any questions pleas let me know,

Regards,
Alex

Ok that would be very helpful. For now we have just turned off autoscaling in EC2. I cannot keep up with all the deployments Octopus handles for us… Thank You.

@Alex.Rolley - is there any updates on this one? we are having to leave our web cluster at full capacity and its costs a ton of money. :frowning:

Hi @JayClark,

Thanks for you patience on this one. We thought we had it sorted and ready to ship yesterday, unfortunately when we checked the fix in a bunch of our tests blew up and we weren’t able to get it sorted in time to ship before the easter long weekend.

We should have this fix out the door early next week, I would hope shipping Wednesday AEST (as in Australia we also have Monday off as part of the long weekend).

I’ll keep you updated as we go,

Regards,
Alex

200OK

@Alex.Rolley -

Any updates? :frowning:

Jay

Hi @JayClark

Sorry about the dropped ball here. I checked with the engineer working on the fix and he advised it will be out in our LTS stream by COB Thursday AEST, or within 48 hours of this post.

Thanks for your patience, I know that it’s been costing you money not being able to scale your instances.

Regards,
Alex

Hi @JayClark

Octopus 2019.3.3 has been released with the fix for auto-deploys included. If you can upgrade and advise if there are any ongoing issues that would be greatly appreciated.

Thanks @JayClark

Regards,
Alex

so far it looks good

Thank @JayClark, that’s good news.

If anything pops up please let us know.

Regards,
Alex

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.