Failure after upgrade from 2.6 to 2.6.4

Today we have upgraded to the latest version of Octopus and the setup was quite silent and quick as usual. After the upgrade we have restarted our Octopus server and we noticed that the publish service and the internal nuget repository of Octopus was not working anymore. After further investigations we saw that the entire system is not working anymore.

We also run a reindex of the RavenDB from the Octopus server console but nothing happen. It seems that Lucene and RavenDB repositories are now somehow corrupted. Can you please help us, this is quite an urgent issue.

This is what we get from the logs:
*RavenDB
2015-04-01 17:13:45.3548 6 ERROR Could not re-lease subscription license
Octopus
2015-04-01 17:13:57.2928 6 ERROR An exception was thrown while invoking the constructor ‘Void .ctor(Octopus.Platform.Deployment.Configuration.IHomeConfiguration)’ on type ‘BuiltInPackageRepositoryFactory’. —> Could not find file ‘C:\Program Files\Octopus Deploy\Octopus\Data\OctopusServer\Repository\Index_82d.fnm’. (See inner exception for details.)
Autofac.Core.DependencyResolutionException: An exception was thrown while invoking the constructor ‘Void .ctor(Octopus.Platform.Deployment.Configuration.IHomeConfiguration)’ on type ‘BuiltInPackageRepositoryFactory’. —> Could not find file ‘C:\Program Files\Octopus Deploy\Octopus\Data\OctopusServer\Repository\Index_82d.fnm’. (See inner exception for details.) —> System.IO.FileNotFoundException: Could not find file ‘C:\Program Files\Octopus Deploy\Octopus\Data\OctopusServer\Repository\Index_82d.fnm’.
at Lucene.Net.Index.SegmentInfos.FindSegmentsFile.Run(IndexCommit commit) in d:\Lucene.Net\FullRepo\trunk\src\core\Index\SegmentInfos.cs:line 585
at Lucene.Net.Linq.Context.CreateSearcher()
at Lucene.Net.Linq.Context.get_CurrentTracker()
at Lucene.Net.Linq.LuceneQueryExecutorBase1.ExecuteScalar[T](QueryModel queryModel) at Remotion.Linq.Clauses.StreamedData.StreamedScalarValueInfo.ExecuteScalarQueryModel[T](QueryModel queryModel, IQueryExecutor executor) at Remotion.Linq.Clauses.StreamedData.StreamedScalarValueInfo.ExecuteQueryModel(QueryModel queryModel, IQueryExecutor executor) at Remotion.Linq.QueryProviderBase.System.Linq.IQueryProvider.Execute[TResult](Expression expression) at System.Linq.Queryable.Count[TSource](IQueryable1 source)
at NuGet.Lucene.LucenePackageRepository.UpdatePackageCount(IQueryable1 packages) at NuGet.Lucene.LuceneRepositoryConfigurator.Initialize() at Octopus.Server.BuiltInFeed.BuiltInPackageRepositoryFactory..ctor(IHomeConfiguration configuration) in y:\work\refs\heads\master\source\Octopus.Server\BuiltInFeed\BuiltInPackageRepositoryFactory.cs:line 35 at lambda_method(Closure , Object[] ) at Autofac.Core.Activators.Reflection.ConstructorParameterBinding.Instantiate() --- End of inner exception stack trace --- at Autofac.Core.Activators.Reflection.ConstructorParameterBinding.Instantiate() at Autofac.Core.Activators.Reflection.ReflectionActivator.ActivateInstance(IComponentContext context, IEnumerable1 parameters)
at Autofac.Core.Resolving.InstanceLookup.Activate(IEnumerable1 parameters) at Autofac.Core.Lifetime.LifetimeScope.GetOrCreateAndShare(Guid id, Func1 creator)
at Autofac.Core.Resolving.InstanceLookup.Execute()
at Autofac.Core.Resolving.ResolveOperation.GetOrCreateInstance(ISharingLifetimeScope currentOperationScope, IComponentRegistration registration, IEnumerable1 parameters) at Autofac.ResolutionExtensions.TryResolveService(IComponentContext context, Service service, IEnumerable1 parameters, Object& instance)
at Autofac.ResolutionExtensions.ResolveOptional[TService](IComponentContext context, IEnumerable1 parameters) at Octopus.Shared.Packages.NuGetModule.<Load>b__1(IComponentContext c) in y:\work\refs\heads\master\source\Octopus.Shared\Packages\NuGetModule.cs:line 20 at Autofac.Builder.RegistrationBuilder.<>c__DisplayClass11.b__0(IComponentContext c, IEnumerable1 p) at Autofac.Core.Activators.Delegate.DelegateActivator.ActivateInstance(IComponentContext context, IEnumerable1 parameters)
at Autofac.Core.Resolving.InstanceLookup.Activate(IEnumerable1 parameters) at Autofac.Core.Resolving.InstanceLookup.Execute() at Autofac.Core.Resolving.ResolveOperation.GetOrCreateInstance(ISharingLifetimeScope currentOperationScope, IComponentRegistration registration, IEnumerable1 parameters)
at Autofac.Core.Activators.Reflection.ConstructorParameterBinding.Instantiate()
at Autofac.Core.Activators.Reflection.ReflectionActivator.ActivateInstance(IComponentContext context, IEnumerable1 parameters) at Autofac.Core.Resolving.InstanceLookup.Activate(IEnumerable1 parameters)
at Autofac.Core.Resolving.InstanceLookup.Execute()
at Autofac.Core.Resolving.ResolveOperation.GetOrCreateInstance(ISharingLifetimeScope currentOperationScope, IComponentRegistration registration, IEnumerable1 parameters) at Autofac.Features.Metadata.MetaRegistrationSource.<>c__DisplayClass41.b__3(IComponentContext c, IEnumerable1 p) at Autofac.Builder.RegistrationBuilder.<>c__DisplayClass11.b__0(IComponentContext c, IEnumerable1 p) at Autofac.Core.Activators.Delegate.DelegateActivator.ActivateInstance(IComponentContext context, IEnumerable1 parameters)
at Autofac.Core.Resolving.InstanceLookup.Activate(IEnumerable1 parameters) at Autofac.Core.Resolving.InstanceLookup.Execute() at Autofac.Core.Resolving.ResolveOperation.GetOrCreateInstance(ISharingLifetimeScope currentOperationScope, IComponentRegistration registration, IEnumerable1 parameters)
at System.Linq.Enumerable.WhereSelectArrayIterator2.MoveNext() at System.Linq.Buffer1…ctor(IEnumerable1 source) at System.Linq.Enumerable.ToArray[TSource](IEnumerable1 source)
at Autofac.Features.Collections.CollectionRegistrationSource.<>c__DisplayClass4.b__0(IComponentContext c, IEnumerable1 p) at Autofac.Core.Activators.Delegate.DelegateActivator.ActivateInstance(IComponentContext context, IEnumerable1 parameters)
at Autofac.Core.Resolving.InstanceLookup.Activate(IEnumerable1 parameters) at Autofac.Core.Resolving.InstanceLookup.Execute() at Autofac.Core.Resolving.ResolveOperation.GetOrCreateInstance(ISharingLifetimeScope currentOperationScope, IComponentRegistration registration, IEnumerable1 parameters)
at Autofac.ResolutionExtensions.ResolveService(IComponentContext context, Service service, IEnumerable1 parameters) at Autofac.ResolutionExtensions.Resolve[TService](IComponentContext context, IEnumerable1 parameters)
at Octopus.Shared.Communications.PipefishModule.b__5(IActivatingEventArgs1 e) in y:\work\refs\heads\master\source\Octopus.Shared\Communications\PipefishModule.cs:line 90 at Autofac.Builder.RegistrationBuilder3.<>c__DisplayClass6.b__5(Object s, ActivatingEventArgs1 e) at Autofac.Core.Registration.ComponentRegistration.RaiseActivating(IComponentContext context, IEnumerable1 parameters, Object& instance)
at Autofac.Core.Resolving.InstanceLookup.Activate(IEnumerable1 parameters) at Autofac.Core.Lifetime.LifetimeScope.GetOrCreateAndShare(Guid id, Func1 creator)
at Autofac.Core.Resolving.InstanceLookup.Execute()
at Autofac.Core.Resolving.ResolveOperation.GetOrCreateInstance(ISharingLifetimeScope currentOperationScope, IComponentRegistration registration, IEnumerable1 parameters) at Autofac.Core.Activators.Reflection.ConstructorParameterBinding.Instantiate() at Autofac.Core.Activators.Reflection.ReflectionActivator.ActivateInstance(IComponentContext context, IEnumerable1 parameters)
at Autofac.Core.Resolving.InstanceLookup.Activate(IEnumerable1 parameters) at Autofac.Core.Lifetime.LifetimeScope.GetOrCreateAndShare(Guid id, Func1 creator)
at Autofac.Core.Resolving.InstanceLookup.Execute()
at Autofac.Core.Resolving.ResolveOperation.GetOrCreateInstance(ISharingLifetimeScope currentOperationScope, IComponentRegistration registration, IEnumerable1 parameters) at Autofac.Core.Resolving.ResolveOperation.Execute(IComponentRegistration registration, IEnumerable1 parameters)
at Autofac.Features.LazyDependencies.LazyRegistrationSource.<>c__DisplayClass51.<>c__DisplayClass7.<CreateLazyRegistration>b__4() at System.Lazy1.CreateValue()
at System.Lazy`1.LazyInitValue()
at Octopus.Server.OctopusServerEngine.Start() in y:\work\refs\heads\master\source\Octopus.Server\OctopusServerEngine.cs:line 57
at Octopus.Server.Commands.RunCommand.Start() in y:\work\refs\heads\master\source\Octopus.Server\Commands\RunCommand.cs:line 21
at Octopus.Shared.Startup.AbstractCommand.Octopus.Shared.Startup.ICommand.Start(String[] commandLineArguments, ICommandRuntime commandRuntime, OptionSet commonOptions) in y:\work\refs\heads\master\source\Octopus.Shared\Startup\AbstractCommand.cs:line 55
at Octopus.Shared.Startup.WindowsServiceHost.<>c__DisplayClass2.b__0() in y:\work\refs\heads\master\source\Octopus.Shared\Startup\WindowsServiceHost.cs:line 19
at Octopus.Shared.Startup.WindowsServiceAdapter.RunService() in y:\work\refs\heads\master\source\Octopus.Shared\Startup\WindowsServiceAdapter.cs:line 44

Found the problem, somehow the indexes of Lucene were deleted by a sys admin task but I luckily found them into the recycle bin and restored them
Everything is working now

Hi Raffaele,

I am glad you found the issue. When 3.0 comes out, situations like this should not be possible.

Vanessa

Thank you so much Vanessa, we just updated our license agreement and we are
eager to test Octopus v 3.0 when it will come out.
Any ETA?

Raf

Hi Raf,

Pre-release in the next week or two. Stable release around June*.
(*All dates are subject to change, and not at the whim of the support staff :wink: )

Vanessa