Deploying older releases pre-configascode fail

terjered · 12 September 2023 09:27

I have updated our On-Prem test instance to newest available recommended for self-hosted instances.

While testing it seems that all releases that’s not created using Config-as-code will now fail to deploy with an error, for all Config-as-code projects. Other projects not using CaC works with no issue.

Now this has happen before in an earlier version, which is why this is specifically tested when we update.

Currently this means we can’t stay updated, anyone have similar issues?

clare.martin · 12 September 2023 10:18

Good morning @terjered,

Thank you for contacting Octopus Support and welcome to the forums! I am sorry to hear your projects that are Config as Code (CaC) are failing to deploy after an upgrade.

Can I ask a few follow up questions just to get an idea of what is happening here and can get this to our engineers. I have not seen the error ‘cannot create DatabaseProjectReference for non-Database project’ before and we have no record of it in past forum posts or tickets so this seems new.

It also may be environmental and isolated to just your instance since we have had a few customers upgrade now and they have not experienced the same issues.

Can you confirm that all of your projects that are CaC are now failing to deploy with that error message.
Can you also confirm that all projects that are not CaC are deploying correctly.
What version of Octopus were you running previously and what version have you upgraded to.
You mentioned you have run into this issue before, do you recall how you fixed it?
Have you confirmed you can connect to your CaC repo from Octopus (by going into the project and clicking on ‘Version Control’ in the left menu and then selecting ‘Test’).
Can you try clearing the Git cache on your Octopus server and re-trying a deployment:

If the test passes on your projects for that CaC repo and the Git cache clear does not work, can you get us your Octopus Server logs and a task log of one of the failed deployments please and we can take a look at this for you.

I have created you a secure link to our secure file site here you can upload the files to, let us know once they have been uploaded and I will take a look.

Kind Regards,
Clare

clare.martin · 12 September 2023 11:30

Hey @terjered,

Sorry for my double post here but I have just been able to reproduce this issue by creating a new project and creating two releases which deployed fine. I then migrated my project to CaC and tried to deploy one of my previous releases and I get the same error so no need to perform all the tests I asked previously.

I will get a GitHub issue created for this and get this sent to our engineers to take a look.

Kind Regards,
Clare

clare.martin · 12 September 2023 12:10

Hey @terjered,

As promised here is the GitHub issue for this bug, if you subscribe to that it will notify you when a fix is out.

github.com/OctopusDeploy/Issues

Releases created Pre-Config as Code project migration fail to open with 'Cannot create DatabaseProjectReference for non-Database project'

opened 12:09PM - 12 Sep 23 UTC

Clare-Octopus

kind/bug

### Severity Blocking any customer who has releases they want to deploy that we…re created before a project migration to CaC ### Version 2023.3.12841, 2023.3.12943 ### Latest Version I could reproduce the problem in the latest build ### What happened? If I have a Non-Config as Code (CaC) project that has a few releases associated with it (which deploy fine) and then I migrate the project to CaC the old non-CaC releases will no longer load with the error: `Cannot create DatabaseProjectReference for non-Database project`: ![image](https://github.com/OctopusDeploy/Issues/assets/92790462/50ac9bfd-60a9-45bf-98e9-22cc05acca3a) ![image](https://github.com/OctopusDeploy/Issues/assets/92790462/55462f5b-c49d-4570-906a-03282fbba42d) ### Reproduction 1. Create a new project and have a simple '`Run a Script`' step with a `Write-Host Hello World` script to be run. 2. Create and deploy a release for that project, see it deploys successfully. 3. Convert that project to Config-As-Code (this should create a new release automatically). 4. Click on the releases page for that project (if not already on it) and click on the release _created before you converted that project to CaC_. 5. See the error message '`Cannot create DatabaseProjectReference for non-Database project`'. ### Error and Stacktrace ```shell 2023-09-12 13:04:24.6073 3196 16 INFO "HTTP" "GET" to "192.168.0.201""/api/Spaces-1/projects/Projects-1022/releases/0.0.1" "completed" with 200 in 00:00:00.0126190 (12ms) by "octoadmin" 2023-09-12 13:04:24.6073 3196 16 INFO "HTTP" "GET" to "192.168.0.201""/api/Spaces-1/environments/all" "completed" with 304 in 00:00:00.0063886 (6ms) by "octoadmin" 2023-09-12 13:04:24.6073 3196 16 INFO "HTTP" "GET" to "192.168.0.201""/api/Spaces-1/projects/Projects-1022/channels" "completed" with 304 in 00:00:00.0061249 (6ms) by "octoadmin" 2023-09-12 13:04:24.6073 3196 16 INFO "HTTP" "GET" to "192.168.0.201""/api/Spaces-1/releases/Releases-1401/defects" "completed" with 200 in 00:00:00.0078456 (7ms) by "octoadmin" 2023-09-12 13:04:24.6073 3196 16 INFO "HTTP" "GET" to "192.168.0.201""/api/Spaces-1/deploymentprocesses/deploymentprocess-Projects-1022-s-1-JNF7H" "completed" with 200 in 00:00:00.0081027 (8ms) by "octoadmin" 2023-09-12 13:04:24.6073 3196 16 WARN Could not locate schema for step with Id null and version "1.3.1" 2023-09-12 13:04:24.6073 3196 16 INFO TinyTypeConversionStrategyProvider: Loading lookups for 2 types "succeeded" after 003ms. 2023-09-12 13:04:24.6073 3196 16 INFO Converting TinyTypes on "System.Collections.Generic.List`1[Octopus.Core.Serialization.Ocl.Transformation.Transforms.DeploymentProcessOclTransform+ActionTemplateLookupItem]" for "Projects-1022" with strategy IdToSlug "succeeded" after 003ms. 2023-09-12 13:04:24.6073 3196 16 INFO Converting TinyTypes on "Octopus.Core.Model.Projects.DeploymentProcess" for "Projects-1022" with strategy SlugToId "succeeded" after 000ms. 2023-09-12 13:04:24.6073 3196 16 INFO "HTTP" "GET" to "192.168.0.201""/bff/spaces/Spaces-1/useronboarding/cac-bug-test" "completed" with 200 in 00:00:00.0472169 (47ms) by "octoadmin" 2023-09-12 13:04:24.6073 3196 16 ERROR Unhandled error on request: "Cannot create DatabaseProjectReference for non-Database project" System.ArgumentException: Cannot create DatabaseProjectReference for non-Database project at Octopus.Core.Model.Projects.DatabaseProjectReference..ctor(Project project) in ./source/Octopus.Core/Model/Projects/ProjectReference.cs:line 37 at Octopus.Core.Model.Projects.ProjectReference.FromProjectPath(Project project, ProjectPath projectPath) in ./source/Octopus.Core/Model/Projects/ProjectReference.cs:line 28 at Octopus.Server.Web.Handlers.GetReleaseSnapshotTemplateRequestHandler.Handle(GetReleaseSnapshotTemplateRequest request, CancellationToken cancellationToken) in ./source/Octopus.Server/Web/Handlers/GetReleaseSnapshotTemplateRequestHandler.cs:line 81 at Octopus.Core.Infrastructure.Mediator.AutofacMediator.Request[TRequest,TResponse](IRequest`2 request, CancellationToken cancellationToken) in ./source/Octopus.Core/Infrastructure/Mediator/AutofacMediator.cs:line 37 at Octopus.Core.Infrastructure.Mediator.Decorators.SystemComponentModelValidationDecorator.Request[TRequest,TResponse](IRequest`2 request, CancellationToken cancellationToken) in ./source/Octopus.Core/Infrastructure/Mediator/Decorators/SystemComponentModelValidationDecorator.cs:line 60 at Octopus.Core.Infrastructure.Mediator.Decorators.FluentValidationsDecorator.Request[TRequest,TResponse](IRequest`2 request, CancellationToken cancellationToken) in ./source/Octopus.Core/Infrastructure/Mediator/Decorators/FluentValidationsDecorator.cs:line 78 at Octopus.Core.Infrastructure.Mediator.Decorators.MessageBusSiphoningDecorator.Request[TRequest,TResponse](IRequest`2 request, CancellationToken cancellationToken) in ./source/Octopus.Core/Infrastructure/Mediator/Decorators/MessageBusSiphoningDecorator.cs:line 37 at Octopus.Server.Web.Controllers.DeploymentProcesses.GetReleaseSnapshotTemplateController.GetReleaseSnapshotTemplate(GetReleaseSnapshotTemplateRequest request, CancellationToken cancellationToken) in ./source/Octopus.Server/Web/Controllers/DeploymentProcesses/GetReleaseSnapshotTemplateController.cs:line 23 at lambda_method11361(Closure , Object ) at Microsoft.AspNetCore.Mvc.Infrastructure.ActionMethodExecutor.AwaitableObjectResultExecutor.Execute(IActionResultTypeMapper mapper, ObjectMethodExecutor executor, Object controller, Object[] arguments) at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<InvokeActionMethodAsync>g__Logged|12_1(ControllerActionInvoker invoker) at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<InvokeNextActionFilterAsync>g__Awaited|10_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted) at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Rethrow(ActionExecutedContextSealed context) at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted) at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<InvokeInnerFilterAsync>g__Awaited|13_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted) at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<InvokeFilterPipelineAsync>g__Awaited|20_0(ResourceInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted) at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<InvokeAsync>g__Logged|17_1(ResourceInvoker invoker) at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<InvokeAsync>g__Logged|17_1(ResourceInvoker invoker) at Microsoft.AspNetCore.Routing.EndpointMiddleware.<Invoke>g__AwaitRequestTask|6_0(Endpoint endpoint, Task requestTask, ILogger logger) at Octopus.Server.Web.Middleware.BoundaryTrailerRewriteMiddleware.Invoke(HttpContext context, IAutomationContext automationContext) in ./source/Octopus.Server/Web/Middleware/BoundaryTrailerRewriteMiddleware.cs:line 44 at Octopus.Server.Web.Infrastructure.Authentication.AuthorizationMiddlewareResultHandler.HandleAsync(RequestDelegate next, HttpContext context, AuthorizationPolicy policy, PolicyAuthorizationResult authorizeResult) in ./source/Octopus.Server/Web/Infrastructure/Authentication/AuthorizationMiddlewareResultHandler.cs:line 50 at Microsoft.AspNetCore.Authorization.AuthorizationMiddleware.Invoke(HttpContext context) at Octopus.Server.Web.UnitOfWorkMiddleware.InvokeAsync(HttpContext httpContext, IUnitOfWork unitOfWork) in ./source/Octopus.Server/Web/UnitOfWorkMiddleware.cs:line 46 at Octopus.Server.Web.UnitOfWorkMiddleware.InvokeAsync(HttpContext httpContext, IUnitOfWork unitOfWork) in ./source/Octopus.Server/Web/UnitOfWorkMiddleware.cs:line 46 at Octopus.Server.Web.Middleware.OctopusClientOldVersionWarningMiddleware.InvokeAsync(HttpContext context, IAutomationContext automationContext) in ./source/Octopus.Server/Web/Middleware/OctopusClientOldVersionWarningMiddleware.cs:line 51 at Octopus.Server.Web.Middleware.DynamicContentHeadersMiddleware.InvokeAsync(HttpContext context) in ./source/Octopus.Server/Web/Middleware/DynamicContentHeadersMiddleware.cs:line 50 at Octopus.Server.Web.Middleware.MaintenanceModeMiddleware.InvokeAsync(HttpContext context) in ./source/Octopus.Server/Web/Middleware/MaintenanceModeMiddleware.cs:line 59 at Octopus.Server.Web.Middleware.OctopusAuthenticationMiddleware.InvokeAsync(HttpContext context, IUserAuthenticator userAuthenticator, IAuthCookieService authCookieService, IWebAuthCache authCache, ILogger logger) in ./source/Octopus.Server/Web/Middleware/OctopusAuthenticationMiddleware.cs:line 59 at Microsoft.AspNetCore.Authentication.AuthenticationMiddleware.Invoke(HttpContext context) at Octopus.Server.Web.Middleware.LegacyRequestLoggerMiddleware.InvokeAsync(HttpContext context) in ./source/Octopus.Server/Web/Middleware/LegacyRequestLoggerMiddleware.cs:line 44 at Octopus.Server.Web.Middleware.TelemetryMiddleware.InvokeAsync(HttpContext context) in ./source/Octopus.Server/Web/Middleware/TelemetryMiddleware.cs:line 65 at Octopus.Server.Web.Middleware.ErrorHandlingMiddleware.InvokeAsync(HttpContext context) in ./source/Octopus.Server/Web/Middleware/ErrorHandlingMiddleware.cs:line 50 2023-09-12 13:04:24.6073 3196 16 INFO "HTTP" "GET" to "192.168.0.201""/api/Spaces-1/deploymentprocesses/deploymentprocess-Projects-1022-s-1-JNF7H/template" "completed" with 400 in 00:00:00.0133893 (13ms) by "octoadmin" System.ArgumentException: Cannot create DatabaseProjectReference for non-Database project at Octopus.Core.Model.Projects.DatabaseProjectReference..ctor(Project project) in ./source/Octopus.Core/Model/Projects/ProjectReference.cs:line 37 at Octopus.Core.Model.Projects.ProjectReference.FromProjectPath(Project project, ProjectPath projectPath) in ./source/Octopus.Core/Model/Projects/ProjectReference.cs:line 28 at Octopus.Server.Web.Handlers.GetReleaseSnapshotTemplateRequestHandler.Handle(GetReleaseSnapshotTemplateRequest request, CancellationToken cancellationToken) in ./source/Octopus.Server/Web/Handlers/GetReleaseSnapshotTemplateRequestHandler.cs:line 81 at Octopus.Core.Infrastructure.Mediator.AutofacMediator.Request[TRequest,TResponse](IRequest`2 request, CancellationToken cancellationToken) in ./source/Octopus.Core/Infrastructure/Mediator/AutofacMediator.cs:line 37 at Octopus.Core.Infrastructure.Mediator.Decorators.SystemComponentModelValidationDecorator.Request[TRequest,TResponse](IRequest`2 request, CancellationToken cancellationToken) in ./source/Octopus.Core/Infrastructure/Mediator/Decorators/SystemComponentModelValidationDecorator.cs:line 60 at Octopus.Core.Infrastructure.Mediator.Decorators.FluentValidationsDecorator.Request[TRequest,TResponse](IRequest`2 request, CancellationToken cancellationToken) in ./source/Octopus.Core/Infrastructure/Mediator/Decorators/FluentValidationsDecorator.cs:line 78 at Octopus.Core.Infrastructure.Mediator.Decorators.MessageBusSiphoningDecorator.Request[TRequest,TResponse](IRequest`2 request, CancellationToken cancellationToken) in ./source/Octopus.Core/Infrastructure/Mediator/Decorators/MessageBusSiphoningDecorator.cs:line 37 at Octopus.Server.Web.Controllers.DeploymentProcesses.GetReleaseSnapshotTemplateController.GetReleaseSnapshotTemplate(GetReleaseSnapshotTemplateRequest request, CancellationToken cancellationToken) in ./source/Octopus.Server/Web/Controllers/DeploymentProcesses/GetReleaseSnapshotTemplateController.cs:line 23 at lambda_method11361(Closure , Object ) at Microsoft.AspNetCore.Mvc.Infrastructure.ActionMethodExecutor.AwaitableObjectResultExecutor.Execute(IActionResultTypeMapper mapper, ObjectMethodExecutor executor, Object controller, Object[] arguments) at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<InvokeActionMethodAsync>g__Logged|12_1(ControllerActionInvoker invoker) at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<InvokeNextActionFilterAsync>g__Awaited|10_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted) at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Rethrow(ActionExecutedContextSealed context) at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted) at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<InvokeInnerFilterAsync>g__Awaited|13_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted) at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<InvokeFilterPipelineAsync>g__Awaited|20_0(ResourceInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted) at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<InvokeAsync>g__Logged|17_1(ResourceInvoker invoker) at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<InvokeAsync>g__Logged|17_1(ResourceInvoker invoker) at Microsoft.AspNetCore.Routing.EndpointMiddleware.<Invoke>g__AwaitRequestTask|6_0(Endpoint endpoint, Task requestTask, ILogger logger) at Octopus.Server.Web.Middleware.BoundaryTrailerRewriteMiddleware.Invoke(HttpContext context, IAutomationContext automationContext) in ./source/Octopus.Server/Web/Middleware/BoundaryTrailerRewriteMiddleware.cs:line 44 at Octopus.Server.Web.Infrastructure.Authentication.AuthorizationMiddlewareResultHandler.HandleAsync(RequestDelegate next, HttpContext context, AuthorizationPolicy policy, PolicyAuthorizationResult authorizeResult) in ./source/Octopus.Server/Web/Infrastructure/Authentication/AuthorizationMiddlewareResultHandler.cs:line 50 at Microsoft.AspNetCore.Authorization.AuthorizationMiddleware.Invoke(HttpContext context) at Octopus.Server.Web.UnitOfWorkMiddleware.InvokeAsync(HttpContext httpContext, IUnitOfWork unitOfWork) in ./source/Octopus.Server/Web/UnitOfWorkMiddleware.cs:line 46 at Octopus.Server.Web.UnitOfWorkMiddleware.InvokeAsync(HttpContext httpContext, IUnitOfWork unitOfWork) in ./source/Octopus.Server/Web/UnitOfWorkMiddleware.cs:line 46 at Octopus.Server.Web.Middleware.OctopusClientOldVersionWarningMiddleware.InvokeAsync(HttpContext context, IAutomationContext automationContext) in ./source/Octopus.Server/Web/Middleware/OctopusClientOldVersionWarningMiddleware.cs:line 51 at Octopus.Server.Web.Middleware.DynamicContentHeadersMiddleware.InvokeAsync(HttpContext context) in ./source/Octopus.Server/Web/Middleware/DynamicContentHeadersMiddleware.cs:line 50 at Octopus.Server.Web.Middleware.MaintenanceModeMiddleware.InvokeAsync(HttpContext context) in ./source/Octopus.Server/Web/Middleware/MaintenanceModeMiddleware.cs:line 59 at Octopus.Server.Web.Middleware.OctopusAuthenticationMiddleware.InvokeAsync(HttpContext context, IUserAuthenticator userAuthenticator, IAuthCookieService authCookieService, IWebAuthCache authCache, ILogger logger) in ./source/Octopus.Server/Web/Middleware/OctopusAuthenticationMiddleware.cs:line 59 at Microsoft.AspNetCore.Authentication.AuthenticationMiddleware.Invoke(HttpContext context) at Octopus.Server.Web.Middleware.LegacyRequestLoggerMiddleware.InvokeAsync(HttpContext context) in ./source/Octopus.Server/Web/Middleware/LegacyRequestLoggerMiddleware.cs:line 44 at Octopus.Server.Web.Middleware.TelemetryMiddleware.InvokeAsync(HttpContext context) in ./source/Octopus.Server/Web/Middleware/TelemetryMiddleware.cs:line 65 at Octopus.Server.Web.Middleware.ErrorHandlingMiddleware.InvokeAsync(HttpContext context) in ./source/Octopus.Server/Web/Middleware/ErrorHandlingMiddleware.cs:line 50 2023-09-12 13:04:24.6073 3196 16 INFO "HTTP" "GET" to "192.168.0.201""/bff/spaces/Spaces-1/projects/cac-bug-test/intents" "completed" with 200 in 00:00:00.0101820 (10ms) by "octoadmin" ``` ### More Information Initial user forum report - https://help.octopus.com/t/deploying-older-releases-pre-configascode-fail/29336/3 ### Workaround None we know of so far, if we find any we will update this section.

Kind Regards,
Clare

terjered · 12 September 2023 13:55

Hi.

Awesome, thanks for checking and for the updates. I will subscribe to the issue, and wait for updates there.

Thanks again.

clare.martin · 12 September 2023 14:01

Hey @terjered

No worries, helping customers is what we are here for! Hopefully we can get this fixed quickly and you can then upgrade your production instance once you are confident the fix works on the new Octopus version you put on your test environment.

Kind Regards,
Clare

clare.martin · 13 September 2023 07:50

Hey @terjered,

Just a quick update for you on this issue, our engineers have a fix out already that they are currently testing and will push out to a 2023.4 release (for our cloud customers) once they are happy with their testing. They will then backport that fix to a 2023.3 version (for our On-Prem server customers).

I do not have a date when this will reach general availability for 2023.3 but the fact we have a fix out already and its in its testing phases is good news.

As a side note and I should have checked this yesterday, you can still deploy the non-CaC release via the Overview page, if you wanted to deploy the same release to the same environment you can use the Overview page to click on that release and then re-deploy it.

So the issue is only for the release page load for a non-CaC release created prior to the migration of that project to Config as Code.

Just in case another customer encounters this you are still able to deploy those releases, you are just unable to load the release page for that release.

Hopefully we can get the fix rolled out soon.

Kind Regards,
Clare

clare.martin · 14 September 2023 08:05

Hey @terjered,

I have wonderful news you for this morning, our engineers have pushed the fix out to our latest 2023 build (2023.3.13001) which you can find on our downloads page.

If you upgrade to that version I can confirm you can now load the releases page for those releases and deploy them. I have tested on my reproduction of this issue and it has fixed it for me.

Let me know if upgrading does not fix it on your test environment though and we will re-open the GitHub issue but you should be good to go after upgrading to 2023.3.13001.

Kind Regards,
Clare

terjered · 15 September 2023 10:29

Hi.

Yes, that is great news indeed.

I’ve updated it and tested in our Test environment, and I can confirm that it’s now working as expected.

Thank you very much for your help.

clare.martin · 15 September 2023 10:32

Hey @terjered,

Great news upgrading your test instance has fixed the release page issue, I am glad we could help!

Reach out if you need anything in future as we are always on hand to assist!

Kind Regards and Happy Deployments,
Clare