Okay yes, that would make sense that the communication over API between Azure and Octopus gets lost somehow.
But, for now and for what we are using it for (Both on-Prem and CloudHosted) works
Thanks for all the help here @paul.calvert , I really appreciate the professional and quick response here