Failed jobs do not become expired to allow you to re-queue them without any
time pressure. You should re-queue or delete them manually, or apply AutomaticRetry(OnAttemptsExceeded = AttemptsExceededAction.Delete)
attribute to delete them automatically.
An exception occurred during performance of the job. Fewer details...
04/26/2025 10:05:22
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, VisualCrossingDataDtoweatherForecastDto)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
04/26/2025 07:05:35
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, VisualCrossingDataDtoweatherForecastDto)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
04/26/2025 04:05:29
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, VisualCrossingDataDtoweatherForecastDto)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
04/26/2025 01:05:24
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, VisualCrossingDataDtoweatherForecastDto)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
04/25/2025 22:05:29
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, VisualCrossingDataDtoweatherForecastDto)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
04/25/2025 19:05:32
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, VisualCrossingDataDtoweatherForecastDto)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
04/25/2025 16:05:36
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, VisualCrossingDataDtoweatherForecastDto)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
04/25/2025 13:05:28
Hangfire.BackgroundJobClientException
Background job creation failed. See inner exception for details.
Hangfire.BackgroundJobClientException: Background job creation failed. See inner exception for details. ---> Newtonsoft.Json.JsonSerializationException: Self referencing loop detected for property 'Location' with type 'EnergyDataHub.Domain.Models.Location'. Path 'WeatherData[0]'.
at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.CheckForCircularReference(JsonWriterwriter, Objectvalue, JsonPropertyproperty, JsonContractcontract, JsonContainerContractcontainerContract, JsonPropertycontainerProperty)
at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.SerializeObject(JsonWriterwriter, Objectvalue, JsonObjectContractcontract, JsonPropertymember, JsonContainerContractcollectionContract, JsonPropertycontainerProperty)
at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.SerializeValue(JsonWriterwriter, Objectvalue, JsonContractvalueContract, JsonPropertymember, JsonContainerContractcontainerContract, JsonPropertycontainerProperty)
at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.SerializeList(JsonWriterwriter, IEnumerablevalues, JsonArrayContractcontract, JsonPropertymember, JsonContainerContractcollectionContract, JsonPropertycontainerProperty)
at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.SerializeValue(JsonWriterwriter, Objectvalue, JsonContractvalueContract, JsonPropertymember, JsonContainerContractcontainerContract, JsonPropertycontainerProperty)
at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.SerializeObject(JsonWriterwriter, Objectvalue, JsonObjectContractcontract, JsonPropertymember, JsonContainerContractcollectionContract, JsonPropertycontainerProperty)
at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.SerializeValue(JsonWriterwriter, Objectvalue, JsonContractvalueContract, JsonPropertymember, JsonContainerContractcontainerContract, JsonPropertycontainerProperty)
at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.Serialize(JsonWriterjsonWriter, Objectvalue, TypeobjectType)
at Newtonsoft.Json.JsonSerializer.SerializeInternal(JsonWriterjsonWriter, Objectvalue, TypeobjectType)
at Newtonsoft.Json.JsonConvert.SerializeObjectInternal(Objectvalue, Typetype, JsonSerializerjsonSerializer)
at Hangfire.Common.SerializationHelper.Serialize(Objectvalue, Typetype, SerializationOptionoption)
at Hangfire.Storage.InvocationData.SerializeArguments(MethodInfomethodInfo, IReadOnlyList`1arguments)
at Hangfire.Storage.InvocationData.SerializeJob(Jobjob)
at Hangfire.PostgreSql.PostgreSqlConnection.CreateExpiredJob(Jobjob, IDictionary`2parameters, DateTimecreatedAt, TimeSpanexpireIn)
at Hangfire.Client.CoreBackgroundJobFactory.<>c.<CreateBackgroundJobTwoSteps>b__15_0(Int32_, JobCreateContextctx)
at Hangfire.Client.CoreBackgroundJobFactory.RetryOnException[TContext,TResult](Int32&attemptsLeft, Func`3action, TContextcontext)
--- End of stack trace from previous location ---
at Hangfire.Client.CoreBackgroundJobFactory.RetryOnException[TContext,TResult](Int32&attemptsLeft, Func`3action, TContextcontext)
at Hangfire.Client.CoreBackgroundJobFactory.CreateBackgroundJobTwoSteps(CreateContextcontext, Dictionary`2parameters, DateTimecreatedAt, TimeSpanexpireIn)
at Hangfire.Client.CoreBackgroundJobFactory.Create(CreateContextcontext)
at Hangfire.Client.BackgroundJobFactory.InvokeNextClientFilter(Enumerator&enumerator, IBackgroundJobFactoryinnerFactory, CreateContextcontext, CreatingContextpreContext)
at Hangfire.Client.BackgroundJobFactory.InvokeClientFilter(Enumerator&enumerator, IBackgroundJobFactoryinnerFactory, CreateContextcontext, CreatingContextpreContext)
at Hangfire.Client.BackgroundJobFactory.InvokeNextClientFilter(Enumerator&enumerator, IBackgroundJobFactoryinnerFactory, CreateContextcontext, CreatingContextpreContext)
at Hangfire.Client.BackgroundJobFactory.CreateWithFilters(CreateContextcontext, FilterCollection`1filters)
at Hangfire.Client.BackgroundJobFactory.Create(CreateContextcontext)
at Hangfire.BackgroundJobClient.Create(Jobjob, IStatestate, IDictionary`2parameters)
--- End of inner exception stack trace ---
at Hangfire.BackgroundJobClient.Create(Jobjob, IStatestate, IDictionary`2parameters)
at Hangfire.BackgroundJobClient.Create(Jobjob, IStatestate)
at Hangfire.BackgroundJobClientExtensions.Create(IBackgroundJobClientclient, Expression`1methodCall, IStatestate)
at Hangfire.BackgroundJobClientExtensions.Enqueue(IBackgroundJobClientclient, Expression`1methodCall)
at Hangfire.BackgroundJob.Enqueue(Expression`1methodCall)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastForLocation(Locationlocation, VisualCrossingDataDtoweatherForecastDto)
at EnergyDataHub.Data.Hangfire.Jobs.VisualCrossingSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
04/23/2025 06:16:03
Renci.SshNet.Common.SshAuthenticationException
Permission denied (password).
Renci.SshNet.Common.SshAuthenticationException: Permission denied (password).
at Renci.SshNet.ClientAuthentication.Authenticate(IConnectionInfoInternalconnectionInfo, ISessionsession)
at Renci.SshNet.ConnectionInfo.Authenticate(ISessionsession, IServiceFactoryserviceFactory)
at Renci.SshNet.Session.Connect()
at Renci.SshNet.BaseClient.CreateAndConnectSession()
at Renci.SshNet.BaseClient.Connect()
at EnergyDataHub.Data.Services.SftpService.MapDataToEachArea[DataClass,CsvMapper](StringremoteDirectory, List`1dataMethods, Int32retryCount)
at EnergyDataHub.Data.Services.SftpService.MapDataToEachArea[DataClass,CsvMapper](StringremoteDirectory, List`1dataMethods, Int32retryCount)
at EnergyDataHub.Data.Services.SftpService.MapDataToEachArea[DataClass,CsvMapper](StringremoteDirectory, List`1dataMethods, Int32retryCount)
at EnergyDataHub.Data.Services.SftpService.MapDataToEachArea[DataClass,CsvMapper](StringremoteDirectory, List`1dataMethods)
at EnergyDataHub.Data.Hangfire.Jobs.TransmissionCapacitySyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
04/23/2025 06:16:31
Renci.SshNet.Common.SshConnectionException
The server response does not contain an SSH identification string.
The connection to the remote server was closed before any data was received.
More information on the Protocol Version Exchange is available here:
https://tools.ietf.org/html/rfc4253#section-4.2
Renci.SshNet.Common.SshConnectionException: The server response does not contain an SSH identification string.
The connection to the remote server was closed before any data was received.
More information on the Protocol Version Exchange is available here:
https://tools.ietf.org/html/rfc4253#section-4.2
at Renci.SshNet.Connection.ProtocolVersionExchange.Start(StringclientVersion, Socketsocket, TimeSpantimeout)
at Renci.SshNet.Session.Connect()
at Renci.SshNet.BaseClient.CreateAndConnectSession()
at Renci.SshNet.BaseClient.Connect()
at EnergyDataHub.Data.Services.SftpService.MapDataToEachArea[DataClass,CsvMapper](StringremoteDirectory, List`1dataMethods, Int32retryCount)
at EnergyDataHub.Data.Services.SftpService.MapDataToEachArea[DataClass,CsvMapper](StringremoteDirectory, List`1dataMethods, Int32retryCount)
at EnergyDataHub.Data.Services.SftpService.MapDataToEachArea[DataClass,CsvMapper](StringremoteDirectory, List`1dataMethods, Int32retryCount)
at EnergyDataHub.Data.Services.SftpService.MapDataToEachArea[DataClass,CsvMapper](StringremoteDirectory, List`1dataMethods, Int32retryCount)
at EnergyDataHub.Data.Services.SftpService.MapDataToEachArea[DataClass,CsvMapper](StringremoteDirectory, List`1dataMethods, Int32retryCount)
at EnergyDataHub.Data.Services.SftpService.MapDataToEachArea[DataClass,CsvMapper](StringremoteDirectory, List`1dataMethods)
at EnergyDataHub.Data.Hangfire.Jobs.LoadSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)