Failed jobs do not become expired to allow you to re-queue them without any
time pressure. You should re-queue or delete them manually, or apply AutomaticRetry(OnAttemptsExceeded = AttemptsExceededAction.Delete)
attribute to delete them automatically.
An exception occurred during performance of the job. Fewer details...
03/20/2026 12:00:43
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken, Int32estimatedSize)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3action, Contextcontext, ExceptionPredicatesshouldRetryExceptionPredicates, ResultPredicates`1shouldRetryResultPredicates, Func`5onRetryAsync, CancellationTokencancellationToken, Int32permittedRetryCount, IEnumerable`1sleepDurationsEnumerable, Func`4sleepDurationProvider, BooleancontinueOnCapturedContext)
at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3action, Contextcontext, BooleancontinueOnCapturedContext, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2parameters)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.WindAndSolarGenerationSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/20/2026 09:07:11
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken, Int32estimatedSize)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3action, Contextcontext, ExceptionPredicatesshouldRetryExceptionPredicates, ResultPredicates`1shouldRetryResultPredicates, Func`5onRetryAsync, CancellationTokencancellationToken, Int32permittedRetryCount, IEnumerable`1sleepDurationsEnumerable, Func`4sleepDurationProvider, BooleancontinueOnCapturedContext)
at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3action, Contextcontext, BooleancontinueOnCapturedContext, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2parameters)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.TransferSyncJobBase.RunTransferSyncAsync(Dictionary`2baseParams, DocumentTypedocumentType)
at EnergyDataHub.Data.Hangfire.Jobs.ScheduledDayAheadTransferSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/20/2026 09:20:57
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken, Int32estimatedSize)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3action, Contextcontext, ExceptionPredicatesshouldRetryExceptionPredicates, ResultPredicates`1shouldRetryResultPredicates, Func`5onRetryAsync, CancellationTokencancellationToken, Int32permittedRetryCount, IEnumerable`1sleepDurationsEnumerable, Func`4sleepDurationProvider, BooleancontinueOnCapturedContext)
at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3action, Contextcontext, BooleancontinueOnCapturedContext, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2parameters)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.LoadSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/20/2026 04:54:02
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/20/2026 04:53:56
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/20/2026 04:53:50
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/20/2026 04:53:44
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/20/2026 09:07:35
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken, Int32estimatedSize)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3action, Contextcontext, ExceptionPredicatesshouldRetryExceptionPredicates, ResultPredicates`1shouldRetryResultPredicates, Func`5onRetryAsync, CancellationTokencancellationToken, Int32permittedRetryCount, IEnumerable`1sleepDurationsEnumerable, Func`4sleepDurationProvider, BooleancontinueOnCapturedContext)
at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3action, Contextcontext, BooleancontinueOnCapturedContext, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2parameters)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.WindAndSolarGenerationSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/20/2026 09:07:11
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken, Int32estimatedSize)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3action, Contextcontext, ExceptionPredicatesshouldRetryExceptionPredicates, ResultPredicates`1shouldRetryResultPredicates, Func`5onRetryAsync, CancellationTokencancellationToken, Int32permittedRetryCount, IEnumerable`1sleepDurationsEnumerable, Func`4sleepDurationProvider, BooleancontinueOnCapturedContext)
at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3action, Contextcontext, BooleancontinueOnCapturedContext, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2parameters)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.TransferSyncJobBase.RunTransferSyncAsync(Dictionary`2baseParams, DocumentTypedocumentType)
at EnergyDataHub.Data.Hangfire.Jobs.ScheduledDayAheadTransferSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/20/2026 09:20:57
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken, Int32estimatedSize)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3action, Contextcontext, ExceptionPredicatesshouldRetryExceptionPredicates, ResultPredicates`1shouldRetryResultPredicates, Func`5onRetryAsync, CancellationTokencancellationToken, Int32permittedRetryCount, IEnumerable`1sleepDurationsEnumerable, Func`4sleepDurationProvider, BooleancontinueOnCapturedContext)
at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3action, Contextcontext, BooleancontinueOnCapturedContext, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2parameters)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.LoadSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/20/2026 03:33:52
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/20/2026 03:33:46
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/20/2026 03:33:40
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/20/2026 03:33:35
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/20/2026 09:07:16
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken, Int32estimatedSize)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3action, Contextcontext, ExceptionPredicatesshouldRetryExceptionPredicates, ResultPredicates`1shouldRetryResultPredicates, Func`5onRetryAsync, CancellationTokencancellationToken, Int32permittedRetryCount, IEnumerable`1sleepDurationsEnumerable, Func`4sleepDurationProvider, BooleancontinueOnCapturedContext)
at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3action, Contextcontext, BooleancontinueOnCapturedContext, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2parameters)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.WindAndSolarGenerationSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/20/2026 09:07:26
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken, Int32estimatedSize)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3action, Contextcontext, ExceptionPredicatesshouldRetryExceptionPredicates, ResultPredicates`1shouldRetryResultPredicates, Func`5onRetryAsync, CancellationTokencancellationToken, Int32permittedRetryCount, IEnumerable`1sleepDurationsEnumerable, Func`4sleepDurationProvider, BooleancontinueOnCapturedContext)
at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3action, Contextcontext, BooleancontinueOnCapturedContext, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2parameters)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.TransferSyncJobBase.RunTransferSyncAsync(Dictionary`2baseParams, DocumentTypedocumentType)
at EnergyDataHub.Data.Hangfire.Jobs.ScheduledDayAheadTransferSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/20/2026 02:39:11
Newtonsoft.Json.JsonReaderException
Unexpected character encountered while parsing value: U. Path '', line 0, position 0.
Newtonsoft.Json.JsonReaderException: Unexpected character encountered while parsing value: U. Path '', line 0, position 0.
at Newtonsoft.Json.JsonTextReader.ParseValue()
at Newtonsoft.Json.JsonReader.ReadForType(JsonContractcontract, BooleanhasConverter)
at Newtonsoft.Json.Serialization.JsonSerializerInternalReader.Deserialize(JsonReaderreader, TypeobjectType, BooleancheckAdditionalContent)
at Newtonsoft.Json.JsonSerializer.DeserializeInternal(JsonReaderreader, TypeobjectType)
at Newtonsoft.Json.JsonConvert.DeserializeObject(Stringvalue, Typetype, JsonSerializerSettingssettings)
at Newtonsoft.Json.JsonConvert.DeserializeObject[T](Stringvalue, JsonSerializerSettingssettings)
at EnergyDataHub.Data.Services.CropexClient.GetCropexWebData[T](Stringpath, NameValueCollectionqueryParams)
at EnergyDataHub.Data.Services.CropexClient.GetIntradayAuctions(DateOnlyfrom, DateOnlyto)
at EnergyDataHub.Data.Services.CropexClient.GetIntradayAuctions(DateOnlydate)
at EnergyDataHub.Data.Hangfire.Jobs.IntradayAuctionsSyncJob.StoreReuslts(DateOnlydate)
at EnergyDataHub.Data.Hangfire.Jobs.IntradayAuctionsSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/20/2026 02:26:27
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/20/2026 02:26:21
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/20/2026 02:26:15
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/20/2026 02:26:09
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/20/2026 09:07:25
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken, Int32estimatedSize)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3action, Contextcontext, ExceptionPredicatesshouldRetryExceptionPredicates, ResultPredicates`1shouldRetryResultPredicates, Func`5onRetryAsync, CancellationTokencancellationToken, Int32permittedRetryCount, IEnumerable`1sleepDurationsEnumerable, Func`4sleepDurationProvider, BooleancontinueOnCapturedContext)
at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3action, Contextcontext, BooleancontinueOnCapturedContext, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2parameters)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.TransferSyncJobBase.RunTransferSyncAsync(Dictionary`2baseParams, DocumentTypedocumentType)
at EnergyDataHub.Data.Hangfire.Jobs.ScheduledDayAheadTransferSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/20/2026 01:19:25
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/20/2026 01:19:19
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/20/2026 01:19:13
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/20/2026 01:19:07
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/20/2026 00:52:13
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/20/2026 00:52:06
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/20/2026 00:52:00
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/20/2026 00:51:53
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/20/2026 00:12:54
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/20/2026 00:12:49
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/20/2026 00:12:43
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/20/2026 00:12:37
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/20/2026 03:33:25
Npgsql.PostgresException
53300: remaining connection slots are reserved for roles with the SUPERUSER attribute
Npgsql.PostgresException: 53300: remaining connection slots are reserved for roles with the SUPERUSER attribute
at Npgsql.Internal.NpgsqlConnector.ReadMessageLong(Booleanasync, DataRowLoadingModedataRowLoadingMode, BooleanreadingNotifications, BooleanisReadingPrependedMessage)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at Npgsql.Internal.NpgsqlConnector.<Open>g__OpenCore|213_1(NpgsqlConnectorconn, SslModesslMode, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken, BooleanisFirstAttempt)
at Npgsql.Internal.NpgsqlConnector.Open(NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.PoolingDataSource.OpenNewConnector(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.PoolingDataSource.<Get>g__RentAsync|33_0(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.NpgsqlConnection.<Open>g__OpenAsync|42_0(Booleanasync, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1values)
at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1values)
at EnergyDataHub.Data.Helpers.TimeseriesBatchCollector.<>c__DisplayClass1_0.<<CreateInsertAction>b__0>d.MoveNext()
--- End of stack trace from previous location ---
at EnergyDataHub.Data.Helpers.BatchCollector`1.AddAsync(Titem)
at EnergyDataHub.Data.Services.TimeseriesUpdateService.UpdateTimeseriesAsync[TData](Int64timeseriesId, List`1data, Nullable`1startDateToDelete, Nullable`1endDateToDelete, DataSourcedataSource, AppDbContextcontext)
at EnergyDataHub.Data.Services.TimeseriesUpdateService.UpdateTimeseriesAsync[TData](Timeseriestimeseries, List`1data, Nullable`1startDateToDelete, Nullable`1endDateToDelete, DataSourcedataSource, AppDbContextcontext)
at EnergyDataHub.Data.Services.LoadService.UpdateActualLoadAsync(GuidloadGuid, List`1data, AppDbContextcontext, DataSourcedataSource)
at EnergyDataHub.Data.Services.BiddingZoneService.MapLoads(List`1data, AppDbContextcontext, DataSourcedataSource)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.LoadSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/19/2026 23:19:30
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/19/2026 23:19:23
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/19/2026 23:19:17
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/19/2026 23:19:11
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/20/2026 01:18:59
Npgsql.PostgresException
53300: remaining connection slots are reserved for roles with the SUPERUSER attribute
Npgsql.PostgresException: 53300: remaining connection slots are reserved for roles with the SUPERUSER attribute
at Npgsql.Internal.NpgsqlConnector.ReadMessageLong(Booleanasync, DataRowLoadingModedataRowLoadingMode, BooleanreadingNotifications, BooleanisReadingPrependedMessage)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at Npgsql.Internal.NpgsqlConnector.<Open>g__OpenCore|213_1(NpgsqlConnectorconn, SslModesslMode, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken, BooleanisFirstAttempt)
at Npgsql.Internal.NpgsqlConnector.Open(NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.PoolingDataSource.OpenNewConnector(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.PoolingDataSource.<Get>g__RentAsync|33_0(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.NpgsqlConnection.<Open>g__OpenAsync|42_0(Booleanasync, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1values)
at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1values)
at EnergyDataHub.Data.Helpers.TimeseriesBatchCollector.<>c__DisplayClass1_0.<<CreateInsertAction>b__0>d.MoveNext()
--- End of stack trace from previous location ---
at EnergyDataHub.Data.Helpers.BatchCollector`1.AddAsync(Titem)
at EnergyDataHub.Data.Services.TimeseriesUpdateService.UpdateTimeseriesAsync[TData](Int64timeseriesId, List`1data, Nullable`1startDateToDelete, Nullable`1endDateToDelete, DataSourcedataSource, AppDbContextcontext)
at EnergyDataHub.Data.Services.TimeseriesUpdateService.UpdateTimeseriesAsync[TData](Timeseriestimeseries, List`1data, Nullable`1startDateToDelete, Nullable`1endDateToDelete, DataSourcedataSource, AppDbContextcontext)
at EnergyDataHub.Data.Services.LoadService.UpdateActualLoadAsync(GuidloadGuid, List`1data, AppDbContextcontext, DataSourcedataSource)
at EnergyDataHub.Data.Services.BiddingZoneService.MapLoads(List`1data, AppDbContextcontext, DataSourcedataSource)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.LoadSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/19/2026 21:45:16
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/19/2026 21:33:01
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/19/2026 21:32:54
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/19/2026 21:32:48
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/19/2026 23:46:02
Npgsql.PostgresException
53300: remaining connection slots are reserved for roles with the SUPERUSER attribute
Npgsql.PostgresException: 53300: remaining connection slots are reserved for roles with the SUPERUSER attribute
at Npgsql.Internal.NpgsqlConnector.ReadMessageLong(Booleanasync, DataRowLoadingModedataRowLoadingMode, BooleanreadingNotifications, BooleanisReadingPrependedMessage)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at Npgsql.Internal.NpgsqlConnector.<Open>g__OpenCore|213_1(NpgsqlConnectorconn, SslModesslMode, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken, BooleanisFirstAttempt)
at Npgsql.Internal.NpgsqlConnector.Open(NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.PoolingDataSource.OpenNewConnector(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.PoolingDataSource.<Get>g__RentAsync|33_0(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.NpgsqlConnection.<Open>g__OpenAsync|42_0(Booleanasync, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1values)
at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1values)
at EnergyDataHub.Data.Helpers.TimeseriesBatchCollector.<>c__DisplayClass1_0.<<CreateInsertAction>b__0>d.MoveNext()
--- End of stack trace from previous location ---
at EnergyDataHub.Data.Helpers.BatchCollector`1.AddAsync(Titem)
at EnergyDataHub.Data.Services.TimeseriesUpdateService.UpdateTimeseriesAsync[TData](Int64timeseriesId, List`1data, Nullable`1startDateToDelete, Nullable`1endDateToDelete, DataSourcedataSource, AppDbContextcontext)
at EnergyDataHub.Data.Services.TimeseriesUpdateService.UpdateTimeseriesAsync[TData](Timeseriestimeseries, List`1data, Nullable`1startDateToDelete, Nullable`1endDateToDelete, DataSourcedataSource, AppDbContextcontext)
at EnergyDataHub.Data.Services.TransferCapacityService.UpdateScheduled(Guidguid, List`1data, AppDbContextcontext, DataSourcedataSource)
at EnergyDataHub.Data.Services.BiddingZoneService.MapTransferCapacity(List`1data, AppDbContextcontext, DataSourcedataSource)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.TransferSyncJobBase.RunTransferSyncAsync(Dictionary`2baseParams, DocumentTypedocumentType)
at EnergyDataHub.Data.Hangfire.Jobs.ScheduledDayAheadTransferSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/19/2026 21:06:52
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/19/2026 21:06:59
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/19/2026 21:07:07
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/19/2026 21:06:46
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/19/2026 19:59:33
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)