Failed Jobs

Enqueued 0 / 1 Scheduled 0 Processing 1 Succeeded 278,956 Failed 29,156 Deleted 203 Awaiting 0

Failed jobs do not become expired to allow you to re-queue them without any time pressure. You should re-queue or delete them manually, or apply AutomaticRetry(OnAttemptsExceeded = AttemptsExceededAction.Delete) attribute to delete them automatically.

Id	Job	Failed
#303873	ProductionForecastService.ForecastGeneration An exception occurred during performance of the job. Fewer details...	09/15/2026 00:57:09
#303873	System.Exception Forecast script failed with exit code 1 System.Exception: Forecast script failed with exit code 1 at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettings forecastSettings, String predictorsPath) at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Location location, IPredictionInput weatherForecastDto, ForecastLocationSettings forecastSettings, IProductionForecastStorageService storageService) at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Location location, XWeatherResponse weatherForecastDto, ForecastLocationSettings forecastSettings) at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#303872	ProductionForecastService.ForecastGeneration An exception occurred during performance of the job. More details...	09/15/2026 00:57:03
#303872	System.Exception Forecast script failed with exit code 1 System.Exception: Forecast script failed with exit code 1 at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettings forecastSettings, String predictorsPath) at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Location location, IPredictionInput weatherForecastDto, ForecastLocationSettings forecastSettings, IProductionForecastStorageService storageService) at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Location location, XWeatherResponse weatherForecastDto, ForecastLocationSettings forecastSettings) at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#303871	ProductionForecastService.ForecastGeneration An exception occurred during performance of the job. More details...	09/15/2026 00:56:56
#303871	System.Exception Forecast script failed with exit code 1 System.Exception: Forecast script failed with exit code 1 at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettings forecastSettings, String predictorsPath) at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Location location, IPredictionInput weatherForecastDto, ForecastLocationSettings forecastSettings, IProductionForecastStorageService storageService) at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Location location, XWeatherResponse weatherForecastDto, ForecastLocationSettings forecastSettings) at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#303869	IScheduledDayAheadTransferSyncJob.Run An exception occurred during performance of the job. More details...	09/15/2026 08:33:12
#303869	System.Threading.Tasks.TaskCanceledException The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled --- End of inner exception stack trace --- at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken) at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token) at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationToken cancellationToken, Int32 estimatedSize) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1 buffer, CancellationToken cancellationToken) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at System.Net.Http.HttpConnection.InitialFillAsync(Boolean async) at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) --- End of inner exception stack trace --- at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core\|5_0(HttpRequestMessage request, Boolean useAsync, CancellationToken cancellationToken) at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core\|5_0(HttpRequestMessage request, Boolean useAsync, CancellationToken cancellationToken) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) --- End of inner exception stack trace --- --- End of inner exception stack trace --- at System.Net.Http.HttpClient.HandleFailure(Exception e, Boolean telemetryStarted, HttpResponseMessage response, CancellationTokenSource cts, CancellationToken cancellationToken, CancellationTokenSource pendingRequestsCts) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3 action, Context context, ExceptionPredicates shouldRetryExceptionPredicates, ResultPredicates`1 shouldRetryResultPredicates, Func`5 onRetryAsync, CancellationToken cancellationToken, Int32 permittedRetryCount, IEnumerable`1 sleepDurationsEnumerable, Func`4 sleepDurationProvider, Boolean continueOnCapturedContext) at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3 action, Context context, Boolean continueOnCapturedContext, CancellationToken cancellationToken) at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentType documentType, AreaEnum area, Dictionary`2 parameters) at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentType documentType, AreaEnum area, Dictionary`2 baseParameters, Func`4 dataMethod) at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1 taskFuncs, Int32 batchSize) at EnergyDataHub.Data.Hangfire.Jobs.TransferSyncJobBase.RunTransferSyncAsync(Dictionary`2 baseParams, DocumentType documentType) at EnergyDataHub.Data.Hangfire.Jobs.ScheduledDayAheadTransferSyncJob.Run() at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#303850	IWindAndSolarGenerationSyncJob.Run An exception occurred during performance of the job. More details...	09/15/2026 08:33:06
#303850	System.Threading.Tasks.TaskCanceledException The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled --- End of inner exception stack trace --- at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken) at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token) at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationToken cancellationToken, Int32 estimatedSize) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1 buffer, CancellationToken cancellationToken) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at System.Net.Http.HttpConnection.InitialFillAsync(Boolean async) at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) --- End of inner exception stack trace --- at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core\|5_0(HttpRequestMessage request, Boolean useAsync, CancellationToken cancellationToken) at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core\|5_0(HttpRequestMessage request, Boolean useAsync, CancellationToken cancellationToken) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) --- End of inner exception stack trace --- --- End of inner exception stack trace --- at System.Net.Http.HttpClient.HandleFailure(Exception e, Boolean telemetryStarted, HttpResponseMessage response, CancellationTokenSource cts, CancellationToken cancellationToken, CancellationTokenSource pendingRequestsCts) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3 action, Context context, ExceptionPredicates shouldRetryExceptionPredicates, ResultPredicates`1 shouldRetryResultPredicates, Func`5 onRetryAsync, CancellationToken cancellationToken, Int32 permittedRetryCount, IEnumerable`1 sleepDurationsEnumerable, Func`4 sleepDurationProvider, Boolean continueOnCapturedContext) at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3 action, Context context, Boolean continueOnCapturedContext, CancellationToken cancellationToken) at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentType documentType, AreaEnum area, Dictionary`2 parameters) at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentType documentType, AreaEnum area, Dictionary`2 baseParameters, Func`4 dataMethod) at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1 taskFuncs, Int32 batchSize) at EnergyDataHub.Data.Hangfire.Jobs.WindAndSolarGenerationSyncJob.Run() at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#303848	ProductionForecastService.ForecastGeneration An exception occurred during performance of the job. More details...	09/14/2026 23:47:41
#303848	System.Exception Forecast script failed with exit code 1 System.Exception: Forecast script failed with exit code 1 at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettings forecastSettings, String predictorsPath) at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Location location, IPredictionInput weatherForecastDto, ForecastLocationSettings forecastSettings, IProductionForecastStorageService storageService) at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Location location, XWeatherResponse weatherForecastDto, ForecastLocationSettings forecastSettings) at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#303845	ProductionForecastService.ForecastGeneration An exception occurred during performance of the job. More details...	09/14/2026 23:47:34
#303845	System.Exception Forecast script failed with exit code 1 System.Exception: Forecast script failed with exit code 1 at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettings forecastSettings, String predictorsPath) at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Location location, IPredictionInput weatherForecastDto, ForecastLocationSettings forecastSettings, IProductionForecastStorageService storageService) at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Location location, XWeatherResponse weatherForecastDto, ForecastLocationSettings forecastSettings) at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#303843	ProductionForecastService.ForecastGeneration An exception occurred during performance of the job. More details...	09/14/2026 23:47:27
#303843	System.Exception Forecast script failed with exit code 1 System.Exception: Forecast script failed with exit code 1 at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettings forecastSettings, String predictorsPath) at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Location location, IPredictionInput weatherForecastDto, ForecastLocationSettings forecastSettings, IProductionForecastStorageService storageService) at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Location location, XWeatherResponse weatherForecastDto, ForecastLocationSettings forecastSettings) at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#303841	IScheduledDayAheadTransferSyncJob.Run An exception occurred during performance of the job. More details...	09/15/2026 03:01:21
#303841	System.Threading.Tasks.TaskCanceledException The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled --- End of inner exception stack trace --- at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken) at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token) at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationToken cancellationToken, Int32 estimatedSize) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1 buffer, CancellationToken cancellationToken) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at System.Net.Http.HttpConnection.InitialFillAsync(Boolean async) at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) --- End of inner exception stack trace --- at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core\|5_0(HttpRequestMessage request, Boolean useAsync, CancellationToken cancellationToken) at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core\|5_0(HttpRequestMessage request, Boolean useAsync, CancellationToken cancellationToken) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) --- End of inner exception stack trace --- --- End of inner exception stack trace --- at System.Net.Http.HttpClient.HandleFailure(Exception e, Boolean telemetryStarted, HttpResponseMessage response, CancellationTokenSource cts, CancellationToken cancellationToken, CancellationTokenSource pendingRequestsCts) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3 action, Context context, ExceptionPredicates shouldRetryExceptionPredicates, ResultPredicates`1 shouldRetryResultPredicates, Func`5 onRetryAsync, CancellationToken cancellationToken, Int32 permittedRetryCount, IEnumerable`1 sleepDurationsEnumerable, Func`4 sleepDurationProvider, Boolean continueOnCapturedContext) at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3 action, Context context, Boolean continueOnCapturedContext, CancellationToken cancellationToken) at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentType documentType, AreaEnum area, Dictionary`2 parameters) at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentType documentType, AreaEnum area, Dictionary`2 baseParameters, Func`4 dataMethod) at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1 taskFuncs, Int32 batchSize) at EnergyDataHub.Data.Hangfire.Jobs.TransferSyncJobBase.RunTransferSyncAsync(Dictionary`2 baseParams, DocumentType documentType) at EnergyDataHub.Data.Hangfire.Jobs.ScheduledDayAheadTransferSyncJob.Run() at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#303840	ILoadSyncJob.Run An exception occurred during performance of the job. More details...	09/15/2026 03:01:10
#303840	System.Threading.Tasks.TaskCanceledException The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled --- End of inner exception stack trace --- at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken) at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token) at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationToken cancellationToken, Int32 estimatedSize) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1 buffer, CancellationToken cancellationToken) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at System.Net.Http.HttpConnection.InitialFillAsync(Boolean async) at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) --- End of inner exception stack trace --- at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core\|5_0(HttpRequestMessage request, Boolean useAsync, CancellationToken cancellationToken) at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core\|5_0(HttpRequestMessage request, Boolean useAsync, CancellationToken cancellationToken) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) --- End of inner exception stack trace --- --- End of inner exception stack trace --- at System.Net.Http.HttpClient.HandleFailure(Exception e, Boolean telemetryStarted, HttpResponseMessage response, CancellationTokenSource cts, CancellationToken cancellationToken, CancellationTokenSource pendingRequestsCts) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3 action, Context context, ExceptionPredicates shouldRetryExceptionPredicates, ResultPredicates`1 shouldRetryResultPredicates, Func`5 onRetryAsync, CancellationToken cancellationToken, Int32 permittedRetryCount, IEnumerable`1 sleepDurationsEnumerable, Func`4 sleepDurationProvider, Boolean continueOnCapturedContext) at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3 action, Context context, Boolean continueOnCapturedContext, CancellationToken cancellationToken) at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentType documentType, AreaEnum area, Dictionary`2 parameters) at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentType documentType, AreaEnum area, Dictionary`2 baseParameters, Func`4 dataMethod) at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1 taskFuncs, Int32 batchSize) at EnergyDataHub.Data.Hangfire.Jobs.LoadSyncJob.Run() at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#303839	ProductionForecastService.ForecastGeneration An exception occurred during performance of the job. More details...	09/14/2026 23:17:55
#303839	System.Exception Forecast script failed with exit code 1 System.Exception: Forecast script failed with exit code 1 at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettings forecastSettings, String predictorsPath) at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Location location, IPredictionInput weatherForecastDto, ForecastLocationSettings forecastSettings, IProductionForecastStorageService storageService) at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Location location, XWeatherResponse weatherForecastDto, ForecastLocationSettings forecastSettings) at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#303817	IScheduledDayAheadTransferSyncJob.Run An exception occurred during performance of the job. More details...	09/15/2026 03:01:04
#303817	System.Threading.Tasks.TaskCanceledException The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled --- End of inner exception stack trace --- at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken) at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token) at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationToken cancellationToken, Int32 estimatedSize) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1 buffer, CancellationToken cancellationToken) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at System.Net.Http.HttpConnection.InitialFillAsync(Boolean async) at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) --- End of inner exception stack trace --- at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core\|5_0(HttpRequestMessage request, Boolean useAsync, CancellationToken cancellationToken) at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core\|5_0(HttpRequestMessage request, Boolean useAsync, CancellationToken cancellationToken) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) --- End of inner exception stack trace --- --- End of inner exception stack trace --- at System.Net.Http.HttpClient.HandleFailure(Exception e, Boolean telemetryStarted, HttpResponseMessage response, CancellationTokenSource cts, CancellationToken cancellationToken, CancellationTokenSource pendingRequestsCts) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3 action, Context context, ExceptionPredicates shouldRetryExceptionPredicates, ResultPredicates`1 shouldRetryResultPredicates, Func`5 onRetryAsync, CancellationToken cancellationToken, Int32 permittedRetryCount, IEnumerable`1 sleepDurationsEnumerable, Func`4 sleepDurationProvider, Boolean continueOnCapturedContext) at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3 action, Context context, Boolean continueOnCapturedContext, CancellationToken cancellationToken) at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentType documentType, AreaEnum area, Dictionary`2 parameters) at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentType documentType, AreaEnum area, Dictionary`2 baseParameters, Func`4 dataMethod) at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1 taskFuncs, Int32 batchSize) at EnergyDataHub.Data.Hangfire.Jobs.TransferSyncJobBase.RunTransferSyncAsync(Dictionary`2 baseParams, DocumentType documentType) at EnergyDataHub.Data.Hangfire.Jobs.ScheduledDayAheadTransferSyncJob.Run() at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#303816	ILoadSyncJob.Run An exception occurred during performance of the job. More details...	09/15/2026 05:41:56
#303816	System.Threading.Tasks.TaskCanceledException The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled --- End of inner exception stack trace --- at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken) at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token) at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationToken cancellationToken, Int32 estimatedSize) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1 buffer, CancellationToken cancellationToken) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) --- End of inner exception stack trace --- at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core\|5_0(HttpRequestMessage request, Boolean useAsync, CancellationToken cancellationToken) at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core\|5_0(HttpRequestMessage request, Boolean useAsync, CancellationToken cancellationToken) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) --- End of inner exception stack trace --- --- End of inner exception stack trace --- at System.Net.Http.HttpClient.HandleFailure(Exception e, Boolean telemetryStarted, HttpResponseMessage response, CancellationTokenSource cts, CancellationToken cancellationToken, CancellationTokenSource pendingRequestsCts) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3 action, Context context, ExceptionPredicates shouldRetryExceptionPredicates, ResultPredicates`1 shouldRetryResultPredicates, Func`5 onRetryAsync, CancellationToken cancellationToken, Int32 permittedRetryCount, IEnumerable`1 sleepDurationsEnumerable, Func`4 sleepDurationProvider, Boolean continueOnCapturedContext) at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3 action, Context context, Boolean continueOnCapturedContext, CancellationToken cancellationToken) at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentType documentType, AreaEnum area, Dictionary`2 parameters) at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentType documentType, AreaEnum area, Dictionary`2 baseParameters, Func`4 dataMethod) at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1 taskFuncs, Int32 batchSize) at EnergyDataHub.Data.Hangfire.Jobs.LoadSyncJob.Run() at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#303806	ProductionForecastService.ForecastGeneration An exception occurred during performance of the job. More details...	09/14/2026 22:12:43
#303806	System.Exception Forecast script failed with exit code 1 System.Exception: Forecast script failed with exit code 1 at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettings forecastSettings, String predictorsPath) at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Location location, IPredictionInput weatherForecastDto, ForecastLocationSettings forecastSettings, IProductionForecastStorageService storageService) at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Location location, XWeatherResponse weatherForecastDto, ForecastLocationSettings forecastSettings) at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#303802	ProductionForecastService.ForecastGeneration An exception occurred during performance of the job. More details...	09/14/2026 22:12:36
#303802	System.Exception Forecast script failed with exit code 1 System.Exception: Forecast script failed with exit code 1 at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettings forecastSettings, String predictorsPath) at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Location location, IPredictionInput weatherForecastDto, ForecastLocationSettings forecastSettings, IProductionForecastStorageService storageService) at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Location location, XWeatherResponse weatherForecastDto, ForecastLocationSettings forecastSettings) at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#303801	ProductionForecastService.ForecastGeneration An exception occurred during performance of the job. More details...	09/14/2026 22:12:29
#303801	System.Exception Forecast script failed with exit code 1 System.Exception: Forecast script failed with exit code 1 at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettings forecastSettings, String predictorsPath) at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Location location, IPredictionInput weatherForecastDto, ForecastLocationSettings forecastSettings, IProductionForecastStorageService storageService) at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Location location, XWeatherResponse weatherForecastDto, ForecastLocationSettings forecastSettings) at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#303799	ProductionForecastService.ForecastGeneration An exception occurred during performance of the job. More details...	09/14/2026 22:12:22
#303799	System.Exception Forecast script failed with exit code 1 System.Exception: Forecast script failed with exit code 1 at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettings forecastSettings, String predictorsPath) at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Location location, IPredictionInput weatherForecastDto, ForecastLocationSettings forecastSettings, IProductionForecastStorageService storageService) at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Location location, XWeatherResponse weatherForecastDto, ForecastLocationSettings forecastSettings) at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#303787	ILoadSyncJob.Run An exception occurred during performance of the job. More details...	09/15/2026 07:27:06
#303787	System.Threading.Tasks.TaskCanceledException The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled --- End of inner exception stack trace --- at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken) at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token) at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationToken cancellationToken, Int32 estimatedSize) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1 buffer, CancellationToken cancellationToken) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at System.Net.Http.HttpConnection.InitialFillAsync(Boolean async) at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) --- End of inner exception stack trace --- at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core\|5_0(HttpRequestMessage request, Boolean useAsync, CancellationToken cancellationToken) at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core\|5_0(HttpRequestMessage request, Boolean useAsync, CancellationToken cancellationToken) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) --- End of inner exception stack trace --- --- End of inner exception stack trace --- at System.Net.Http.HttpClient.HandleFailure(Exception e, Boolean telemetryStarted, HttpResponseMessage response, CancellationTokenSource cts, CancellationToken cancellationToken, CancellationTokenSource pendingRequestsCts) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3 action, Context context, ExceptionPredicates shouldRetryExceptionPredicates, ResultPredicates`1 shouldRetryResultPredicates, Func`5 onRetryAsync, CancellationToken cancellationToken, Int32 permittedRetryCount, IEnumerable`1 sleepDurationsEnumerable, Func`4 sleepDurationProvider, Boolean continueOnCapturedContext) at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3 action, Context context, Boolean continueOnCapturedContext, CancellationToken cancellationToken) at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentType documentType, AreaEnum area, Dictionary`2 parameters) at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentType documentType, AreaEnum area, Dictionary`2 baseParameters, Func`4 dataMethod) at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1 taskFuncs, Int32 batchSize) at EnergyDataHub.Data.Hangfire.Jobs.LoadSyncJob.Run() at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#303774	ProductionForecastService.ForecastGeneration An exception occurred during performance of the job. More details...	09/14/2026 20:40:53
#303774	System.Exception Forecast script failed with exit code 1 System.Exception: Forecast script failed with exit code 1 at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettings forecastSettings, String predictorsPath) at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Location location, IPredictionInput weatherForecastDto, ForecastLocationSettings forecastSettings, IProductionForecastStorageService storageService) at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Location location, XWeatherResponse weatherForecastDto, ForecastLocationSettings forecastSettings) at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#303770	ProductionForecastService.ForecastGeneration An exception occurred during performance of the job. More details...	09/14/2026 20:40:46
#303770	System.Exception Forecast script failed with exit code 1 System.Exception: Forecast script failed with exit code 1 at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettings forecastSettings, String predictorsPath) at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Location location, IPredictionInput weatherForecastDto, ForecastLocationSettings forecastSettings, IProductionForecastStorageService storageService) at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Location location, XWeatherResponse weatherForecastDto, ForecastLocationSettings forecastSettings) at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)

System.Exception

System.Exception

System.Exception

System.Threading.Tasks.TaskCanceledException

System.Threading.Tasks.TaskCanceledException

System.Exception

System.Exception

System.Exception

System.Threading.Tasks.TaskCanceledException

System.Threading.Tasks.TaskCanceledException

System.Exception

System.Threading.Tasks.TaskCanceledException

System.Threading.Tasks.TaskCanceledException

System.Exception

System.Exception

System.Exception

System.Exception

System.Threading.Tasks.TaskCanceledException

System.Exception

System.Exception