Failed jobs do not become expired to allow you to re-queue them without any
time pressure. You should re-queue or delete them manually, or apply AutomaticRetry(OnAttemptsExceeded = AttemptsExceededAction.Delete)
attribute to delete them automatically.
An exception occurred during performance of the job. Fewer details...
03/15/2026 22:11:04
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 22:05:45
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 22:05:38
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 22:05:32
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 22:05:25
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 22:05:17
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 22:05:02
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 22:05:10
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 22:04:55
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 22:05:24
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken, Int32estimatedSize)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3action, Contextcontext, ExceptionPredicatesshouldRetryExceptionPredicates, ResultPredicates`1shouldRetryResultPredicates, Func`5onRetryAsync, CancellationTokencancellationToken, Int32permittedRetryCount, IEnumerable`1sleepDurationsEnumerable, Func`4sleepDurationProvider, BooleancontinueOnCapturedContext)
at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3action, Contextcontext, BooleancontinueOnCapturedContext, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2parameters)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.TransferSyncJobBase.RunTransferSyncAsync(Dictionary`2baseParams, DocumentTypedocumentType)
at EnergyDataHub.Data.Hangfire.Jobs.ScheduledDayAheadTransferSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 22:05:23
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken, Int32estimatedSize)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3action, Contextcontext, ExceptionPredicatesshouldRetryExceptionPredicates, ResultPredicates`1shouldRetryResultPredicates, Func`5onRetryAsync, CancellationTokencancellationToken, Int32permittedRetryCount, IEnumerable`1sleepDurationsEnumerable, Func`4sleepDurationProvider, BooleancontinueOnCapturedContext)
at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3action, Contextcontext, BooleancontinueOnCapturedContext, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2parameters)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.LoadSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 22:04:40
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken, Int32estimatedSize)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3action, Contextcontext, ExceptionPredicatesshouldRetryExceptionPredicates, ResultPredicates`1shouldRetryResultPredicates, Func`5onRetryAsync, CancellationTokencancellationToken, Int32permittedRetryCount, IEnumerable`1sleepDurationsEnumerable, Func`4sleepDurationProvider, BooleancontinueOnCapturedContext)
at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3action, Contextcontext, BooleancontinueOnCapturedContext, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2parameters)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.TransferSyncJobBase.RunTransferSyncAsync(Dictionary`2baseParams, DocumentTypedocumentType)
at EnergyDataHub.Data.Hangfire.Jobs.ScheduledDayAheadTransferSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 22:05:23
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken, Int32estimatedSize)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3action, Contextcontext, ExceptionPredicatesshouldRetryExceptionPredicates, ResultPredicates`1shouldRetryResultPredicates, Func`5onRetryAsync, CancellationTokencancellationToken, Int32permittedRetryCount, IEnumerable`1sleepDurationsEnumerable, Func`4sleepDurationProvider, BooleancontinueOnCapturedContext)
at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3action, Contextcontext, BooleancontinueOnCapturedContext, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2parameters)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.LoadSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 21:24:59
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 21:16:16
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 21:16:10
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 21:16:03
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 22:05:21
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken, Int32estimatedSize)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3action, Contextcontext, ExceptionPredicatesshouldRetryExceptionPredicates, ResultPredicates`1shouldRetryResultPredicates, Func`5onRetryAsync, CancellationTokencancellationToken, Int32permittedRetryCount, IEnumerable`1sleepDurationsEnumerable, Func`4sleepDurationProvider, BooleancontinueOnCapturedContext)
at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3action, Contextcontext, BooleancontinueOnCapturedContext, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2parameters)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.WindAndSolarGenerationSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 22:05:23
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken, Int32estimatedSize)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3action, Contextcontext, ExceptionPredicatesshouldRetryExceptionPredicates, ResultPredicates`1shouldRetryResultPredicates, Func`5onRetryAsync, CancellationTokencancellationToken, Int32permittedRetryCount, IEnumerable`1sleepDurationsEnumerable, Func`4sleepDurationProvider, BooleancontinueOnCapturedContext)
at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3action, Contextcontext, BooleancontinueOnCapturedContext, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2parameters)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.TransferSyncJobBase.RunTransferSyncAsync(Dictionary`2baseParams, DocumentTypedocumentType)
at EnergyDataHub.Data.Hangfire.Jobs.ScheduledDayAheadTransferSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 22:05:19
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken, Int32estimatedSize)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3action, Contextcontext, ExceptionPredicatesshouldRetryExceptionPredicates, ResultPredicates`1shouldRetryResultPredicates, Func`5onRetryAsync, CancellationTokencancellationToken, Int32permittedRetryCount, IEnumerable`1sleepDurationsEnumerable, Func`4sleepDurationProvider, BooleancontinueOnCapturedContext)
at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3action, Contextcontext, BooleancontinueOnCapturedContext, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2parameters)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.LoadSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 21:15:49
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken, Int32estimatedSize)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3action, Contextcontext, ExceptionPredicatesshouldRetryExceptionPredicates, ResultPredicates`1shouldRetryResultPredicates, Func`5onRetryAsync, CancellationTokencancellationToken, Int32permittedRetryCount, IEnumerable`1sleepDurationsEnumerable, Func`4sleepDurationProvider, BooleancontinueOnCapturedContext)
at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3action, Contextcontext, BooleancontinueOnCapturedContext, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2parameters)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.WindAndSolarGenerationForecastSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 20:04:44
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 20:04:38
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 20:04:31
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 20:04:23
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 22:05:23
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken, Int32estimatedSize)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3action, Contextcontext, ExceptionPredicatesshouldRetryExceptionPredicates, ResultPredicates`1shouldRetryResultPredicates, Func`5onRetryAsync, CancellationTokencancellationToken, Int32permittedRetryCount, IEnumerable`1sleepDurationsEnumerable, Func`4sleepDurationProvider, BooleancontinueOnCapturedContext)
at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3action, Contextcontext, BooleancontinueOnCapturedContext, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2parameters)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.WindAndSolarGenerationSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 22:05:23
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken, Int32estimatedSize)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3action, Contextcontext, ExceptionPredicatesshouldRetryExceptionPredicates, ResultPredicates`1shouldRetryResultPredicates, Func`5onRetryAsync, CancellationTokencancellationToken, Int32permittedRetryCount, IEnumerable`1sleepDurationsEnumerable, Func`4sleepDurationProvider, BooleancontinueOnCapturedContext)
at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3action, Contextcontext, BooleancontinueOnCapturedContext, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2parameters)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.TransferSyncJobBase.RunTransferSyncAsync(Dictionary`2baseParams, DocumentTypedocumentType)
at EnergyDataHub.Data.Hangfire.Jobs.ScheduledDayAheadTransferSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 22:04:40
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken, Int32estimatedSize)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3action, Contextcontext, ExceptionPredicatesshouldRetryExceptionPredicates, ResultPredicates`1shouldRetryResultPredicates, Func`5onRetryAsync, CancellationTokencancellationToken, Int32permittedRetryCount, IEnumerable`1sleepDurationsEnumerable, Func`4sleepDurationProvider, BooleancontinueOnCapturedContext)
at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3action, Contextcontext, BooleancontinueOnCapturedContext, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2parameters)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.LoadSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 18:44:10
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 18:44:04
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 18:43:57
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 18:43:51
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 22:05:29
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken, Int32estimatedSize)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3action, Contextcontext, ExceptionPredicatesshouldRetryExceptionPredicates, ResultPredicates`1shouldRetryResultPredicates, Func`5onRetryAsync, CancellationTokencancellationToken, Int32permittedRetryCount, IEnumerable`1sleepDurationsEnumerable, Func`4sleepDurationProvider, BooleancontinueOnCapturedContext)
at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3action, Contextcontext, BooleancontinueOnCapturedContext, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2parameters)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.WindAndSolarGenerationSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 22:05:19
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken, Int32estimatedSize)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3action, Contextcontext, ExceptionPredicatesshouldRetryExceptionPredicates, ResultPredicates`1shouldRetryResultPredicates, Func`5onRetryAsync, CancellationTokencancellationToken, Int32permittedRetryCount, IEnumerable`1sleepDurationsEnumerable, Func`4sleepDurationProvider, BooleancontinueOnCapturedContext)
at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3action, Contextcontext, BooleancontinueOnCapturedContext, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2parameters)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.TransferSyncJobBase.RunTransferSyncAsync(Dictionary`2baseParams, DocumentTypedocumentType)
at EnergyDataHub.Data.Hangfire.Jobs.ScheduledDayAheadTransferSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 20:44:11
Npgsql.PostgresException
53300: sorry, too many clients already
Npgsql.PostgresException: 53300: sorry, too many clients already
at Npgsql.Internal.NpgsqlConnector.ReadMessageLong(Booleanasync, DataRowLoadingModedataRowLoadingMode, BooleanreadingNotifications, BooleanisReadingPrependedMessage)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at Npgsql.Internal.NpgsqlConnector.Authenticate(Stringusername, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.Internal.NpgsqlConnector.<Open>g__OpenCore|213_1(NpgsqlConnectorconn, SslModesslMode, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken, BooleanisFirstAttempt)
at Npgsql.Internal.NpgsqlConnector.Open(NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.PoolingDataSource.OpenNewConnector(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.PoolingDataSource.<Get>g__RentAsync|33_0(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.NpgsqlConnection.<Open>g__OpenAsync|42_0(Booleanasync, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1values)
at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1values)
at EnergyDataHub.Data.Helpers.TimeseriesBatchCollector.<>c__DisplayClass1_0.<<CreateInsertAction>b__0>d.MoveNext()
--- End of stack trace from previous location ---
at EnergyDataHub.Data.Helpers.BatchCollector`1.AddAsync(Titem)
at EnergyDataHub.Data.Services.TimeseriesUpdateService.UpdateTimeseriesAsync[TData](Int64timeseriesId, List`1data, Nullable`1startDateToDelete, Nullable`1endDateToDelete, DataSourcedataSource, AppDbContextcontext)
at EnergyDataHub.Data.Services.TimeseriesUpdateService.UpdateTimeseriesAsync[TData](Timeseriestimeseries, List`1data, Nullable`1startDateToDelete, Nullable`1endDateToDelete, DataSourcedataSource, AppDbContextcontext)
at EnergyDataHub.Data.Services.LoadService.UpdateForecastedLoadAsync(GuidloadGuid, List`1data, AppDbContextcontext, DataSourcedataSource)
at EnergyDataHub.Data.Services.CountryService.MapLoads(List`1data, AppDbContextcontext, DataSourcedataSource)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.LoadSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 17:51:04
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 17:50:57
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 17:50:50
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 17:50:44
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 17:50:37
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 17:50:30
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 17:50:23
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 17:50:16
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 22:05:19
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken, Int32estimatedSize)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3action, Contextcontext, ExceptionPredicatesshouldRetryExceptionPredicates, ResultPredicates`1shouldRetryResultPredicates, Func`5onRetryAsync, CancellationTokencancellationToken, Int32permittedRetryCount, IEnumerable`1sleepDurationsEnumerable, Func`4sleepDurationProvider, BooleancontinueOnCapturedContext)
at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3action, Contextcontext, BooleancontinueOnCapturedContext, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2parameters)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.WindAndSolarGenerationSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 22:05:23
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken, Int32estimatedSize)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3action, Contextcontext, ExceptionPredicatesshouldRetryExceptionPredicates, ResultPredicates`1shouldRetryResultPredicates, Func`5onRetryAsync, CancellationTokencancellationToken, Int32permittedRetryCount, IEnumerable`1sleepDurationsEnumerable, Func`4sleepDurationProvider, BooleancontinueOnCapturedContext)
at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3action, Contextcontext, BooleancontinueOnCapturedContext, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2parameters)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.TransferSyncJobBase.RunTransferSyncAsync(Dictionary`2baseParams, DocumentTypedocumentType)
at EnergyDataHub.Data.Hangfire.Jobs.ScheduledDayAheadTransferSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 16:56:49
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 16:56:42
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 16:56:36
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 16:56:30
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 22:05:29
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken, Int32estimatedSize)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3action, Contextcontext, ExceptionPredicatesshouldRetryExceptionPredicates, ResultPredicates`1shouldRetryResultPredicates, Func`5onRetryAsync, CancellationTokencancellationToken, Int32permittedRetryCount, IEnumerable`1sleepDurationsEnumerable, Func`4sleepDurationProvider, BooleancontinueOnCapturedContext)
at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3action, Contextcontext, BooleancontinueOnCapturedContext, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2parameters)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.WindAndSolarGenerationSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)