Failed jobs do not become expired to allow you to re-queue them without any
time pressure. You should re-queue or delete them manually, or apply AutomaticRetry(OnAttemptsExceeded = AttemptsExceededAction.Delete)
attribute to delete them automatically.
An exception occurred during performance of the job. Fewer details...
03/25/2026 10:27:26
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken, Int32estimatedSize)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3action, Contextcontext, ExceptionPredicatesshouldRetryExceptionPredicates, ResultPredicates`1shouldRetryResultPredicates, Func`5onRetryAsync, CancellationTokencancellationToken, Int32permittedRetryCount, IEnumerable`1sleepDurationsEnumerable, Func`4sleepDurationProvider, BooleancontinueOnCapturedContext)
at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3action, Contextcontext, BooleancontinueOnCapturedContext, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2parameters)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.LoadSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 07:58:39
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 07:45:22
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 07:45:16
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 07:45:08
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 10:27:21
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken, Int32estimatedSize)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3action, Contextcontext, ExceptionPredicatesshouldRetryExceptionPredicates, ResultPredicates`1shouldRetryResultPredicates, Func`5onRetryAsync, CancellationTokencancellationToken, Int32permittedRetryCount, IEnumerable`1sleepDurationsEnumerable, Func`4sleepDurationProvider, BooleancontinueOnCapturedContext)
at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3action, Contextcontext, BooleancontinueOnCapturedContext, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2parameters)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.TransferSyncJobBase.RunTransferSyncAsync(Dictionary`2baseParams, DocumentTypedocumentType)
at EnergyDataHub.Data.Hangfire.Jobs.ScheduledDayAheadTransferSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 06:25:50
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 06:25:43
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 06:25:36
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 06:25:29
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 12:14:49
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken, Int32estimatedSize)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3action, Contextcontext, ExceptionPredicatesshouldRetryExceptionPredicates, ResultPredicates`1shouldRetryResultPredicates, Func`5onRetryAsync, CancellationTokencancellationToken, Int32permittedRetryCount, IEnumerable`1sleepDurationsEnumerable, Func`4sleepDurationProvider, BooleancontinueOnCapturedContext)
at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3action, Contextcontext, BooleancontinueOnCapturedContext, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2parameters)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.WindAndSolarGenerationSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 05:58:41
System.InvalidOperationException
Could not get a value of the job parameter `CurrentCulture`. See inner exception for details.
System.InvalidOperationException: Could not get a value of the job parameter `CurrentCulture`. See inner exception for details. ---> Npgsql.PostgresException: 53300: remaining connection slots are reserved for roles with the SUPERUSER attribute
at Npgsql.Internal.NpgsqlConnector.ReadMessageLong(Booleanasync, DataRowLoadingModedataRowLoadingMode, BooleanreadingNotifications, BooleanisReadingPrependedMessage)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at Npgsql.Internal.NpgsqlConnector.<Open>g__OpenCore|213_1(NpgsqlConnectorconn, SslModesslMode, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken, BooleanisFirstAttempt)
at Npgsql.Internal.NpgsqlConnector.Open(NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.PoolingDataSource.OpenNewConnector(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.PoolingDataSource.<Get>g__RentAsync|33_0(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.NpgsqlConnection.<Open>g__OpenAsync|42_0(Booleanasync, CancellationTokencancellationToken)
at Hangfire.PostgreSql.PostgreSqlStorage.CreateAndOpenConnection()
at Hangfire.PostgreSql.PostgreSqlStorage.UseConnection[T](DbConnectiondedicatedConnection, Func`2func)
at Hangfire.Server.PerformContext.GetJobParameter[T](Stringname, BooleanallowStale)
--- End of inner exception stack trace ---
at Hangfire.Server.PerformContext.GetJobParameter[T](Stringname, BooleanallowStale)
at Hangfire.CaptureCultureAttribute.OnPerforming(PerformingContextcontext)
at Hangfire.Server.BackgroundJobPerformer.InvokeOnPerforming(KeyValuePair`2ctx)
An exception occurred during performance of the job. More details...
03/25/2026 05:58:40
System.InvalidOperationException
Could not get a value of the job parameter `CurrentCulture`. See inner exception for details.
System.InvalidOperationException: Could not get a value of the job parameter `CurrentCulture`. See inner exception for details. ---> Npgsql.PostgresException: 53300: remaining connection slots are reserved for roles with the SUPERUSER attribute
at Npgsql.Internal.NpgsqlConnector.ReadMessageLong(Booleanasync, DataRowLoadingModedataRowLoadingMode, BooleanreadingNotifications, BooleanisReadingPrependedMessage)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at Npgsql.Internal.NpgsqlConnector.<Open>g__OpenCore|213_1(NpgsqlConnectorconn, SslModesslMode, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken, BooleanisFirstAttempt)
at Npgsql.Internal.NpgsqlConnector.Open(NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.PoolingDataSource.OpenNewConnector(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.PoolingDataSource.<Get>g__RentAsync|33_0(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.NpgsqlConnection.<Open>g__OpenAsync|42_0(Booleanasync, CancellationTokencancellationToken)
at Hangfire.PostgreSql.PostgreSqlStorage.CreateAndOpenConnection()
at Hangfire.PostgreSql.PostgreSqlStorage.UseConnection[T](DbConnectiondedicatedConnection, Func`2func)
at Hangfire.Server.PerformContext.GetJobParameter[T](Stringname, BooleanallowStale)
--- End of inner exception stack trace ---
at Hangfire.Server.PerformContext.GetJobParameter[T](Stringname, BooleanallowStale)
at Hangfire.CaptureCultureAttribute.OnPerforming(PerformingContextcontext)
at Hangfire.Server.BackgroundJobPerformer.InvokeOnPerforming(KeyValuePair`2ctx)
An exception occurred during performance of the job. More details...
03/25/2026 10:13:49
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken, Int32estimatedSize)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3action, Contextcontext, ExceptionPredicatesshouldRetryExceptionPredicates, ResultPredicates`1shouldRetryResultPredicates, Func`5onRetryAsync, CancellationTokencancellationToken, Int32permittedRetryCount, IEnumerable`1sleepDurationsEnumerable, Func`4sleepDurationProvider, BooleancontinueOnCapturedContext)
at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3action, Contextcontext, BooleancontinueOnCapturedContext, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2parameters)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.TransferSyncJobBase.RunTransferSyncAsync(Dictionary`2baseParams, DocumentTypedocumentType)
at EnergyDataHub.Data.Hangfire.Jobs.ScheduledDayAheadTransferSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 04:28:26
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 10:10:56
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken, Int32estimatedSize)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3action, Contextcontext, ExceptionPredicatesshouldRetryExceptionPredicates, ResultPredicates`1shouldRetryResultPredicates, Func`5onRetryAsync, CancellationTokencancellationToken, Int32permittedRetryCount, IEnumerable`1sleepDurationsEnumerable, Func`4sleepDurationProvider, BooleancontinueOnCapturedContext)
at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3action, Contextcontext, BooleancontinueOnCapturedContext, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2parameters)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.TransferSyncJobBase.RunTransferSyncAsync(Dictionary`2baseParams, DocumentTypedocumentType)
at EnergyDataHub.Data.Hangfire.Jobs.ScheduledDayAheadTransferSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 04:26:16
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 04:26:10
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 04:26:03
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 04:13:06
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 04:13:00
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 04:12:54
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 04:12:48
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 10:10:57
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken, Int32estimatedSize)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3action, Contextcontext, ExceptionPredicatesshouldRetryExceptionPredicates, ResultPredicates`1shouldRetryResultPredicates, Func`5onRetryAsync, CancellationTokencancellationToken, Int32permittedRetryCount, IEnumerable`1sleepDurationsEnumerable, Func`4sleepDurationProvider, BooleancontinueOnCapturedContext)
at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3action, Contextcontext, BooleancontinueOnCapturedContext, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2parameters)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.TransferSyncJobBase.RunTransferSyncAsync(Dictionary`2baseParams, DocumentTypedocumentType)
at EnergyDataHub.Data.Hangfire.Jobs.ScheduledDayAheadTransferSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 03:32:41
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 03:32:34
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 03:32:25
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 03:32:18
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 10:10:56
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken, Int32estimatedSize)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3action, Contextcontext, ExceptionPredicatesshouldRetryExceptionPredicates, ResultPredicates`1shouldRetryResultPredicates, Func`5onRetryAsync, CancellationTokencancellationToken, Int32permittedRetryCount, IEnumerable`1sleepDurationsEnumerable, Func`4sleepDurationProvider, BooleancontinueOnCapturedContext)
at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3action, Contextcontext, BooleancontinueOnCapturedContext, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2parameters)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.TransferSyncJobBase.RunTransferSyncAsync(Dictionary`2baseParams, DocumentTypedocumentType)
at EnergyDataHub.Data.Hangfire.Jobs.ScheduledDayAheadTransferSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 02:52:56
Newtonsoft.Json.JsonReaderException
Unexpected character encountered while parsing value: C. Path '', line 0, position 0.
Newtonsoft.Json.JsonReaderException: Unexpected character encountered while parsing value: C. Path '', line 0, position 0.
at Newtonsoft.Json.JsonTextReader.ParseValue()
at Newtonsoft.Json.JsonReader.ReadForType(JsonContractcontract, BooleanhasConverter)
at Newtonsoft.Json.Serialization.JsonSerializerInternalReader.Deserialize(JsonReaderreader, TypeobjectType, BooleancheckAdditionalContent)
at Newtonsoft.Json.JsonSerializer.DeserializeInternal(JsonReaderreader, TypeobjectType)
at Newtonsoft.Json.JsonConvert.DeserializeObject(Stringvalue, Typetype, JsonSerializerSettingssettings)
at Newtonsoft.Json.JsonConvert.DeserializeObject[T](Stringvalue, JsonSerializerSettingssettings)
at EnergyDataHub.Data.Services.CropexClient.GetCropexWebData[T](Stringpath, NameValueCollectionqueryParams)
at EnergyDataHub.Data.Services.CropexClient.GetIntradayAuctions(DateOnlyfrom, DateOnlyto)
at EnergyDataHub.Data.Services.CropexClient.GetIntradayAuctions(DateOnlydate)
at EnergyDataHub.Data.Hangfire.Jobs.IntradayAuctionsSyncJob.StoreReuslts(DateOnlydate)
at EnergyDataHub.Data.Hangfire.Jobs.IntradayAuctionsSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 10:27:07
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken, Int32estimatedSize)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3action, Contextcontext, ExceptionPredicatesshouldRetryExceptionPredicates, ResultPredicates`1shouldRetryResultPredicates, Func`5onRetryAsync, CancellationTokencancellationToken, Int32permittedRetryCount, IEnumerable`1sleepDurationsEnumerable, Func`4sleepDurationProvider, BooleancontinueOnCapturedContext)
at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3action, Contextcontext, BooleancontinueOnCapturedContext, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2parameters)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.WindAndSolarGenerationSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 02:27:52
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 02:27:45
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 02:27:39
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 02:27:33
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 02:27:18
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 20 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException: Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken, Int32estimatedSize)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<SendCoreAsync>g__Core|5_0(HttpRequestMessagerequest, BooleanuseAsync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3action, Contextcontext, ExceptionPredicatesshouldRetryExceptionPredicates, ResultPredicates`1shouldRetryResultPredicates, Func`5onRetryAsync, CancellationTokencancellationToken, Int32permittedRetryCount, IEnumerable`1sleepDurationsEnumerable, Func`4sleepDurationProvider, BooleancontinueOnCapturedContext)
at Polly.AsyncPolicy`1.ExecuteInternalAsync(Func`3action, Contextcontext, BooleancontinueOnCapturedContext, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.DataFetchService.LoadDataFromApi[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2parameters)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.LoadSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 00:26:08
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 00:26:01
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 00:25:55
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 00:25:48
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 00:13:45
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 00:13:38
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 00:13:32
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 00:13:26
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 00:13:12
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 00:13:05
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 00:13:19
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/25/2026 00:12:58
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/24/2026 23:46:29
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/24/2026 23:38:38
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)