Failed jobs do not become expired to allow you to re-queue them without any
time pressure. You should re-queue or delete them manually, or apply AutomaticRetry(OnAttemptsExceeded = AttemptsExceededAction.Delete)
attribute to delete them automatically.
An exception occurred during performance of the job. Fewer details...
03/17/2026 01:29:16
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/17/2026 05:28:25
Npgsql.PostgresException
53300: remaining connection slots are reserved for roles with the SUPERUSER attribute
Npgsql.PostgresException: 53300: remaining connection slots are reserved for roles with the SUPERUSER attribute
at Npgsql.Internal.NpgsqlConnector.ReadMessageLong(Booleanasync, DataRowLoadingModedataRowLoadingMode, BooleanreadingNotifications, BooleanisReadingPrependedMessage)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at Npgsql.Internal.NpgsqlConnector.<Open>g__OpenCore|213_1(NpgsqlConnectorconn, SslModesslMode, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken, BooleanisFirstAttempt)
at Npgsql.Internal.NpgsqlConnector.Open(NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.PoolingDataSource.OpenNewConnector(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.PoolingDataSource.<Get>g__RentAsync|33_0(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.NpgsqlConnection.<Open>g__OpenAsync|42_0(Booleanasync, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1values)
at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1values)
at EnergyDataHub.Data.Helpers.TimeseriesBatchCollector.<>c__DisplayClass1_0.<<CreateInsertAction>b__0>d.MoveNext()
--- End of stack trace from previous location ---
at EnergyDataHub.Data.Helpers.BatchCollector`1.AddAsync(Titem)
at EnergyDataHub.Data.Services.TimeseriesUpdateService.UpdateTimeseriesAsync[TData](Int64timeseriesId, List`1data, Nullable`1startDateToDelete, Nullable`1endDateToDelete, DataSourcedataSource, AppDbContextcontext)
at EnergyDataHub.Data.Services.TimeseriesUpdateService.UpdateTimeseriesAsync[TData](Timeseriestimeseries, List`1data, Nullable`1startDateToDelete, Nullable`1endDateToDelete, DataSourcedataSource, AppDbContextcontext)
at EnergyDataHub.Data.Services.LoadService.UpdateForecastedLoadAsync(GuidloadGuid, List`1data, AppDbContextcontext, DataSourcedataSource)
at EnergyDataHub.Data.Services.BiddingZoneService.MapLoads(List`1data, AppDbContextcontext, DataSourcedataSource)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.LoadSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/16/2026 23:16:08
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/16/2026 23:16:01
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/16/2026 23:15:48
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/16/2026 23:15:54
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/16/2026 23:15:35
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/16/2026 23:15:28
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/16/2026 23:15:41
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/16/2026 23:15:22
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/16/2026 22:08:23
System.InvalidOperationException
Could not get a value of the job parameter `CurrentCulture`. See inner exception for details.
System.InvalidOperationException: Could not get a value of the job parameter `CurrentCulture`. See inner exception for details. ---> Npgsql.PostgresException: 53300: remaining connection slots are reserved for roles with the SUPERUSER attribute
at Npgsql.Internal.NpgsqlConnector.ReadMessageLong(Booleanasync, DataRowLoadingModedataRowLoadingMode, BooleanreadingNotifications, BooleanisReadingPrependedMessage)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at Npgsql.Internal.NpgsqlConnector.<Open>g__OpenCore|213_1(NpgsqlConnectorconn, SslModesslMode, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken, BooleanisFirstAttempt)
at Npgsql.Internal.NpgsqlConnector.Open(NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.PoolingDataSource.OpenNewConnector(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.PoolingDataSource.<Get>g__RentAsync|33_0(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.NpgsqlConnection.<Open>g__OpenAsync|42_0(Booleanasync, CancellationTokencancellationToken)
at Hangfire.PostgreSql.PostgreSqlStorage.CreateAndOpenConnection()
at Hangfire.PostgreSql.PostgreSqlStorage.UseConnection[T](DbConnectiondedicatedConnection, Func`2func)
at Hangfire.Server.PerformContext.GetJobParameter[T](Stringname, BooleanallowStale)
--- End of inner exception stack trace ---
at Hangfire.Server.PerformContext.GetJobParameter[T](Stringname, BooleanallowStale)
at Hangfire.CaptureCultureAttribute.OnPerforming(PerformingContextcontext)
at Hangfire.Server.BackgroundJobPerformer.InvokeOnPerforming(KeyValuePair`2ctx)
An exception occurred during performance of the job. More details...
03/16/2026 21:42:05
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/16/2026 21:41:58
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/16/2026 21:41:52
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/16/2026 21:41:43
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/16/2026 21:15:37
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/16/2026 21:15:31
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/16/2026 21:15:25
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/16/2026 21:15:19
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/16/2026 19:15:54
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)