Failed jobs do not become expired to allow you to re-queue them without any
time pressure. You should re-queue or delete them manually, or apply AutomaticRetry(OnAttemptsExceeded = AttemptsExceededAction.Delete)
attribute to delete them automatically.
An exception occurred during performance of the job. Fewer details...
03/16/2026 03:14:08
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/16/2026 02:58:31
Newtonsoft.Json.JsonReaderException
Unexpected character encountered while parsing value: U. Path '', line 0, position 0.
Newtonsoft.Json.JsonReaderException: Unexpected character encountered while parsing value: U. Path '', line 0, position 0.
at Newtonsoft.Json.JsonTextReader.ParseValue()
at Newtonsoft.Json.JsonReader.ReadForType(JsonContractcontract, BooleanhasConverter)
at Newtonsoft.Json.Serialization.JsonSerializerInternalReader.Deserialize(JsonReaderreader, TypeobjectType, BooleancheckAdditionalContent)
at Newtonsoft.Json.JsonSerializer.DeserializeInternal(JsonReaderreader, TypeobjectType)
at Newtonsoft.Json.JsonConvert.DeserializeObject(Stringvalue, Typetype, JsonSerializerSettingssettings)
at Newtonsoft.Json.JsonConvert.DeserializeObject[T](Stringvalue, JsonSerializerSettingssettings)
at EnergyDataHub.Data.Services.CropexClient.GetCropexWebData[T](Stringpath, NameValueCollectionqueryParams)
at EnergyDataHub.Data.Services.CropexClient.GetIntradayAuctions(DateOnlyfrom, DateOnlyto)
at EnergyDataHub.Data.Services.CropexClient.GetIntradayAuctions(DateOnlydate)
at EnergyDataHub.Data.Hangfire.Jobs.IntradayAuctionsSyncJob.StoreReuslts(DateOnlydate)
at EnergyDataHub.Data.Hangfire.Jobs.IntradayAuctionsSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/16/2026 02:58:29
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/16/2026 02:58:23
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/16/2026 02:58:36
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/16/2026 02:58:17
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/16/2026 05:37:37
Npgsql.PostgresException
53300: remaining connection slots are reserved for roles with the SUPERUSER attribute
Npgsql.PostgresException: 53300: remaining connection slots are reserved for roles with the SUPERUSER attribute
at Npgsql.Internal.NpgsqlConnector.ReadMessageLong(Booleanasync, DataRowLoadingModedataRowLoadingMode, BooleanreadingNotifications, BooleanisReadingPrependedMessage)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at Npgsql.Internal.NpgsqlConnector.<Open>g__OpenCore|213_1(NpgsqlConnectorconn, SslModesslMode, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken, BooleanisFirstAttempt)
at Npgsql.Internal.NpgsqlConnector.Open(NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.PoolingDataSource.OpenNewConnector(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.PoolingDataSource.<Get>g__RentAsync|33_0(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.NpgsqlConnection.<Open>g__OpenAsync|42_0(Booleanasync, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1values)
at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1values)
at EnergyDataHub.Data.Helpers.TimeseriesBatchCollector.<>c__DisplayClass1_0.<<CreateInsertAction>b__0>d.MoveNext()
--- End of stack trace from previous location ---
at EnergyDataHub.Data.Helpers.BatchCollector`1.AddAsync(Titem)
at EnergyDataHub.Data.Services.TimeseriesUpdateService.UpdateTimeseriesAsync[TData](Int64timeseriesId, List`1data, Nullable`1startDateToDelete, Nullable`1endDateToDelete, DataSourcedataSource, AppDbContextcontext)
at EnergyDataHub.Data.Services.TimeseriesUpdateService.UpdateTimeseriesAsync[TData](Timeseriestimeseries, List`1data, Nullable`1startDateToDelete, Nullable`1endDateToDelete, DataSourcedataSource, AppDbContextcontext)
at EnergyDataHub.Data.Services.LoadService.UpdateForecastedLoadAsync(GuidloadGuid, List`1data, AppDbContextcontext, DataSourcedataSource)
at EnergyDataHub.Data.Services.BiddingZoneService.MapLoads(List`1data, AppDbContextcontext, DataSourcedataSource)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentTypedocumentType, AreaEnumarea, Dictionary`2baseParameters, Func`4dataMethod)
at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1taskFuncs, Int32batchSize)
at EnergyDataHub.Data.Hangfire.Jobs.LoadSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/16/2026 00:25:06
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/16/2026 00:11:58
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/16/2026 00:11:26
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/16/2026 00:10:56
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 23:17:55
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 23:12:21
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 23:11:36
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 23:11:05
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 22:15:53
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 22:12:13
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 22:11:37
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 22:11:04
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
03/15/2026 22:05:45
System.Exception
Forecast script failed with exit code 1
System.Exception: Forecast script failed with exit code 1
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Locationlocation, IPredictionInputweatherForecastDto, ForecastLocationSettingsforecastSettings, IProductionForecastStorageServicestorageService)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, XWeatherResponseweatherForecastDto, ForecastLocationSettingsforecastSettings)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)