Failed Jobs

Enqueued 0 / 1 Scheduled 0 Processing 2 Succeeded 141,694 Failed 3,524 Deleted 84 Awaiting 0

Failed jobs do not become expired to allow you to re-queue them without any time pressure. You should re-queue or delete them manually, or apply AutomaticRetry(OnAttemptsExceeded = AttemptsExceededAction.Delete) attribute to delete them automatically.

Id	Job	Failed
#139139	IScheduledDayAheadTransferSyncJob.Run An exception occurred during performance of the job. Fewer details...	12/15/2025 03:49:37
#139139	Npgsql.PostgresException 53100: could not extend file "base/18813/18945.45": No space left on device Npgsql.PostgresException: 53100: could not extend file "base/18813/18945.45": No space left on device at Npgsql.Internal.NpgsqlConnector.ReadMessageLong(Boolean async, DataRowLoadingMode dataRowLoadingMode, Boolean readingNotifications, Boolean isReadingPrependedMessage) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at Npgsql.NpgsqlBinaryImporter.Complete(Boolean async, CancellationToken cancellationToken) at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1 values) at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1 values) at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1 values) at EnergyDataHub.Data.Helpers.TimeseriesBatchCollector.<>c__DisplayClass1_0.<<CreateInsertAction>b__0>d.MoveNext() --- End of stack trace from previous location --- at EnergyDataHub.Data.Helpers.BatchCollector`1.AddAsync(T item) at EnergyDataHub.Data.Services.TimeseriesUpdateService.UpdateTimeseriesAsync[TData](Int64 timeseriesId, List`1 data, Nullable`1 startDateToDelete, Nullable`1 endDateToDelete, DataSource dataSource, AppDbContext context) at EnergyDataHub.Data.Services.TimeseriesUpdateService.UpdateTimeseriesAsync[TData](Timeseries timeseries, List`1 data, Nullable`1 startDateToDelete, Nullable`1 endDateToDelete, DataSource dataSource, AppDbContext context) at EnergyDataHub.Data.Services.TransferCapacityService.UpdateScheduled(Guid guid, List`1 data, AppDbContext context, DataSource dataSource) at EnergyDataHub.Data.Services.BiddingZoneService.MapTransferCapacity(List`1 data, AppDbContext context, DataSource dataSource) at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentType documentType, AreaEnum area, Dictionary`2 baseParameters, Func`4 dataMethod) at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentType documentType, AreaEnum area, Dictionary`2 baseParameters, Func`4 dataMethod) at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1 taskFuncs, Int32 batchSize) at EnergyDataHub.Data.Hangfire.Jobs.TransferSyncJobBase.RunTransferSyncAsync(Dictionary`2 baseParams, DocumentType documentType) at EnergyDataHub.Data.Hangfire.Jobs.ScheduledDayAheadTransferSyncJob.Run() at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#139138	ILoadSyncJob.Run An exception occurred during performance of the job. More details...	12/15/2025 03:49:33
#139138	Npgsql.PostgresException 53100: could not extend file "base/18813/19274.18": No space left on device Npgsql.PostgresException: 53100: could not extend file "base/18813/19274.18": No space left on device at Npgsql.Internal.NpgsqlConnector.ReadMessageLong(Boolean async, DataRowLoadingMode dataRowLoadingMode, Boolean readingNotifications, Boolean isReadingPrependedMessage) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at Npgsql.NpgsqlBinaryImporter.Complete(Boolean async, CancellationToken cancellationToken) at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1 values) at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1 values) at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1 values) at EnergyDataHub.Data.Helpers.TimeseriesBatchCollector.<>c__DisplayClass1_0.<<CreateInsertAction>b__0>d.MoveNext() --- End of stack trace from previous location --- at EnergyDataHub.Data.Helpers.BatchCollector`1.AddAsync(T item) at EnergyDataHub.Data.Services.TimeseriesUpdateService.UpdateTimeseriesAsync[TData](Int64 timeseriesId, List`1 data, Nullable`1 startDateToDelete, Nullable`1 endDateToDelete, DataSource dataSource, AppDbContext context) at EnergyDataHub.Data.Services.TimeseriesUpdateService.UpdateTimeseriesAsync[TData](Timeseries timeseries, List`1 data, Nullable`1 startDateToDelete, Nullable`1 endDateToDelete, DataSource dataSource, AppDbContext context) at EnergyDataHub.Data.Services.LoadService.UpdateForecastedLoadAsync(Guid loadGuid, List`1 data, AppDbContext context, DataSource dataSource) at EnergyDataHub.Data.Services.CountryService.MapLoads(List`1 data, AppDbContext context, DataSource dataSource) at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentType documentType, AreaEnum area, Dictionary`2 baseParameters, Func`4 dataMethod) at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentType documentType, AreaEnum area, Dictionary`2 baseParameters, Func`4 dataMethod) at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1 taskFuncs, Int32 batchSize) at EnergyDataHub.Data.Hangfire.Jobs.LoadSyncJob.Run() at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#139136	IXWeatherSyncJob.Run An exception occurred during performance of the job. More details...	12/15/2025 03:50:00
#139136	Microsoft.EntityFrameworkCore.Storage.RetryLimitExceededException The maximum number of retries (5) was exceeded while executing database operations with 'NpgsqlRetryingExecutionStrategy'. See the inner exception for the most recent failure. Microsoft.EntityFrameworkCore.Storage.RetryLimitExceededException: The maximum number of retries (5) was exceeded while executing database operations with 'NpgsqlRetryingExecutionStrategy'. See the inner exception for the most recent failure. ---> Microsoft.EntityFrameworkCore.DbUpdateException: An error occurred while saving the entity changes. See the inner exception for details. ---> Npgsql.PostgresException: 53100: could not extend file "base/18813/18945.45": No space left on device at Npgsql.Internal.NpgsqlConnector.ReadMessageLong(Boolean async, DataRowLoadingMode dataRowLoadingMode, Boolean readingNotifications, Boolean isReadingPrependedMessage) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at Npgsql.NpgsqlDataReader.NextResult(Boolean async, Boolean isConsuming, CancellationToken cancellationToken) at Npgsql.NpgsqlDataReader.NextResult(Boolean async, Boolean isConsuming, CancellationToken cancellationToken) at Npgsql.NpgsqlCommand.ExecuteReader(Boolean async, CommandBehavior behavior, CancellationToken cancellationToken) at Npgsql.NpgsqlCommand.ExecuteReader(Boolean async, CommandBehavior behavior, CancellationToken cancellationToken) at Npgsql.NpgsqlCommand.ExecuteDbDataReaderAsync(CommandBehavior behavior, CancellationToken cancellationToken) at Microsoft.EntityFrameworkCore.Storage.RelationalCommand.ExecuteReaderAsync(RelationalCommandParameterObject parameterObject, CancellationToken cancellationToken) at Microsoft.EntityFrameworkCore.Storage.RelationalCommand.ExecuteReaderAsync(RelationalCommandParameterObject parameterObject, CancellationToken cancellationToken) at Microsoft.EntityFrameworkCore.Update.ReaderModificationCommandBatch.ExecuteAsync(IRelationalConnection connection, CancellationToken cancellationToken) --- End of inner exception stack trace --- at Microsoft.EntityFrameworkCore.Update.ReaderModificationCommandBatch.ExecuteAsync(IRelationalConnection connection, CancellationToken cancellationToken) at Microsoft.EntityFrameworkCore.Update.Internal.BatchExecutor.ExecuteAsync(IEnumerable`1 commandBatches, IRelationalConnection connection, CancellationToken cancellationToken) at Microsoft.EntityFrameworkCore.Update.Internal.BatchExecutor.ExecuteAsync(IEnumerable`1 commandBatches, IRelationalConnection connection, CancellationToken cancellationToken) at Microsoft.EntityFrameworkCore.Update.Internal.BatchExecutor.ExecuteAsync(IEnumerable`1 commandBatches, IRelationalConnection connection, CancellationToken cancellationToken) at Microsoft.EntityFrameworkCore.ChangeTracking.Internal.StateManager.SaveChangesAsync(IList`1 entriesToSave, CancellationToken cancellationToken) at Microsoft.EntityFrameworkCore.ChangeTracking.Internal.StateManager.SaveChangesAsync(StateManager stateManager, Boolean acceptAllChangesOnSuccess, CancellationToken cancellationToken) at Microsoft.EntityFrameworkCore.Storage.ExecutionStrategy.<>c__DisplayClass30_0`2.<<ExecuteAsync>b__0>d.MoveNext() --- End of stack trace from previous location --- at Microsoft.EntityFrameworkCore.Storage.ExecutionStrategy.ExecuteImplementationAsync[TState,TResult](Func`4 operation, Func`4 verifySucceeded, TState state, CancellationToken cancellationToken) --- End of inner exception stack trace --- at Microsoft.EntityFrameworkCore.Storage.ExecutionStrategy.ExecuteImplementationAsync[TState,TResult](Func`4 operation, Func`4 verifySucceeded, TState state, CancellationToken cancellationToken) at Microsoft.EntityFrameworkCore.Storage.ExecutionStrategy.ExecuteAsync[TState,TResult](TState state, Func`4 operation, Func`4 verifySucceeded, CancellationToken cancellationToken) at Microsoft.EntityFrameworkCore.DbContext.SaveChangesAsync(Boolean acceptAllChangesOnSuccess, CancellationToken cancellationToken) at Microsoft.EntityFrameworkCore.DbContext.SaveChangesAsync(Boolean acceptAllChangesOnSuccess, CancellationToken cancellationToken) at EnergyDataHub.Data.Hangfire.Jobs.XWeatherSyncJob.SyncLocationWeatherData(Location location, DataSource dataSource, DateTime taskStartHour) at EnergyDataHub.Data.Hangfire.Jobs.XWeatherSyncJob.Run() at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#139096	ProductionForecastService.ForecastGeneration An exception occurred during performance of the job. More details...	12/15/2025 03:49:18
#139096	System.InvalidOperationException Sequence contains no matching element System.InvalidOperationException: Sequence contains no matching element at System.Linq.ThrowHelper.ThrowNoMatchException() at EnergyDataHub.Data.Services.XProductionForecastStorageService.SaveProductionForecast(List`1 forecasts, Location location, ForecastLocationSettings forecastSettings) at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Location location, IPredictionInput weatherForecastDto, ForecastLocationSettings forecastSettings, IProductionForecastStorageService storageService) at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Location location, XWeatherResponse weatherForecastDto, ForecastLocationSettings forecastSettings) at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#139094	ProductionForecastService.ForecastGeneration An exception occurred during performance of the job. More details...	12/15/2025 03:49:13
#139094	System.InvalidOperationException Sequence contains no matching element System.InvalidOperationException: Sequence contains no matching element at System.Linq.ThrowHelper.ThrowNoMatchException() at EnergyDataHub.Data.Services.XProductionForecastStorageService.SaveProductionForecast(List`1 forecasts, Location location, ForecastLocationSettings forecastSettings) at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Location location, IPredictionInput weatherForecastDto, ForecastLocationSettings forecastSettings, IProductionForecastStorageService storageService) at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Location location, XWeatherResponse weatherForecastDto, ForecastLocationSettings forecastSettings) at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#139093	ProductionForecastService.ForecastGeneration An exception occurred during performance of the job. More details...	12/15/2025 03:49:24
#139093	System.InvalidOperationException Sequence contains no matching element System.InvalidOperationException: Sequence contains no matching element at System.Linq.ThrowHelper.ThrowNoMatchException() at EnergyDataHub.Data.Services.XProductionForecastStorageService.SaveProductionForecast(List`1 forecasts, Location location, ForecastLocationSettings forecastSettings) at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Location location, IPredictionInput weatherForecastDto, ForecastLocationSettings forecastSettings, IProductionForecastStorageService storageService) at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Location location, XWeatherResponse weatherForecastDto, ForecastLocationSettings forecastSettings) at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#139092	ProductionForecastService.ForecastGeneration An exception occurred during performance of the job. More details...	12/15/2025 03:49:02
#139092	System.InvalidOperationException Sequence contains no matching element System.InvalidOperationException: Sequence contains no matching element at System.Linq.ThrowHelper.ThrowNoMatchException() at EnergyDataHub.Data.Services.XProductionForecastStorageService.SaveProductionForecast(List`1 forecasts, Location location, ForecastLocationSettings forecastSettings) at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Location location, IPredictionInput weatherForecastDto, ForecastLocationSettings forecastSettings, IProductionForecastStorageService storageService) at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Location location, XWeatherResponse weatherForecastDto, ForecastLocationSettings forecastSettings) at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#139075	IScheduledDayAheadTransferSyncJob.Run An exception occurred during performance of the job. More details...	12/15/2025 03:08:44
#139075	Npgsql.NpgsqlException Exception while reading from stream Npgsql.NpgsqlException: Exception while reading from stream ---> System.IO.EndOfStreamException: Attempted to read past the end of the stream. at Npgsql.Internal.NpgsqlReadBuffer.<Ensure>g__EnsureLong\|55_0(NpgsqlReadBuffer buffer, Int32 count, Boolean async, Boolean readingNotifications) --- End of inner exception stack trace --- at Npgsql.Internal.NpgsqlReadBuffer.<Ensure>g__EnsureLong\|55_0(NpgsqlReadBuffer buffer, Int32 count, Boolean async, Boolean readingNotifications) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token) at Npgsql.Internal.NpgsqlConnector.ReadMessageLong(Boolean async, DataRowLoadingMode dataRowLoadingMode, Boolean readingNotifications, Boolean isReadingPrependedMessage) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at Npgsql.Internal.NpgsqlConnector.ReadMessageLong(Boolean async, DataRowLoadingMode dataRowLoadingMode, Boolean readingNotifications, Boolean isReadingPrependedMessage) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at Npgsql.NpgsqlBinaryImporter.Init(String copyFromCommand, Boolean async, CancellationToken cancellationToken) at Npgsql.NpgsqlConnection.BeginBinaryImport(Boolean async, String copyFromCommand, CancellationToken cancellationToken) at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1 values) at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1 values) at EnergyDataHub.Data.Helpers.TimeseriesBatchCollector.<>c__DisplayClass1_0.<<CreateInsertAction>b__0>d.MoveNext() --- End of stack trace from previous location --- at EnergyDataHub.Data.Helpers.BatchCollector`1.AddAsync(T item) at EnergyDataHub.Data.Services.TimeseriesUpdateService.UpdateTimeseriesAsync[TData](Int64 timeseriesId, List`1 data, Nullable`1 startDateToDelete, Nullable`1 endDateToDelete, DataSource dataSource, AppDbContext context) at EnergyDataHub.Data.Services.TimeseriesUpdateService.UpdateTimeseriesAsync[TData](Timeseries timeseries, List`1 data, Nullable`1 startDateToDelete, Nullable`1 endDateToDelete, DataSource dataSource, AppDbContext context) at EnergyDataHub.Data.Services.TransferCapacityService.UpdateScheduled(Guid guid, List`1 data, AppDbContext context, DataSource dataSource) at EnergyDataHub.Data.Services.ControlAreaService.MapTransferCapacity(List`1 data, AppDbContext context, DataSource dataSource) at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentType documentType, AreaEnum area, Dictionary`2 baseParameters, Func`4 dataMethod) at EnergyDataHub.Data.Services.DataFetchService.MapAndFetchData[TParser,TData](DocumentType documentType, AreaEnum area, Dictionary`2 baseParameters, Func`4 dataMethod) at EnergyDataHub.Data.Helpers.ConcurrencyHelper.ProcessTasksInBatchesAsync(IEnumerable`1 taskFuncs, Int32 batchSize) at EnergyDataHub.Data.Hangfire.Jobs.TransferSyncJobBase.RunTransferSyncAsync(Dictionary`2 baseParams, DocumentType documentType) at EnergyDataHub.Data.Hangfire.Jobs.ScheduledDayAheadTransferSyncJob.Run() at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#139063	IIntradayAuctionsSyncJob.Run An exception occurred during performance of the job. More details...	12/15/2025 02:44:45
#139063	Newtonsoft.Json.JsonReaderException Unexpected character encountered while parsing value: U. Path '', line 0, position 0. Newtonsoft.Json.JsonReaderException: Unexpected character encountered while parsing value: U. Path '', line 0, position 0. at Newtonsoft.Json.JsonTextReader.ParseValue() at Newtonsoft.Json.JsonReader.ReadForType(JsonContract contract, Boolean hasConverter) at Newtonsoft.Json.Serialization.JsonSerializerInternalReader.Deserialize(JsonReader reader, Type objectType, Boolean checkAdditionalContent) at Newtonsoft.Json.JsonSerializer.DeserializeInternal(JsonReader reader, Type objectType) at Newtonsoft.Json.JsonConvert.DeserializeObject(String value, Type type, JsonSerializerSettings settings) at Newtonsoft.Json.JsonConvert.DeserializeObject[T](String value, JsonSerializerSettings settings) at EnergyDataHub.Data.Services.CropexClient.GetCropexWebData[T](String path, NameValueCollection queryParams) at EnergyDataHub.Data.Services.CropexClient.GetIntradayAuctions(DateOnly from, DateOnly to) at EnergyDataHub.Data.Services.CropexClient.GetIntradayAuctions(DateOnly date) at EnergyDataHub.Data.Hangfire.Jobs.IntradayAuctionsSyncJob.StoreReuslts(DateOnly date) at EnergyDataHub.Data.Hangfire.Jobs.IntradayAuctionsSyncJob.Run() at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#139027	ProductionForecastService.ForecastGeneration An exception occurred during performance of the job. More details...	12/15/2025 02:06:07
#139027	System.InvalidOperationException Sequence contains no matching element System.InvalidOperationException: Sequence contains no matching element at System.Linq.ThrowHelper.ThrowNoMatchException() at EnergyDataHub.Data.Services.XProductionForecastStorageService.SaveProductionForecast(List`1 forecasts, Location location, ForecastLocationSettings forecastSettings) at EnergyDataHub.Data.Services.ProductionForecastService.Forecast(Location location, IPredictionInput weatherForecastDto, ForecastLocationSettings forecastSettings, IProductionForecastStorageService storageService) at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Location location, XWeatherResponse weatherForecastDto, ForecastLocationSettings forecastSettings) at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)

Npgsql.PostgresException

Npgsql.PostgresException

Microsoft.EntityFrameworkCore.Storage.RetryLimitExceededException

System.InvalidOperationException

System.InvalidOperationException

System.InvalidOperationException

System.InvalidOperationException

Npgsql.NpgsqlException

Newtonsoft.Json.JsonReaderException

System.InvalidOperationException