Failed Jobs

Enqueued 0 / 1 Scheduled 0 Processing 2 Succeeded 140,665 Failed 3,500 Deleted 84 Awaiting 0

Failed jobs do not become expired to allow you to re-queue them without any time pressure. You should re-queue or delete them manually, or apply AutomaticRetry(OnAttemptsExceeded = AttemptsExceededAction.Delete) attribute to delete them automatically.

Id	Job	Failed
#341	IGenerationSyncJob.Run An exception occurred during performance of the job. Fewer details...	04/13/2025 16:44:24
#341	Npgsql.NpgsqlException Exception while reading from stream Npgsql.NpgsqlException: Exception while reading from stream ---> System.TimeoutException: Timeout during reading attempt --- End of inner exception stack trace --- at Npgsql.Internal.NpgsqlReadBuffer.<Ensure>g__EnsureLong\|55_0(NpgsqlReadBuffer buffer, Int32 count, Boolean async, Boolean readingNotifications) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token) at Npgsql.Internal.NpgsqlConnector.ReadMessageLong(Boolean async, DataRowLoadingMode dataRowLoadingMode, Boolean readingNotifications, Boolean isReadingPrependedMessage) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at Npgsql.NpgsqlBinaryImporter.Complete(Boolean async, CancellationToken cancellationToken) at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1 values) at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1 values) at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1 values) at EnergyDataHub.Data.Services.GenerationService.UpdateOutputAndConsumption(List`1 generationIds, List`1 data, AppDbContext context, DataSource dataSource) at EnergyDataHub.Data.Services.ControlAreaService.MapActualGeneration(List`1 data, AppDbContext context, DataSource dataSource) at EnergyDataHub.Data.Services.SftpService.MapDataToEachArea[DataClass,CsvMapper](String remoteDirectory, List`1 dataMethods) at EnergyDataHub.Data.Hangfire.Jobs.GenerationSyncJob.Run() at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#327	IGenerationSyncJob.Run An exception occurred during performance of the job. More details...	04/13/2025 12:45:53
#327	Npgsql.NpgsqlException Exception while reading from stream Npgsql.NpgsqlException: Exception while reading from stream ---> System.TimeoutException: Timeout during reading attempt --- End of inner exception stack trace --- at Npgsql.Internal.NpgsqlReadBuffer.<Ensure>g__EnsureLong\|55_0(NpgsqlReadBuffer buffer, Int32 count, Boolean async, Boolean readingNotifications) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token) at Npgsql.Internal.NpgsqlConnector.ReadMessageLong(Boolean async, DataRowLoadingMode dataRowLoadingMode, Boolean readingNotifications, Boolean isReadingPrependedMessage) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at Npgsql.NpgsqlBinaryImporter.Complete(Boolean async, CancellationToken cancellationToken) at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1 values) at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1 values) at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1 values) at EnergyDataHub.Data.Services.GenerationService.UpdateOutputAndConsumption(List`1 generationIds, List`1 data, AppDbContext context, DataSource dataSource) at EnergyDataHub.Data.Services.ControlAreaService.MapActualGeneration(List`1 data, AppDbContext context, DataSource dataSource) at EnergyDataHub.Data.Services.SftpService.MapDataToEachArea[DataClass,CsvMapper](String remoteDirectory, List`1 dataMethods) at EnergyDataHub.Data.Hangfire.Jobs.GenerationSyncJob.Run() at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#315	IGenerationSyncJob.Run An exception occurred during performance of the job. More details...	04/13/2025 09:30:12
#315	Renci.SshNet.Common.SshConnectionException The server response does not contain an SSH identification string. The connection to the remote server was closed before any data was received. More information on the Protocol Version Exchange is available here: https://tools.ietf.org/html/rfc4253#section-4.2 Renci.SshNet.Common.SshConnectionException: The server response does not contain an SSH identification string. The connection to the remote server was closed before any data was received. More information on the Protocol Version Exchange is available here: https://tools.ietf.org/html/rfc4253#section-4.2 at Renci.SshNet.Connection.ProtocolVersionExchange.Start(String clientVersion, Socket socket, TimeSpan timeout) at Renci.SshNet.Session.Connect() at Renci.SshNet.BaseClient.CreateAndConnectSession() at Renci.SshNet.BaseClient.Connect() at EnergyDataHub.Data.Services.SftpService.MapDataToEachArea[DataClass,CsvMapper](String remoteDirectory, List`1 dataMethods) at EnergyDataHub.Data.Hangfire.Jobs.GenerationSyncJob.Run() at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#302	IScheduledDayAheadTransferSyncJob.Run An exception occurred during performance of the job. More details...	04/13/2025 06:15:31
#302	CsvHelper.MissingFieldException Field at index '5' does not exist. You can ignore missing fields by setting MissingFieldFound to null. IReader state: ColumnCount: 0 CurrentIndex: 5 HeaderRecord: ["DateTime(UTC)","ResolutionCode","OutAreaCode","OutAreaDisplayName","OutAreaTypeCode","OutMapCode","InAreaCode","InAreaDisplayName","InAreaTypeCode","InMapCode","DayAheadCapacity[MW]","TotalCapacity[MW]","UpdateTime(UTC)"] IParser state: ByteCount: 0 CharCount: 28644000 Row: 202117 RawRow: 202117 Count: 5 RawRecord: 2025-04-07 22:00:00 PT60M 10YRO-TEL------P Romania (RO) BZN/C CsvHelper.MissingFieldException: Field at index '5' does not exist. You can ignore missing fields by setting MissingFieldFound to null. IReader state: ColumnCount: 0 CurrentIndex: 5 HeaderRecord: ["DateTime(UTC)","ResolutionCode","OutAreaCode","OutAreaDisplayName","OutAreaTypeCode","OutMapCode","InAreaCode","InAreaDisplayName","InAreaTypeCode","InMapCode","DayAheadCapacity[MW]","TotalCapacity[MW]","UpdateTime(UTC)"] IParser state: ByteCount: 0 CharCount: 28644000 Row: 202117 RawRow: 202117 Count: 5 RawRecord: 2025-04-07 22:00:00 PT60M 10YRO-TEL------P Romania (RO) BZN/C at CsvHelper.Configuration.ConfigurationFunctions.MissingFieldFound(MissingFieldFoundArgs args) at CsvHelper.CsvReader.GetField(Int32 index) at lambda_method3148(Closure) at CsvHelper.Expressions.RecordCreator.Create[T]() at CsvHelper.CsvReader.GetRecords[T]()+MoveNext() at System.Collections.Generic.List`1..ctor(IEnumerable`1 collection) at System.Linq.Enumerable.ToList[TSource](IEnumerable`1 source) at EnergyDataHub.Data.Services.SftpService.LoadGenericData[DataClass,CsvMapper](String fileLocation, SftpClient client) at EnergyDataHub.Data.Services.SftpService.MapDataToEachArea[DataClass,CsvMapper](String remoteDirectory, List`1 dataMethods) at EnergyDataHub.Data.Hangfire.Jobs.TransmissionCapacitySyncJob.Run() at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#287	IGenerationSyncJob.Run An exception occurred during performance of the job. More details...	04/13/2025 01:40:19
#287	Npgsql.NpgsqlException Exception while reading from stream Npgsql.NpgsqlException: Exception while reading from stream ---> System.TimeoutException: Timeout during reading attempt --- End of inner exception stack trace --- at Npgsql.Internal.NpgsqlReadBuffer.<Ensure>g__EnsureLong\|55_0(NpgsqlReadBuffer buffer, Int32 count, Boolean async, Boolean readingNotifications) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token) at Npgsql.Internal.NpgsqlConnector.ReadMessageLong(Boolean async, DataRowLoadingMode dataRowLoadingMode, Boolean readingNotifications, Boolean isReadingPrependedMessage) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at Npgsql.NpgsqlBinaryImporter.Complete(Boolean async, CancellationToken cancellationToken) at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1 values) at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1 values) at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1 values) at EnergyDataHub.Data.Services.GenerationService.UpdateOutputAndConsumption(List`1 generationIds, List`1 data, AppDbContext context, DataSource dataSource) at EnergyDataHub.Data.Services.ControlAreaService.MapActualGeneration(List`1 data, AppDbContext context, DataSource dataSource) at EnergyDataHub.Data.Services.SftpService.MapDataToEachArea[DataClass,CsvMapper](String remoteDirectory, List`1 dataMethods) at EnergyDataHub.Data.Hangfire.Jobs.GenerationSyncJob.Run() at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#283	IGenerationSyncJob.Run An exception occurred during performance of the job. More details...	04/13/2025 00:39:25
#283	Npgsql.NpgsqlException Exception while reading from stream Npgsql.NpgsqlException: Exception while reading from stream ---> System.TimeoutException: Timeout during reading attempt --- End of inner exception stack trace --- at Npgsql.Internal.NpgsqlReadBuffer.<Ensure>g__EnsureLong\|55_0(NpgsqlReadBuffer buffer, Int32 count, Boolean async, Boolean readingNotifications) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token) at Npgsql.Internal.NpgsqlConnector.ReadMessageLong(Boolean async, DataRowLoadingMode dataRowLoadingMode, Boolean readingNotifications, Boolean isReadingPrependedMessage) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at Npgsql.NpgsqlBinaryImporter.Complete(Boolean async, CancellationToken cancellationToken) at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1 values) at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1 values) at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1 values) at EnergyDataHub.Data.Services.GenerationService.UpdateOutputAndConsumption(List`1 generationIds, List`1 data, AppDbContext context, DataSource dataSource) at EnergyDataHub.Data.Services.ControlAreaService.MapActualGeneration(List`1 data, AppDbContext context, DataSource dataSource) at EnergyDataHub.Data.Services.SftpService.MapDataToEachArea[DataClass,CsvMapper](String remoteDirectory, List`1 dataMethods) at EnergyDataHub.Data.Hangfire.Jobs.GenerationSyncJob.Run() at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#278	IGenerationSyncJob.Run An exception occurred during performance of the job. More details...	04/12/2025 23:48:01
#278	Npgsql.NpgsqlException Exception while reading from stream Npgsql.NpgsqlException: Exception while reading from stream ---> System.TimeoutException: Timeout during reading attempt --- End of inner exception stack trace --- at Npgsql.Internal.NpgsqlReadBuffer.<Ensure>g__EnsureLong\|55_0(NpgsqlReadBuffer buffer, Int32 count, Boolean async, Boolean readingNotifications) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token) at Npgsql.Internal.NpgsqlConnector.ReadMessageLong(Boolean async, DataRowLoadingMode dataRowLoadingMode, Boolean readingNotifications, Boolean isReadingPrependedMessage) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at Npgsql.NpgsqlBinaryImporter.Complete(Boolean async, CancellationToken cancellationToken) at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1 values) at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1 values) at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1 values) at EnergyDataHub.Data.Services.GenerationService.UpdateOutputAndConsumption(List`1 generationIds, List`1 data, AppDbContext context, DataSource dataSource) at EnergyDataHub.Data.Services.ControlAreaService.MapActualGeneration(List`1 data, AppDbContext context, DataSource dataSource) at EnergyDataHub.Data.Services.SftpService.MapDataToEachArea[DataClass,CsvMapper](String remoteDirectory, List`1 dataMethods) at EnergyDataHub.Data.Hangfire.Jobs.GenerationSyncJob.Run() at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#275	IGenerationSyncJob.Run An exception occurred during performance of the job. More details...	04/12/2025 23:02:44
#275	Npgsql.NpgsqlException Exception while reading from stream Npgsql.NpgsqlException: Exception while reading from stream ---> System.TimeoutException: Timeout during reading attempt --- End of inner exception stack trace --- at Npgsql.Internal.NpgsqlReadBuffer.<Ensure>g__EnsureLong\|55_0(NpgsqlReadBuffer buffer, Int32 count, Boolean async, Boolean readingNotifications) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token) at Npgsql.Internal.NpgsqlConnector.ReadMessageLong(Boolean async, DataRowLoadingMode dataRowLoadingMode, Boolean readingNotifications, Boolean isReadingPrependedMessage) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at Npgsql.NpgsqlBinaryImporter.Complete(Boolean async, CancellationToken cancellationToken) at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1 values) at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1 values) at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1 values) at EnergyDataHub.Data.Services.GenerationService.UpdateOutputAndConsumption(List`1 generationIds, List`1 data, AppDbContext context, DataSource dataSource) at EnergyDataHub.Data.Services.ControlAreaService.MapActualGeneration(List`1 data, AppDbContext context, DataSource dataSource) at EnergyDataHub.Data.Services.SftpService.MapDataToEachArea[DataClass,CsvMapper](String remoteDirectory, List`1 dataMethods) at EnergyDataHub.Data.Hangfire.Jobs.GenerationSyncJob.Run() at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#273	ILoadSyncJob.Run An exception occurred during performance of the job. More details...	04/12/2025 22:15:13
#273	Renci.SshNet.Common.SshConnectionException The server response does not contain an SSH identification string. The connection to the remote server was closed before any data was received. More information on the Protocol Version Exchange is available here: https://tools.ietf.org/html/rfc4253#section-4.2 Renci.SshNet.Common.SshConnectionException: The server response does not contain an SSH identification string. The connection to the remote server was closed before any data was received. More information on the Protocol Version Exchange is available here: https://tools.ietf.org/html/rfc4253#section-4.2 at Renci.SshNet.Connection.ProtocolVersionExchange.Start(String clientVersion, Socket socket, TimeSpan timeout) at Renci.SshNet.Session.Connect() at Renci.SshNet.BaseClient.CreateAndConnectSession() at Renci.SshNet.BaseClient.Connect() at EnergyDataHub.Data.Services.SftpService.MapDataToEachArea[DataClass,CsvMapper](String remoteDirectory, List`1 dataMethods) at EnergyDataHub.Data.Hangfire.Jobs.LoadSyncJob.Run() at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#271	IGenerationSyncJob.Run An exception occurred during performance of the job. More details...	04/12/2025 22:04:54
#271	Npgsql.NpgsqlException Exception while reading from stream Npgsql.NpgsqlException: Exception while reading from stream ---> System.TimeoutException: Timeout during reading attempt --- End of inner exception stack trace --- at Npgsql.Internal.NpgsqlReadBuffer.<Ensure>g__EnsureLong\|55_0(NpgsqlReadBuffer buffer, Int32 count, Boolean async, Boolean readingNotifications) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token) at Npgsql.Internal.NpgsqlConnector.ReadMessageLong(Boolean async, DataRowLoadingMode dataRowLoadingMode, Boolean readingNotifications, Boolean isReadingPrependedMessage) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at Npgsql.NpgsqlBinaryImporter.Complete(Boolean async, CancellationToken cancellationToken) at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1 values) at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1 values) at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1 values) at EnergyDataHub.Data.Services.GenerationService.UpdateOutputAndConsumption(List`1 generationIds, List`1 data, AppDbContext context, DataSource dataSource) at EnergyDataHub.Data.Services.ControlAreaService.MapActualGeneration(List`1 data, AppDbContext context, DataSource dataSource) at EnergyDataHub.Data.Services.SftpService.MapDataToEachArea[DataClass,CsvMapper](String remoteDirectory, List`1 dataMethods) at EnergyDataHub.Data.Hangfire.Jobs.GenerationSyncJob.Run() at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)

Npgsql.NpgsqlException

Npgsql.NpgsqlException

Renci.SshNet.Common.SshConnectionException

CsvHelper.MissingFieldException

Npgsql.NpgsqlException

Npgsql.NpgsqlException

Npgsql.NpgsqlException

Npgsql.NpgsqlException

Renci.SshNet.Common.SshConnectionException

Npgsql.NpgsqlException