Failed jobs do not become expired to allow you to re-queue them without any
time pressure. You should re-queue or delete them manually, or apply AutomaticRetry(OnAttemptsExceeded = AttemptsExceededAction.Delete)
attribute to delete them automatically.
An exception occurred during performance of the job. Fewer details...
05/20/2025 16:15:39
Renci.SshNet.Common.SshOperationTimeoutException
Connection failed to establish within 30000 milliseconds.
Renci.SshNet.Common.SshOperationTimeoutException: Connection failed to establish within 30000 milliseconds.
at Renci.SshNet.Abstractions.SocketAbstraction.ConnectCore(Socketsocket, IPEndPointremoteEndpoint, TimeSpanconnectTimeout, BooleanownsSocket)
at Renci.SshNet.Connection.ConnectorBase.SocketConnect(Stringhost, Int32port, TimeSpantimeout)
at Renci.SshNet.Session.Connect()
at Renci.SshNet.BaseClient.CreateAndConnectSession()
at Renci.SshNet.BaseClient.Connect()
at EnergyDataHub.Data.Services.SftpService.MapDataToEachArea[DataClass,CsvMapper](StringremoteDirectory, List`1dataMethods, Int32retryCount)
at EnergyDataHub.Data.Services.SftpService.MapDataToEachArea[DataClass,CsvMapper](StringremoteDirectory, List`1dataMethods)
at EnergyDataHub.Data.Hangfire.Jobs.TransmissionCapacitySyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/20/2025 16:15:39
Renci.SshNet.Common.SshOperationTimeoutException
Connection failed to establish within 30000 milliseconds.
Renci.SshNet.Common.SshOperationTimeoutException: Connection failed to establish within 30000 milliseconds.
at Renci.SshNet.Abstractions.SocketAbstraction.ConnectCore(Socketsocket, IPEndPointremoteEndpoint, TimeSpanconnectTimeout, BooleanownsSocket)
at Renci.SshNet.Connection.ConnectorBase.SocketConnect(Stringhost, Int32port, TimeSpantimeout)
at Renci.SshNet.Session.Connect()
at Renci.SshNet.BaseClient.CreateAndConnectSession()
at Renci.SshNet.BaseClient.Connect()
at EnergyDataHub.Data.Services.SftpService.MapDataToEachArea[DataClass,CsvMapper](StringremoteDirectory, List`1dataMethods, Int32retryCount)
at EnergyDataHub.Data.Services.SftpService.MapDataToEachArea[DataClass,CsvMapper](StringremoteDirectory, List`1dataMethods)
at EnergyDataHub.Data.Hangfire.Jobs.LoadSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/20/2025 15:30:39
Renci.SshNet.Common.SshOperationTimeoutException
Connection failed to establish within 30000 milliseconds.
Renci.SshNet.Common.SshOperationTimeoutException: Connection failed to establish within 30000 milliseconds.
at Renci.SshNet.Abstractions.SocketAbstraction.ConnectCore(Socketsocket, IPEndPointremoteEndpoint, TimeSpanconnectTimeout, BooleanownsSocket)
at Renci.SshNet.Connection.ConnectorBase.SocketConnect(Stringhost, Int32port, TimeSpantimeout)
at Renci.SshNet.Session.Connect()
at Renci.SshNet.BaseClient.CreateAndConnectSession()
at Renci.SshNet.BaseClient.Connect()
at EnergyDataHub.Data.Services.SftpService.MapDataToEachArea[DataClass,CsvMapper](StringremoteDirectory, List`1dataMethods, Int32retryCount)
at EnergyDataHub.Data.Services.SftpService.MapDataToEachArea[DataClass,CsvMapper](StringremoteDirectory, List`1dataMethods)
at EnergyDataHub.Data.Hangfire.Jobs.GenerationSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/20/2025 15:15:38
Renci.SshNet.Common.SshOperationTimeoutException
Connection failed to establish within 30000 milliseconds.
Renci.SshNet.Common.SshOperationTimeoutException: Connection failed to establish within 30000 milliseconds.
at Renci.SshNet.Abstractions.SocketAbstraction.ConnectCore(Socketsocket, IPEndPointremoteEndpoint, TimeSpanconnectTimeout, BooleanownsSocket)
at Renci.SshNet.Connection.ConnectorBase.SocketConnect(Stringhost, Int32port, TimeSpantimeout)
at Renci.SshNet.Session.Connect()
at Renci.SshNet.BaseClient.CreateAndConnectSession()
at Renci.SshNet.BaseClient.Connect()
at EnergyDataHub.Data.Services.SftpService.MapDataToEachArea[DataClass,CsvMapper](StringremoteDirectory, List`1dataMethods, Int32retryCount)
at EnergyDataHub.Data.Services.SftpService.MapDataToEachArea[DataClass,CsvMapper](StringremoteDirectory, List`1dataMethods)
at EnergyDataHub.Data.Hangfire.Jobs.TransmissionCapacitySyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/20/2025 15:15:38
Renci.SshNet.Common.SshOperationTimeoutException
Connection failed to establish within 30000 milliseconds.
Renci.SshNet.Common.SshOperationTimeoutException: Connection failed to establish within 30000 milliseconds.
at Renci.SshNet.Abstractions.SocketAbstraction.ConnectCore(Socketsocket, IPEndPointremoteEndpoint, TimeSpanconnectTimeout, BooleanownsSocket)
at Renci.SshNet.Connection.ConnectorBase.SocketConnect(Stringhost, Int32port, TimeSpantimeout)
at Renci.SshNet.Session.Connect()
at Renci.SshNet.BaseClient.CreateAndConnectSession()
at Renci.SshNet.BaseClient.Connect()
at EnergyDataHub.Data.Services.SftpService.MapDataToEachArea[DataClass,CsvMapper](StringremoteDirectory, List`1dataMethods, Int32retryCount)
at EnergyDataHub.Data.Services.SftpService.MapDataToEachArea[DataClass,CsvMapper](StringremoteDirectory, List`1dataMethods)
at EnergyDataHub.Data.Hangfire.Jobs.LoadSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/20/2025 12:00:07
System.InvalidOperationException
Sequence contains no matching element
System.InvalidOperationException: Sequence contains no matching element
at System.Linq.ThrowHelper.ThrowNoMatchException()
at EnergyDataHub.Data.Hangfire.Jobs.JaoSyncJob.CreateFlowBasedDataModel(FlowBasedDataDtodto, List`1controlAreas)
at EnergyDataHub.Data.Hangfire.Jobs.JaoSyncJob.PrepareFlowBasedDataEntities(List`1dtos)
at EnergyDataHub.Data.Hangfire.Jobs.JaoSyncJob.GetHourlyData(DateTimestart)
at EnergyDataHub.Data.Hangfire.Jobs.JaoSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/18/2025 01:00:05
Newtonsoft.Json.JsonSerializationException
Error converting value {null} to type 'System.Double'. Path 'data.ida2[0].peakVolume', line 1, position 30850.
Newtonsoft.Json.JsonSerializationException: Error converting value {null} to type 'System.Double'. Path 'data.ida2[0].peakVolume', line 1, position 30850. ---> System.InvalidCastException: Null object cannot be converted to a value type.
at System.Convert.ChangeType(Objectvalue, TypeconversionType, IFormatProviderprovider)
at Newtonsoft.Json.Serialization.JsonSerializerInternalReader.EnsureType(JsonReaderreader, Objectvalue, CultureInfoculture, JsonContractcontract, TypetargetType)
--- End of inner exception stack trace ---
at Newtonsoft.Json.Serialization.JsonSerializerInternalReader.EnsureType(JsonReaderreader, Objectvalue, CultureInfoculture, JsonContractcontract, TypetargetType)
at Newtonsoft.Json.Serialization.JsonSerializerInternalReader.CreateValueInternal(JsonReaderreader, TypeobjectType, JsonContractcontract, JsonPropertymember, JsonContainerContractcontainerContract, JsonPropertycontainerMember, ObjectexistingValue)
at Newtonsoft.Json.Serialization.JsonSerializerInternalReader.SetPropertyValue(JsonPropertyproperty, JsonConverterpropertyConverter, JsonContainerContractcontainerContract, JsonPropertycontainerProperty, JsonReaderreader, Objecttarget)
at Newtonsoft.Json.Serialization.JsonSerializerInternalReader.PopulateObject(ObjectnewObject, JsonReaderreader, JsonObjectContractcontract, JsonPropertymember, Stringid)
at Newtonsoft.Json.Serialization.JsonSerializerInternalReader.CreateObject(JsonReaderreader, TypeobjectType, JsonContractcontract, JsonPropertymember, JsonContainerContractcontainerContract, JsonPropertycontainerMember, ObjectexistingValue)
at Newtonsoft.Json.Serialization.JsonSerializerInternalReader.CreateValueInternal(JsonReaderreader, TypeobjectType, JsonContractcontract, JsonPropertymember, JsonContainerContractcontainerContract, JsonPropertycontainerMember, ObjectexistingValue)
at Newtonsoft.Json.Serialization.JsonSerializerInternalReader.PopulateList(IListlist, JsonReaderreader, JsonArrayContractcontract, JsonPropertycontainerProperty, Stringid)
at Newtonsoft.Json.Serialization.JsonSerializerInternalReader.CreateList(JsonReaderreader, TypeobjectType, JsonContractcontract, JsonPropertymember, ObjectexistingValue, Stringid)
at Newtonsoft.Json.Serialization.JsonSerializerInternalReader.CreateValueInternal(JsonReaderreader, TypeobjectType, JsonContractcontract, JsonPropertymember, JsonContainerContractcontainerContract, JsonPropertycontainerMember, ObjectexistingValue)
at Newtonsoft.Json.Serialization.JsonSerializerInternalReader.PopulateDictionary(IDictionarydictionary, JsonReaderreader, JsonDictionaryContractcontract, JsonPropertycontainerProperty, Stringid)
at Newtonsoft.Json.Serialization.JsonSerializerInternalReader.CreateObject(JsonReaderreader, TypeobjectType, JsonContractcontract, JsonPropertymember, JsonContainerContractcontainerContract, JsonPropertycontainerMember, ObjectexistingValue)
at Newtonsoft.Json.Serialization.JsonSerializerInternalReader.CreateValueInternal(JsonReaderreader, TypeobjectType, JsonContractcontract, JsonPropertymember, JsonContainerContractcontainerContract, JsonPropertycontainerMember, ObjectexistingValue)
at Newtonsoft.Json.Serialization.JsonSerializerInternalReader.SetPropertyValue(JsonPropertyproperty, JsonConverterpropertyConverter, JsonContainerContractcontainerContract, JsonPropertycontainerProperty, JsonReaderreader, Objecttarget)
at Newtonsoft.Json.Serialization.JsonSerializerInternalReader.PopulateObject(ObjectnewObject, JsonReaderreader, JsonObjectContractcontract, JsonPropertymember, Stringid)
at Newtonsoft.Json.Serialization.JsonSerializerInternalReader.CreateObject(JsonReaderreader, TypeobjectType, JsonContractcontract, JsonPropertymember, JsonContainerContractcontainerContract, JsonPropertycontainerMember, ObjectexistingValue)
at Newtonsoft.Json.Serialization.JsonSerializerInternalReader.CreateValueInternal(JsonReaderreader, TypeobjectType, JsonContractcontract, JsonPropertymember, JsonContainerContractcontainerContract, JsonPropertycontainerMember, ObjectexistingValue)
at Newtonsoft.Json.Serialization.JsonSerializerInternalReader.Deserialize(JsonReaderreader, TypeobjectType, BooleancheckAdditionalContent)
at Newtonsoft.Json.JsonSerializer.DeserializeInternal(JsonReaderreader, TypeobjectType)
at Newtonsoft.Json.JsonConvert.DeserializeObject(Stringvalue, Typetype, JsonSerializerSettingssettings)
at Newtonsoft.Json.JsonConvert.DeserializeObject[T](Stringvalue, JsonSerializerSettingssettings)
at EnergyDataHub.Data.Services.CropexClient.GetCropexWebData[T](Stringpath, NameValueCollectionqueryParams)
at EnergyDataHub.Data.Services.CropexClient.GetIntradayAuctions(DateOnlyfrom, DateOnlyto)
at EnergyDataHub.Data.Services.CropexClient.GetIntradayAuctions(DateOnlydate)
at EnergyDataHub.Data.Hangfire.Jobs.IntradayAuctionsSyncJob.StoreReuslts(DateOnlydate)
at EnergyDataHub.Data.Hangfire.Jobs.IntradayAuctionsSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/17/2025 12:02:31
System.Net.Http.HttpRequestException
Response status code does not indicate success: 500 (Internal Server Error).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 500 (Internal Server Error).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at System.Net.Http.HttpClient.GetStringAsyncCore(HttpRequestMessagerequest, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.FinalComputationClient.GetFinalComputation(DateTimefrom, Nullable`1to, Int32skip, Int32take, FinalComputationFilterfilters)
at EnergyDataHub.Data.Hangfire.Jobs.JaoSyncJob.GetHourlyData(DateTimestart)
at EnergyDataHub.Data.Hangfire.Jobs.JaoSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/16/2025 12:04:55
System.Net.Http.HttpRequestException
Response status code does not indicate success: 500 (Internal Server Error).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 500 (Internal Server Error).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at System.Net.Http.HttpClient.GetStringAsyncCore(HttpRequestMessagerequest, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.FinalComputationClient.GetFinalComputation(DateTimefrom, Nullable`1to, Int32skip, Int32take, FinalComputationFilterfilters)
at EnergyDataHub.Data.Hangfire.Jobs.JaoSyncJob.GetHourlyData(DateTimestart)
at EnergyDataHub.Data.Hangfire.Jobs.JaoSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/13/2025 13:28:08
Npgsql.NpgsqlException
Exception while writing to stream
Npgsql.NpgsqlException: Exception while writing to stream ---> System.TimeoutException: Timeout during writing attempt
--- End of inner exception stack trace ---
at Npgsql.Internal.NpgsqlWriteBuffer.Flush(Booleanasync, CancellationTokencancellationToken)
at Npgsql.Internal.NpgsqlBufferWriter.Flush(TimeSpantimeout)
at Npgsql.Internal.PgWriter.Flush(Booleanasync, CancellationTokencancellationToken)
at Npgsql.NpgsqlParameter.Write(Booleanasync, PgWriterwriter, CancellationTokencancellationToken)
at Npgsql.NpgsqlBinaryImporter.<Write>g__Core|26_0[T](Booleanasync, Tvalue, Nullable`1npgsqlDbType, StringdataTypeName, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1values)
at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1values)
at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1values)
at EnergyDataHub.Data.Services.GenerationService.UpdateOutputAndConsumption(List`1generationIds, List`1data, AppDbContextcontext, DataSourcedataSource)
at EnergyDataHub.Data.Services.ControlAreaService.MapActualGeneration(List`1data, AppDbContextcontext, DataSourcedataSource)
at EnergyDataHub.Data.Services.SftpService.MapDataToEachArea[DataClass,CsvMapper](StringremoteDirectory, List`1dataMethods, Int32retryCount)
at EnergyDataHub.Data.Services.SftpService.MapDataToEachArea[DataClass,CsvMapper](StringremoteDirectory, List`1dataMethods)
at EnergyDataHub.Data.Hangfire.Jobs.GenerationSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/13/2025 12:09:19
System.Net.Http.HttpRequestException
Response status code does not indicate success: 500 (Internal Server Error).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 500 (Internal Server Error).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at System.Net.Http.HttpClient.GetStringAsyncCore(HttpRequestMessagerequest, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.FinalComputationClient.GetFinalComputation(DateTimefrom, Nullable`1to, Int32skip, Int32take, FinalComputationFilterfilters)
at EnergyDataHub.Data.Hangfire.Jobs.JaoSyncJob.GetHourlyData(DateTimestart)
at EnergyDataHub.Data.Hangfire.Jobs.JaoSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/13/2025 13:28:08
Npgsql.NpgsqlException
Exception while writing to stream
Npgsql.NpgsqlException: Exception while writing to stream ---> System.TimeoutException: Timeout during writing attempt
--- End of inner exception stack trace ---
at Npgsql.Internal.NpgsqlWriteBuffer.Flush(Booleanasync, CancellationTokencancellationToken)
at Npgsql.Internal.NpgsqlBufferWriter.Flush(TimeSpantimeout)
at Npgsql.Internal.PgWriter.Flush(Booleanasync, CancellationTokencancellationToken)
at Npgsql.NpgsqlParameter.Write(Booleanasync, PgWriterwriter, CancellationTokencancellationToken)
at Npgsql.NpgsqlBinaryImporter.<Write>g__Core|26_0[T](Booleanasync, Tvalue, Nullable`1npgsqlDbType, StringdataTypeName, CancellationTokencancellationToken)
at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1values)
at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1values)
at EnergyDataHub.Data.Services.TimeseriesBulkInserter.BulkInsertAsync(IEnumerable`1values)
at EnergyDataHub.Data.Services.GenerationService.UpdateOutputAndConsumption(List`1generationIds, List`1data, AppDbContextcontext, DataSourcedataSource)
at EnergyDataHub.Data.Services.BiddingZoneService.MapActualGeneration(List`1data, AppDbContextcontext, DataSourcedataSource)
at EnergyDataHub.Data.Services.SftpService.MapDataToEachArea[DataClass,CsvMapper](StringremoteDirectory, List`1dataMethods, Int32retryCount)
at EnergyDataHub.Data.Services.SftpService.MapDataToEachArea[DataClass,CsvMapper](StringremoteDirectory, List`1dataMethods)
at EnergyDataHub.Data.Hangfire.Jobs.GenerationSyncJob.Run()
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/12/2025 13:05:22
System.Exception
Forecast script failed with exit code 143
System.Exception: Forecast script failed with exit code 143
at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettingsforecastSettings, StringpredictorsPath)
at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Locationlocation, VisualCrossingDataDtoweatherForecastDto)
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)