Failed Jobs

Id	Job	Failed
#1755	ILoadSyncJob.Run An exception occurred during performance of the job. Fewer details...	04/26/2025 19:18:43
#1755	Microsoft.EntityFrameworkCore.Storage.RetryLimitExceededException The maximum number of retries (5) was exceeded while executing database operations with 'NpgsqlRetryingExecutionStrategy'. See the inner exception for the most recent failure. Microsoft.EntityFrameworkCore.Storage.RetryLimitExceededException: The maximum number of retries (5) was exceeded while executing database operations with 'NpgsqlRetryingExecutionStrategy'. See the inner exception for the most recent failure. ---> Microsoft.EntityFrameworkCore.DbUpdateException: An error occurred while saving the entity changes. See the inner exception for details. ---> Npgsql.PostgresException: 53100: could not extend file "base/18813/19276.11": No space left on device at Npgsql.Internal.NpgsqlConnector.ReadMessageLong(Boolean async, DataRowLoadingMode dataRowLoadingMode, Boolean readingNotifications, Boolean isReadingPrependedMessage) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at Npgsql.NpgsqlDataReader.NextResult(Boolean async, Boolean isConsuming, CancellationToken cancellationToken) at Npgsql.NpgsqlDataReader.NextResult(Boolean async, Boolean isConsuming, CancellationToken cancellationToken) at Npgsql.EntityFrameworkCore.PostgreSQL.Update.Internal.NpgsqlModificationCommandBatch.Consume(RelationalDataReader reader, Boolean async, CancellationToken cancellationToken) --- End of inner exception stack trace --- at Npgsql.EntityFrameworkCore.PostgreSQL.Update.Internal.NpgsqlModificationCommandBatch.Consume(RelationalDataReader reader, Boolean async, CancellationToken cancellationToken) at Microsoft.EntityFrameworkCore.Update.ReaderModificationCommandBatch.ExecuteAsync(IRelationalConnection connection, CancellationToken cancellationToken) at Microsoft.EntityFrameworkCore.Update.ReaderModificationCommandBatch.ExecuteAsync(IRelationalConnection connection, CancellationToken cancellationToken) at Microsoft.EntityFrameworkCore.Update.Internal.BatchExecutor.ExecuteAsync(IEnumerable`1 commandBatches, IRelationalConnection connection, CancellationToken cancellationToken) at Microsoft.EntityFrameworkCore.Update.Internal.BatchExecutor.ExecuteAsync(IEnumerable`1 commandBatches, IRelationalConnection connection, CancellationToken cancellationToken) at Microsoft.EntityFrameworkCore.Update.Internal.BatchExecutor.ExecuteAsync(IEnumerable`1 commandBatches, IRelationalConnection connection, CancellationToken cancellationToken) at Microsoft.EntityFrameworkCore.ChangeTracking.Internal.StateManager.SaveChangesAsync(IList`1 entriesToSave, CancellationToken cancellationToken) at Microsoft.EntityFrameworkCore.ChangeTracking.Internal.StateManager.SaveChangesAsync(StateManager stateManager, Boolean acceptAllChangesOnSuccess, CancellationToken cancellationToken) at Microsoft.EntityFrameworkCore.Storage.ExecutionStrategy.<>c__DisplayClass30_0`2.<<ExecuteAsync>b__0>d.MoveNext() --- End of stack trace from previous location --- at Microsoft.EntityFrameworkCore.Storage.ExecutionStrategy.ExecuteImplementationAsync[TState,TResult](Func`4 operation, Func`4 verifySucceeded, TState state, CancellationToken cancellationToken) --- End of inner exception stack trace --- at Microsoft.EntityFrameworkCore.Storage.ExecutionStrategy.ExecuteImplementationAsync[TState,TResult](Func`4 operation, Func`4 verifySucceeded, TState state, CancellationToken cancellationToken) at Microsoft.EntityFrameworkCore.Storage.ExecutionStrategy.ExecuteAsync[TState,TResult](TState state, Func`4 operation, Func`4 verifySucceeded, CancellationToken cancellationToken) at Microsoft.EntityFrameworkCore.DbContext.SaveChangesAsync(Boolean acceptAllChangesOnSuccess, CancellationToken cancellationToken) at Microsoft.EntityFrameworkCore.DbContext.SaveChangesAsync(Boolean acceptAllChangesOnSuccess, CancellationToken cancellationToken) at EnergyDataHub.Data.Services.LoadService.UpdateActualLoadAsync(Guid loadGuid, List`1 data, AppDbContext context, DataSource dataSource) at EnergyDataHub.Data.Services.ControlAreaService.MapLoads(List`1 data, AppDbContext context, DataSource dataSource) at EnergyDataHub.Data.Services.SftpService.MapDataToEachArea[DataClass,CsvMapper](String remoteDirectory, List`1 dataMethods, Int32 retryCount) at EnergyDataHub.Data.Services.SftpService.MapDataToEachArea[DataClass,CsvMapper](String remoteDirectory, List`1 dataMethods) at EnergyDataHub.Data.Hangfire.Jobs.LoadSyncJob.Run() at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
#1719	Can not find the target method. An exception occurred during performance of the job. More details...	04/26/2025 13:05:31
#1719	System.Exception Forecast script failed with exit code 1 `System.Exception: Forecast script failed with exit code 1 at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettings forecastSettings, String predictorsPath) at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Location location, VisualCrossingDataDto weatherForecastDto) at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)`
#1700	Can not find the target method. An exception occurred during performance of the job. More details...	04/26/2025 10:05:22
#1700	System.Exception Forecast script failed with exit code 1 `System.Exception: Forecast script failed with exit code 1 at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettings forecastSettings, String predictorsPath) at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Location location, VisualCrossingDataDto weatherForecastDto) at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)`
#1681	Can not find the target method. An exception occurred during performance of the job. More details...	04/26/2025 07:05:35
#1681	System.Exception Forecast script failed with exit code 1 `System.Exception: Forecast script failed with exit code 1 at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettings forecastSettings, String predictorsPath) at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Location location, VisualCrossingDataDto weatherForecastDto) at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)`
#1664	Can not find the target method. An exception occurred during performance of the job. More details...	04/26/2025 04:05:29
#1664	System.Exception Forecast script failed with exit code 1 `System.Exception: Forecast script failed with exit code 1 at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettings forecastSettings, String predictorsPath) at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Location location, VisualCrossingDataDto weatherForecastDto) at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)`
#1647	Can not find the target method. An exception occurred during performance of the job. More details...	04/26/2025 01:05:24
#1647	System.Exception Forecast script failed with exit code 1 `System.Exception: Forecast script failed with exit code 1 at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettings forecastSettings, String predictorsPath) at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Location location, VisualCrossingDataDto weatherForecastDto) at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)`
#1628	Can not find the target method. An exception occurred during performance of the job. More details...	04/25/2025 22:05:29
#1628	System.Exception Forecast script failed with exit code 1 `System.Exception: Forecast script failed with exit code 1 at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettings forecastSettings, String predictorsPath) at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Location location, VisualCrossingDataDto weatherForecastDto) at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)`
#1611	Can not find the target method. An exception occurred during performance of the job. More details...	04/25/2025 19:05:32
#1611	System.Exception Forecast script failed with exit code 1 `System.Exception: Forecast script failed with exit code 1 at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettings forecastSettings, String predictorsPath) at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Location location, VisualCrossingDataDto weatherForecastDto) at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)`
#1594	Can not find the target method. An exception occurred during performance of the job. More details...	04/25/2025 16:05:36
#1594	System.Exception Forecast script failed with exit code 1 `System.Exception: Forecast script failed with exit code 1 at EnergyDataHub.Data.Services.ProductionForecastService.RunForecastScript(ForecastLocationSettings forecastSettings, String predictorsPath) at EnergyDataHub.Data.Services.ProductionForecastService.ForecastGeneration(Location location, VisualCrossingDataDto weatherForecastDto) at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)`
#1574	IVisualCrossingSyncJob.Run An exception occurred during performance of the job. More details...	04/25/2025 13:05:28
#1574	Hangfire.BackgroundJobClientException Background job creation failed. See inner exception for details. Hangfire.BackgroundJobClientException: Background job creation failed. See inner exception for details. ---> Newtonsoft.Json.JsonSerializationException: Self referencing loop detected for property 'Location' with type 'EnergyDataHub.Domain.Models.Location'. Path 'WeatherData[0]'. at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.CheckForCircularReference(JsonWriter writer, Object value, JsonProperty property, JsonContract contract, JsonContainerContract containerContract, JsonProperty containerProperty) at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.SerializeObject(JsonWriter writer, Object value, JsonObjectContract contract, JsonProperty member, JsonContainerContract collectionContract, JsonProperty containerProperty) at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.SerializeValue(JsonWriter writer, Object value, JsonContract valueContract, JsonProperty member, JsonContainerContract containerContract, JsonProperty containerProperty) at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.SerializeList(JsonWriter writer, IEnumerable values, JsonArrayContract contract, JsonProperty member, JsonContainerContract collectionContract, JsonProperty containerProperty) at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.SerializeValue(JsonWriter writer, Object value, JsonContract valueContract, JsonProperty member, JsonContainerContract containerContract, JsonProperty containerProperty) at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.SerializeObject(JsonWriter writer, Object value, JsonObjectContract contract, JsonProperty member, JsonContainerContract collectionContract, JsonProperty containerProperty) at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.SerializeValue(JsonWriter writer, Object value, JsonContract valueContract, JsonProperty member, JsonContainerContract containerContract, JsonProperty containerProperty) at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.Serialize(JsonWriter jsonWriter, Object value, Type objectType) at Newtonsoft.Json.JsonSerializer.SerializeInternal(JsonWriter jsonWriter, Object value, Type objectType) at Newtonsoft.Json.JsonConvert.SerializeObjectInternal(Object value, Type type, JsonSerializer jsonSerializer) at Hangfire.Common.SerializationHelper.Serialize(Object value, Type type, SerializationOption option) at Hangfire.Storage.InvocationData.SerializeArguments(MethodInfo methodInfo, IReadOnlyList`1 arguments) at Hangfire.Storage.InvocationData.SerializeJob(Job job) at Hangfire.PostgreSql.PostgreSqlConnection.CreateExpiredJob(Job job, IDictionary`2 parameters, DateTime createdAt, TimeSpan expireIn) at Hangfire.Client.CoreBackgroundJobFactory.<>c.<CreateBackgroundJobTwoSteps>b__15_0(Int32 _, JobCreateContext ctx) at Hangfire.Client.CoreBackgroundJobFactory.RetryOnException[TContext,TResult](Int32& attemptsLeft, Func`3 action, TContext context) --- End of stack trace from previous location --- at Hangfire.Client.CoreBackgroundJobFactory.RetryOnException[TContext,TResult](Int32& attemptsLeft, Func`3 action, TContext context) at Hangfire.Client.CoreBackgroundJobFactory.CreateBackgroundJobTwoSteps(CreateContext context, Dictionary`2 parameters, DateTime createdAt, TimeSpan expireIn) at Hangfire.Client.CoreBackgroundJobFactory.Create(CreateContext context) at Hangfire.Client.BackgroundJobFactory.InvokeNextClientFilter(Enumerator& enumerator, IBackgroundJobFactory innerFactory, CreateContext context, CreatingContext preContext) at Hangfire.Client.BackgroundJobFactory.InvokeClientFilter(Enumerator& enumerator, IBackgroundJobFactory innerFactory, CreateContext context, CreatingContext preContext) at Hangfire.Client.BackgroundJobFactory.InvokeNextClientFilter(Enumerator& enumerator, IBackgroundJobFactory innerFactory, CreateContext context, CreatingContext preContext) at Hangfire.Client.BackgroundJobFactory.CreateWithFilters(CreateContext context, FilterCollection`1 filters) at Hangfire.Client.BackgroundJobFactory.Create(CreateContext context) at Hangfire.BackgroundJobClient.Create(Job job, IState state, IDictionary`2 parameters) --- End of inner exception stack trace --- at Hangfire.BackgroundJobClient.Create(Job job, IState state, IDictionary`2 parameters) at Hangfire.BackgroundJobClient.Create(Job job, IState state) at Hangfire.BackgroundJobClientExtensions.Create(IBackgroundJobClient client, Expression`1 methodCall, IState state) at Hangfire.BackgroundJobClientExtensions.Enqueue(IBackgroundJobClient client, Expression`1 methodCall) at Hangfire.BackgroundJob.Enqueue(Expression`1 methodCall) at EnergyDataHub.Data.Services.ProductionForecastService.ForecastForLocation(Location location, VisualCrossingDataDto weatherForecastDto) at EnergyDataHub.Data.Hangfire.Jobs.VisualCrossingSyncJob.Run() at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)

Microsoft.EntityFrameworkCore.Storage.RetryLimitExceededException

System.Exception

System.Exception

System.Exception

System.Exception

System.Exception

System.Exception

System.Exception

System.Exception

Hangfire.BackgroundJobClientException