Failed jobs do not become expired to allow you to re-queue them without any
time pressure. You should re-queue or delete them manually, or apply AutomaticRetry(OnAttemptsExceeded = AttemptsExceededAction.Delete)
attribute to delete them automatically.
An exception occurred during performance of the job. Fewer details...
02/15/2026 20:12:10
Grpc.Core.RpcException
Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (integration:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (integration:80)")
Grpc.Core.RpcException: Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (integration:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (integration:80)") ---> System.Net.Http.HttpRequestException: Connection timed out (integration:80) ---> System.Net.Sockets.SocketException: Connection timed out
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16token)
at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(Stringhost, Int32port, HttpRequestMessageinitialRequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(Stringhost, Int32port, HttpRequestMessageinitialRequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.InjectNewHttp11ConnectionAsync(QueueItemqueueItem)
at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.SocketsHttpHandler.<SendAsync>g__CreateHandlerAndSendAsync|115_0(HttpRequestMessagerequest, CancellationTokencancellationToken)
at Grpc.Net.Client.Web.GrpcWebHandler.SendAsyncCore(HttpRequestMessagerequest, CancellationTokencancellationToken)
at Grpc.Net.Client.Balancer.Internal.BalancerHttpHandler.SendAsync(HttpRequestMessagerequest, CancellationTokencancellationToken)
at Grpc.Net.Client.Internal.GrpcCall`2.RunCall(HttpRequestMessagerequest, Nullable`1timeout)
--- End of inner exception stack trace ---
at Gateway.Services.GrpcServices.Services.GrpcIntegrationService.ProcessSmsQueueMessages(GrpcRequestrequest) in /src/Hangfire/GrpcServices/Services/GrpcIntegrationService.cs:line 76
at SmsQueueProcessingService.ExecuteAsync(Int32pageSize) in /src/Hangfire/Jobs/Integration/SmsQueueProcessingService.cs:line 19
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.RuntimeMethodInfo.Invoke(Objectobj, BindingFlagsinvokeAttr, Binderbinder, Object[]parameters, CultureInfoculture)
An exception occurred during performance of the job. More details...
02/15/2026 20:00:04
Grpc.Core.RpcException
Status(StatusCode="Unknown", Detail="Exception was thrown by handler.")
Grpc.Core.RpcException: Status(StatusCode="Unknown", Detail="Exception was thrown by handler.")
at Gateway.Services.GrpcServices.Services.Application.GrpcApplicationService.ChangeNafithStatus(GrpcRequestrequest) in /src/Hangfire/GrpcServices/Services/Application/GrpcApplicationService.cs:line 98
at NafithStatusCheckerService.ExecuteAsync(Int32pageSize) in /src/Hangfire/Jobs/Application/NafithStatusCheckerService.cs:line 20
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
02/15/2026 19:30:04
Grpc.Core.RpcException
Status(StatusCode="Unknown", Detail="Exception was thrown by handler.")
Grpc.Core.RpcException: Status(StatusCode="Unknown", Detail="Exception was thrown by handler.")
at Gateway.Services.GrpcServices.Services.Application.GrpcApplicationService.ChangeNafithStatus(GrpcRequestrequest) in /src/Hangfire/GrpcServices/Services/Application/GrpcApplicationService.cs:line 98
at NafithStatusCheckerService.ExecuteAsync(Int32pageSize) in /src/Hangfire/Jobs/Application/NafithStatusCheckerService.cs:line 20
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
02/15/2026 19:00:03
Grpc.Core.RpcException
Status(StatusCode="Unknown", Detail="Exception was thrown by handler.")
Grpc.Core.RpcException: Status(StatusCode="Unknown", Detail="Exception was thrown by handler.")
at Gateway.Services.GrpcServices.Services.Application.GrpcApplicationService.ChangeNafithStatus(GrpcRequestrequest) in /src/Hangfire/GrpcServices/Services/Application/GrpcApplicationService.cs:line 98
at NafithStatusCheckerService.ExecuteAsync(Int32pageSize) in /src/Hangfire/Jobs/Application/NafithStatusCheckerService.cs:line 20
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
02/15/2026 18:30:02
Grpc.Core.RpcException
Status(StatusCode="Unimplemented", Detail="Method is unimplemented.")
Grpc.Core.RpcException: Status(StatusCode="Unimplemented", Detail="Method is unimplemented.")
at Gateway.Services.GrpcServices.Services.Payment.GrpcPaymentService.ProcessReconciliation(GrpcRequestrequest) in /src/Hangfire/GrpcServices/Services/Payment/GrpcPaymentService.cs:line 38
at ReconciliationService.ExecuteAsync(Int32pageSize) in /src/Hangfire/Jobs/Payment/ReconciliationService.cs:line 19
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.RuntimeMethodInfo.Invoke(Objectobj, BindingFlagsinvokeAttr, Binderbinder, Object[]parameters, CultureInfoculture)
An exception occurred during performance of the job. More details...
02/15/2026 18:30:02
Grpc.Core.RpcException
Status(StatusCode="Unknown", Detail="Exception was thrown by handler.")
Grpc.Core.RpcException: Status(StatusCode="Unknown", Detail="Exception was thrown by handler.")
at Gateway.Services.GrpcServices.Services.Application.GrpcApplicationService.ChangeNafithStatus(GrpcRequestrequest) in /src/Hangfire/GrpcServices/Services/Application/GrpcApplicationService.cs:line 98
at NafithStatusCheckerService.ExecuteAsync(Int32pageSize) in /src/Hangfire/Jobs/Application/NafithStatusCheckerService.cs:line 20
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
02/15/2026 18:00:01
Grpc.Core.RpcException
Status(StatusCode="Unknown", Detail="Exception was thrown by handler.")
Grpc.Core.RpcException: Status(StatusCode="Unknown", Detail="Exception was thrown by handler.")
at Gateway.Services.GrpcServices.Services.Application.GrpcApplicationService.ChangeNafithStatus(GrpcRequestrequest) in /src/Hangfire/GrpcServices/Services/Application/GrpcApplicationService.cs:line 98
at NafithStatusCheckerService.ExecuteAsync(Int32pageSize) in /src/Hangfire/Jobs/Application/NafithStatusCheckerService.cs:line 20
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
02/15/2026 17:30:01
Grpc.Core.RpcException
Status(StatusCode="Unknown", Detail="Exception was thrown by handler.")
Grpc.Core.RpcException: Status(StatusCode="Unknown", Detail="Exception was thrown by handler.")
at Gateway.Services.GrpcServices.Services.Application.GrpcApplicationService.ChangeNafithStatus(GrpcRequestrequest) in /src/Hangfire/GrpcServices/Services/Application/GrpcApplicationService.cs:line 98
at NafithStatusCheckerService.ExecuteAsync(Int32pageSize) in /src/Hangfire/Jobs/Application/NafithStatusCheckerService.cs:line 20
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
02/15/2026 17:00:00
Grpc.Core.RpcException
Status(StatusCode="Unknown", Detail="Exception was thrown by handler.")
Grpc.Core.RpcException: Status(StatusCode="Unknown", Detail="Exception was thrown by handler.")
at Gateway.Services.GrpcServices.Services.Application.GrpcApplicationService.ChangeNafithStatus(GrpcRequestrequest) in /src/Hangfire/GrpcServices/Services/Application/GrpcApplicationService.cs:line 98
at NafithStatusCheckerService.ExecuteAsync(Int32pageSize) in /src/Hangfire/Jobs/Application/NafithStatusCheckerService.cs:line 20
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Objectobj, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
02/15/2026 16:47:12
Grpc.Core.RpcException
Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (integration:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (integration:80)")
Grpc.Core.RpcException: Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (integration:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (integration:80)") ---> System.Net.Http.HttpRequestException: Connection timed out (integration:80) ---> System.Net.Sockets.SocketException: Connection timed out
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16token)
at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(Stringhost, Int32port, HttpRequestMessageinitialRequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(Stringhost, Int32port, HttpRequestMessageinitialRequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.InjectNewHttp11ConnectionAsync(QueueItemqueueItem)
at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.SocketsHttpHandler.<SendAsync>g__CreateHandlerAndSendAsync|115_0(HttpRequestMessagerequest, CancellationTokencancellationToken)
at Grpc.Net.Client.Web.GrpcWebHandler.SendAsyncCore(HttpRequestMessagerequest, CancellationTokencancellationToken)
at Grpc.Net.Client.Balancer.Internal.BalancerHttpHandler.SendAsync(HttpRequestMessagerequest, CancellationTokencancellationToken)
at Grpc.Net.Client.Internal.GrpcCall`2.RunCall(HttpRequestMessagerequest, Nullable`1timeout)
--- End of inner exception stack trace ---
at Gateway.Services.GrpcServices.Services.GrpcIntegrationService.ProcessSimahInstantUpdate(GrpcRequestrequest) in /src/Hangfire/GrpcServices/Services/GrpcIntegrationService.cs:line 81
at SimahInstantUpdateProcessingService.ExecuteAsync(Int32pageSize) in /src/Hangfire/Jobs/Integration/SimahInstantUpdateProcessingService.cs:line 19
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.RuntimeMethodInfo.Invoke(Objectobj, BindingFlagsinvokeAttr, Binderbinder, Object[]parameters, CultureInfoculture)