Failed Jobs

Enqueued 0 / 0 Scheduled 0 Processing 0 Succeeded 29,280 Failed 4,501 Deleted 0 Awaiting 0

Failed jobs do not become expired to allow you to re-queue them without any time pressure. You should re-queue or delete them manually, or apply AutomaticRetry(OnAttemptsExceeded = AttemptsExceededAction.Delete) attribute to delete them automatically.

Id	Job	Failed
#10174	SmsQueueProcessingService.ExecuteAsync An exception occurred during performance of the job. Fewer details...	02/15/2026 23:32:15
#10174	Grpc.Core.RpcException Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (integration:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (integration:80)") Grpc.Core.RpcException: Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (integration:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (integration:80)") ---> System.Net.Http.HttpRequestException: Connection timed out (integration:80) ---> System.Net.Sockets.SocketException: Connection timed out at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token) at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) --- End of inner exception stack trace --- at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.InjectNewHttp11ConnectionAsync(QueueItem queueItem) at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.SocketsHttpHandler.<SendAsync>g__CreateHandlerAndSendAsync\|115_0(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Web.GrpcWebHandler.SendAsyncCore(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Balancer.Internal.BalancerHttpHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Internal.GrpcCall`2.RunCall(HttpRequestMessage request, Nullable`1 timeout) --- End of inner exception stack trace --- at Gateway.Services.GrpcServices.Services.GrpcIntegrationService.ProcessSmsQueueMessages(GrpcRequest request) in /src/Hangfire/GrpcServices/Services/GrpcIntegrationService.cs:line 76 at SmsQueueProcessingService.ExecuteAsync(Int32 pageSize) in /src/Hangfire/Jobs/Integration/SmsQueueProcessingService.cs:line 19 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
#10173	ReconciliationService.ExecuteAsync An exception occurred during performance of the job. More details...	02/15/2026 23:30:06
#10173	Grpc.Core.RpcException Status(StatusCode="Unimplemented", Detail="Method is unimplemented.") Grpc.Core.RpcException: Status(StatusCode="Unimplemented", Detail="Method is unimplemented.") at Gateway.Services.GrpcServices.Services.Payment.GrpcPaymentService.ProcessReconciliation(GrpcRequest request) in /src/Hangfire/GrpcServices/Services/Payment/GrpcPaymentService.cs:line 38 at ReconciliationService.ExecuteAsync(Int32 pageSize) in /src/Hangfire/Jobs/Payment/ReconciliationService.cs:line 19 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
#10172	NafithStatusCheckerService.ExecuteAsync An exception occurred during performance of the job. More details...	02/15/2026 23:32:15
#10172	Grpc.Core.RpcException Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (application:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (application:80)") Grpc.Core.RpcException: Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (application:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (application:80)") ---> System.Net.Http.HttpRequestException: Connection timed out (application:80) ---> System.Net.Sockets.SocketException: Connection timed out at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token) at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) --- End of inner exception stack trace --- at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.InjectNewHttp11ConnectionAsync(QueueItem queueItem) at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.SocketsHttpHandler.<SendAsync>g__CreateHandlerAndSendAsync\|115_0(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Web.GrpcWebHandler.SendAsyncCore(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Balancer.Internal.BalancerHttpHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Internal.GrpcCall`2.RunCall(HttpRequestMessage request, Nullable`1 timeout) --- End of inner exception stack trace --- at Gateway.Services.GrpcServices.Services.Application.GrpcApplicationService.ChangeNafithStatus(GrpcRequest request) in /src/Hangfire/GrpcServices/Services/Application/GrpcApplicationService.cs:line 98 at NafithStatusCheckerService.ExecuteAsync(Int32 pageSize) in /src/Hangfire/Jobs/Application/NafithStatusCheckerService.cs:line 20 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
#10171	SimahInstantUpdateProcessingService.ExecuteAsync An exception occurred during performance of the job. More details...	02/15/2026 23:27:14
#10171	Grpc.Core.RpcException Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (integration:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (integration:80)") Grpc.Core.RpcException: Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (integration:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (integration:80)") ---> System.Net.Http.HttpRequestException: Connection timed out (integration:80) ---> System.Net.Sockets.SocketException: Connection timed out at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token) at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) --- End of inner exception stack trace --- at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.InjectNewHttp11ConnectionAsync(QueueItem queueItem) at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.SocketsHttpHandler.<SendAsync>g__CreateHandlerAndSendAsync\|115_0(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Web.GrpcWebHandler.SendAsyncCore(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Balancer.Internal.BalancerHttpHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Internal.GrpcCall`2.RunCall(HttpRequestMessage request, Nullable`1 timeout) --- End of inner exception stack trace --- at Gateway.Services.GrpcServices.Services.GrpcIntegrationService.ProcessSimahInstantUpdate(GrpcRequest request) in /src/Hangfire/GrpcServices/Services/GrpcIntegrationService.cs:line 81 at SimahInstantUpdateProcessingService.ExecuteAsync(Int32 pageSize) in /src/Hangfire/Jobs/Integration/SimahInstantUpdateProcessingService.cs:line 19 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
#10170	SmsQueueProcessingService.ExecuteAsync An exception occurred during performance of the job. More details...	02/15/2026 23:27:14
#10170	Grpc.Core.RpcException Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (integration:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (integration:80)") Grpc.Core.RpcException: Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (integration:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (integration:80)") ---> System.Net.Http.HttpRequestException: Connection timed out (integration:80) ---> System.Net.Sockets.SocketException: Connection timed out at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token) at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) --- End of inner exception stack trace --- at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.InjectNewHttp11ConnectionAsync(QueueItem queueItem) at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.SocketsHttpHandler.<SendAsync>g__CreateHandlerAndSendAsync\|115_0(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Web.GrpcWebHandler.SendAsyncCore(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Balancer.Internal.BalancerHttpHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Internal.GrpcCall`2.RunCall(HttpRequestMessage request, Nullable`1 timeout) --- End of inner exception stack trace --- at Gateway.Services.GrpcServices.Services.GrpcIntegrationService.ProcessSmsQueueMessages(GrpcRequest request) in /src/Hangfire/GrpcServices/Services/GrpcIntegrationService.cs:line 76 at SmsQueueProcessingService.ExecuteAsync(Int32 pageSize) in /src/Hangfire/Jobs/Integration/SmsQueueProcessingService.cs:line 19 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
#10169	SimahInstantUpdateProcessingService.ExecuteAsync An exception occurred during performance of the job. More details...	02/15/2026 23:22:15
#10169	Grpc.Core.RpcException Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (integration:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (integration:80)") Grpc.Core.RpcException: Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (integration:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (integration:80)") ---> System.Net.Http.HttpRequestException: Connection timed out (integration:80) ---> System.Net.Sockets.SocketException: Connection timed out at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token) at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) --- End of inner exception stack trace --- at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.InjectNewHttp11ConnectionAsync(QueueItem queueItem) at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.SocketsHttpHandler.<SendAsync>g__CreateHandlerAndSendAsync\|115_0(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Web.GrpcWebHandler.SendAsyncCore(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Balancer.Internal.BalancerHttpHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Internal.GrpcCall`2.RunCall(HttpRequestMessage request, Nullable`1 timeout) --- End of inner exception stack trace --- at Gateway.Services.GrpcServices.Services.GrpcIntegrationService.ProcessSimahInstantUpdate(GrpcRequest request) in /src/Hangfire/GrpcServices/Services/GrpcIntegrationService.cs:line 81 at SimahInstantUpdateProcessingService.ExecuteAsync(Int32 pageSize) in /src/Hangfire/Jobs/Integration/SimahInstantUpdateProcessingService.cs:line 19 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
#10168	SmsQueueProcessingService.ExecuteAsync An exception occurred during performance of the job. More details...	02/15/2026 23:22:15
#10168	Grpc.Core.RpcException Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (integration:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (integration:80)") Grpc.Core.RpcException: Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (integration:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (integration:80)") ---> System.Net.Http.HttpRequestException: Connection timed out (integration:80) ---> System.Net.Sockets.SocketException: Connection timed out at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token) at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) --- End of inner exception stack trace --- at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.InjectNewHttp11ConnectionAsync(QueueItem queueItem) at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.SocketsHttpHandler.<SendAsync>g__CreateHandlerAndSendAsync\|115_0(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Web.GrpcWebHandler.SendAsyncCore(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Balancer.Internal.BalancerHttpHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Internal.GrpcCall`2.RunCall(HttpRequestMessage request, Nullable`1 timeout) --- End of inner exception stack trace --- at Gateway.Services.GrpcServices.Services.GrpcIntegrationService.ProcessSmsQueueMessages(GrpcRequest request) in /src/Hangfire/GrpcServices/Services/GrpcIntegrationService.cs:line 76 at SmsQueueProcessingService.ExecuteAsync(Int32 pageSize) in /src/Hangfire/Jobs/Integration/SmsQueueProcessingService.cs:line 19 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
#10167	SimahInstantUpdateProcessingService.ExecuteAsync An exception occurred during performance of the job. More details...	02/15/2026 23:17:14
#10167	Grpc.Core.RpcException Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (integration:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (integration:80)") Grpc.Core.RpcException: Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (integration:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (integration:80)") ---> System.Net.Http.HttpRequestException: Connection timed out (integration:80) ---> System.Net.Sockets.SocketException: Connection timed out at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token) at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) --- End of inner exception stack trace --- at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.InjectNewHttp11ConnectionAsync(QueueItem queueItem) at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.SocketsHttpHandler.<SendAsync>g__CreateHandlerAndSendAsync\|115_0(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Web.GrpcWebHandler.SendAsyncCore(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Balancer.Internal.BalancerHttpHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Internal.GrpcCall`2.RunCall(HttpRequestMessage request, Nullable`1 timeout) --- End of inner exception stack trace --- at Gateway.Services.GrpcServices.Services.GrpcIntegrationService.ProcessSimahInstantUpdate(GrpcRequest request) in /src/Hangfire/GrpcServices/Services/GrpcIntegrationService.cs:line 81 at SimahInstantUpdateProcessingService.ExecuteAsync(Int32 pageSize) in /src/Hangfire/Jobs/Integration/SimahInstantUpdateProcessingService.cs:line 19 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
#10166	SmsQueueProcessingService.ExecuteAsync An exception occurred during performance of the job. More details...	02/15/2026 23:17:14
#10166	Grpc.Core.RpcException Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (integration:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (integration:80)") Grpc.Core.RpcException: Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (integration:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (integration:80)") ---> System.Net.Http.HttpRequestException: Connection timed out (integration:80) ---> System.Net.Sockets.SocketException: Connection timed out at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token) at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) --- End of inner exception stack trace --- at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.InjectNewHttp11ConnectionAsync(QueueItem queueItem) at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.SocketsHttpHandler.<SendAsync>g__CreateHandlerAndSendAsync\|115_0(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Web.GrpcWebHandler.SendAsyncCore(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Balancer.Internal.BalancerHttpHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Internal.GrpcCall`2.RunCall(HttpRequestMessage request, Nullable`1 timeout) --- End of inner exception stack trace --- at Gateway.Services.GrpcServices.Services.GrpcIntegrationService.ProcessSmsQueueMessages(GrpcRequest request) in /src/Hangfire/GrpcServices/Services/GrpcIntegrationService.cs:line 76 at SmsQueueProcessingService.ExecuteAsync(Int32 pageSize) in /src/Hangfire/Jobs/Integration/SmsQueueProcessingService.cs:line 19 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
#10165	SimahInstantUpdateProcessingService.ExecuteAsync An exception occurred during performance of the job. More details...	02/15/2026 23:12:13
#10165	Grpc.Core.RpcException Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (integration:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (integration:80)") Grpc.Core.RpcException: Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (integration:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (integration:80)") ---> System.Net.Http.HttpRequestException: Connection timed out (integration:80) ---> System.Net.Sockets.SocketException: Connection timed out at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token) at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) --- End of inner exception stack trace --- at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.InjectNewHttp11ConnectionAsync(QueueItem queueItem) at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.SocketsHttpHandler.<SendAsync>g__CreateHandlerAndSendAsync\|115_0(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Web.GrpcWebHandler.SendAsyncCore(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Balancer.Internal.BalancerHttpHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Internal.GrpcCall`2.RunCall(HttpRequestMessage request, Nullable`1 timeout) --- End of inner exception stack trace --- at Gateway.Services.GrpcServices.Services.GrpcIntegrationService.ProcessSimahInstantUpdate(GrpcRequest request) in /src/Hangfire/GrpcServices/Services/GrpcIntegrationService.cs:line 81 at SimahInstantUpdateProcessingService.ExecuteAsync(Int32 pageSize) in /src/Hangfire/Jobs/Integration/SimahInstantUpdateProcessingService.cs:line 19 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
#10164	SmsQueueProcessingService.ExecuteAsync An exception occurred during performance of the job. More details...	02/15/2026 23:12:13
#10164	Grpc.Core.RpcException Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (integration:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (integration:80)") Grpc.Core.RpcException: Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (integration:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (integration:80)") ---> System.Net.Http.HttpRequestException: Connection timed out (integration:80) ---> System.Net.Sockets.SocketException: Connection timed out at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token) at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) --- End of inner exception stack trace --- at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.InjectNewHttp11ConnectionAsync(QueueItem queueItem) at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.SocketsHttpHandler.<SendAsync>g__CreateHandlerAndSendAsync\|115_0(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Web.GrpcWebHandler.SendAsyncCore(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Balancer.Internal.BalancerHttpHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Internal.GrpcCall`2.RunCall(HttpRequestMessage request, Nullable`1 timeout) --- End of inner exception stack trace --- at Gateway.Services.GrpcServices.Services.GrpcIntegrationService.ProcessSmsQueueMessages(GrpcRequest request) in /src/Hangfire/GrpcServices/Services/GrpcIntegrationService.cs:line 76 at SmsQueueProcessingService.ExecuteAsync(Int32 pageSize) in /src/Hangfire/Jobs/Integration/SmsQueueProcessingService.cs:line 19 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
#10163	SimahInstantUpdateProcessingService.ExecuteAsync An exception occurred during performance of the job. More details...	02/15/2026 23:07:12
#10163	Grpc.Core.RpcException Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (integration:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (integration:80)") Grpc.Core.RpcException: Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (integration:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (integration:80)") ---> System.Net.Http.HttpRequestException: Connection timed out (integration:80) ---> System.Net.Sockets.SocketException: Connection timed out at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token) at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) --- End of inner exception stack trace --- at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.InjectNewHttp11ConnectionAsync(QueueItem queueItem) at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.SocketsHttpHandler.<SendAsync>g__CreateHandlerAndSendAsync\|115_0(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Web.GrpcWebHandler.SendAsyncCore(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Balancer.Internal.BalancerHttpHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Internal.GrpcCall`2.RunCall(HttpRequestMessage request, Nullable`1 timeout) --- End of inner exception stack trace --- at Gateway.Services.GrpcServices.Services.GrpcIntegrationService.ProcessSimahInstantUpdate(GrpcRequest request) in /src/Hangfire/GrpcServices/Services/GrpcIntegrationService.cs:line 81 at SimahInstantUpdateProcessingService.ExecuteAsync(Int32 pageSize) in /src/Hangfire/Jobs/Integration/SimahInstantUpdateProcessingService.cs:line 19 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
#10162	SmsQueueProcessingService.ExecuteAsync An exception occurred during performance of the job. More details...	02/15/2026 23:07:12
#10162	Grpc.Core.RpcException Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (integration:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (integration:80)") Grpc.Core.RpcException: Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (integration:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (integration:80)") ---> System.Net.Http.HttpRequestException: Connection timed out (integration:80) ---> System.Net.Sockets.SocketException: Connection timed out at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token) at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) --- End of inner exception stack trace --- at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.InjectNewHttp11ConnectionAsync(QueueItem queueItem) at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.SocketsHttpHandler.<SendAsync>g__CreateHandlerAndSendAsync\|115_0(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Web.GrpcWebHandler.SendAsyncCore(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Balancer.Internal.BalancerHttpHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Internal.GrpcCall`2.RunCall(HttpRequestMessage request, Nullable`1 timeout) --- End of inner exception stack trace --- at Gateway.Services.GrpcServices.Services.GrpcIntegrationService.ProcessSmsQueueMessages(GrpcRequest request) in /src/Hangfire/GrpcServices/Services/GrpcIntegrationService.cs:line 76 at SmsQueueProcessingService.ExecuteAsync(Int32 pageSize) in /src/Hangfire/Jobs/Integration/SmsQueueProcessingService.cs:line 19 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
#10161	BenchMatrixDataCollectionService.ExecuteAsync An exception occurred during performance of the job. More details...	02/15/2026 23:02:11
#10161	Grpc.Core.RpcException Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (integration:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (integration:80)") Grpc.Core.RpcException: Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (integration:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (integration:80)") ---> System.Net.Http.HttpRequestException: Connection timed out (integration:80) ---> System.Net.Sockets.SocketException: Connection timed out at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token) at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) --- End of inner exception stack trace --- at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.InjectNewHttp11ConnectionAsync(QueueItem queueItem) at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.SocketsHttpHandler.<SendAsync>g__CreateHandlerAndSendAsync\|115_0(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Web.GrpcWebHandler.SendAsyncCore(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Balancer.Internal.BalancerHttpHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Internal.GrpcCall`2.RunCall(HttpRequestMessage request, Nullable`1 timeout) --- End of inner exception stack trace --- at Gateway.Services.GrpcServices.Services.GrpcIntegrationService.ProcessBenchMatrixDataCollection(GrpcRequest request) in /src/Hangfire/GrpcServices/Services/GrpcIntegrationService.cs:line 66 at BenchMatrixDataCollectionService.ExecuteAsync(Int32 pageSize) in /src/Hangfire/Jobs/Integration/BenchMatrixDataCollectionService.cs:line 19 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
#10160	SimahInstantUpdateProcessingService.ExecuteAsync An exception occurred during performance of the job. More details...	02/15/2026 23:02:11
#10160	Grpc.Core.RpcException Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (integration:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (integration:80)") Grpc.Core.RpcException: Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (integration:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (integration:80)") ---> System.Net.Http.HttpRequestException: Connection timed out (integration:80) ---> System.Net.Sockets.SocketException: Connection timed out at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token) at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) --- End of inner exception stack trace --- at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.InjectNewHttp11ConnectionAsync(QueueItem queueItem) at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.SocketsHttpHandler.<SendAsync>g__CreateHandlerAndSendAsync\|115_0(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Web.GrpcWebHandler.SendAsyncCore(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Balancer.Internal.BalancerHttpHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Internal.GrpcCall`2.RunCall(HttpRequestMessage request, Nullable`1 timeout) --- End of inner exception stack trace --- at Gateway.Services.GrpcServices.Services.GrpcIntegrationService.ProcessSimahInstantUpdate(GrpcRequest request) in /src/Hangfire/GrpcServices/Services/GrpcIntegrationService.cs:line 81 at SimahInstantUpdateProcessingService.ExecuteAsync(Int32 pageSize) in /src/Hangfire/Jobs/Integration/SimahInstantUpdateProcessingService.cs:line 19 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
#10159	SmsQueueProcessingService.ExecuteAsync An exception occurred during performance of the job. More details...	02/15/2026 23:02:11
#10159	Grpc.Core.RpcException Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (integration:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (integration:80)") Grpc.Core.RpcException: Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (integration:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (integration:80)") ---> System.Net.Http.HttpRequestException: Connection timed out (integration:80) ---> System.Net.Sockets.SocketException: Connection timed out at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token) at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) --- End of inner exception stack trace --- at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.InjectNewHttp11ConnectionAsync(QueueItem queueItem) at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.SocketsHttpHandler.<SendAsync>g__CreateHandlerAndSendAsync\|115_0(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Web.GrpcWebHandler.SendAsyncCore(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Balancer.Internal.BalancerHttpHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Internal.GrpcCall`2.RunCall(HttpRequestMessage request, Nullable`1 timeout) --- End of inner exception stack trace --- at Gateway.Services.GrpcServices.Services.GrpcIntegrationService.ProcessSmsQueueMessages(GrpcRequest request) in /src/Hangfire/GrpcServices/Services/GrpcIntegrationService.cs:line 76 at SmsQueueProcessingService.ExecuteAsync(Int32 pageSize) in /src/Hangfire/Jobs/Integration/SmsQueueProcessingService.cs:line 19 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
#10158	ReconciliationService.ExecuteAsync An exception occurred during performance of the job. More details...	02/15/2026 23:00:02
#10158	Grpc.Core.RpcException Status(StatusCode="Unimplemented", Detail="Method is unimplemented.") Grpc.Core.RpcException: Status(StatusCode="Unimplemented", Detail="Method is unimplemented.") at Gateway.Services.GrpcServices.Services.Payment.GrpcPaymentService.ProcessReconciliation(GrpcRequest request) in /src/Hangfire/GrpcServices/Services/Payment/GrpcPaymentService.cs:line 38 at ReconciliationService.ExecuteAsync(Int32 pageSize) in /src/Hangfire/Jobs/Payment/ReconciliationService.cs:line 19 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
#10157	NafithStatusCheckerService.ExecuteAsync An exception occurred during performance of the job. More details...	02/15/2026 23:02:11
#10157	Grpc.Core.RpcException Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (application:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (application:80)") Grpc.Core.RpcException: Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (application:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (application:80)") ---> System.Net.Http.HttpRequestException: Connection timed out (application:80) ---> System.Net.Sockets.SocketException: Connection timed out at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token) at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) --- End of inner exception stack trace --- at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.InjectNewHttp11ConnectionAsync(QueueItem queueItem) at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.SocketsHttpHandler.<SendAsync>g__CreateHandlerAndSendAsync\|115_0(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Web.GrpcWebHandler.SendAsyncCore(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Balancer.Internal.BalancerHttpHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Internal.GrpcCall`2.RunCall(HttpRequestMessage request, Nullable`1 timeout) --- End of inner exception stack trace --- at Gateway.Services.GrpcServices.Services.Application.GrpcApplicationService.ChangeNafithStatus(GrpcRequest request) in /src/Hangfire/GrpcServices/Services/Application/GrpcApplicationService.cs:line 98 at NafithStatusCheckerService.ExecuteAsync(Int32 pageSize) in /src/Hangfire/Jobs/Application/NafithStatusCheckerService.cs:line 20 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
#10156	SimahInstantUpdateProcessingService.ExecuteAsync An exception occurred during performance of the job. More details...	02/15/2026 22:57:12
#10156	Grpc.Core.RpcException Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (integration:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (integration:80)") Grpc.Core.RpcException: Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (integration:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (integration:80)") ---> System.Net.Http.HttpRequestException: Connection timed out (integration:80) ---> System.Net.Sockets.SocketException: Connection timed out at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token) at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) --- End of inner exception stack trace --- at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.InjectNewHttp11ConnectionAsync(QueueItem queueItem) at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.SocketsHttpHandler.<SendAsync>g__CreateHandlerAndSendAsync\|115_0(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Web.GrpcWebHandler.SendAsyncCore(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Balancer.Internal.BalancerHttpHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Internal.GrpcCall`2.RunCall(HttpRequestMessage request, Nullable`1 timeout) --- End of inner exception stack trace --- at Gateway.Services.GrpcServices.Services.GrpcIntegrationService.ProcessSimahInstantUpdate(GrpcRequest request) in /src/Hangfire/GrpcServices/Services/GrpcIntegrationService.cs:line 81 at SimahInstantUpdateProcessingService.ExecuteAsync(Int32 pageSize) in /src/Hangfire/Jobs/Integration/SimahInstantUpdateProcessingService.cs:line 19 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
#10155	SmsQueueProcessingService.ExecuteAsync An exception occurred during performance of the job. More details...	02/15/2026 22:57:12
#10155	Grpc.Core.RpcException Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (integration:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (integration:80)") Grpc.Core.RpcException: Status(StatusCode="Unavailable", Detail="Error starting gRPC call. HttpRequestException: Connection timed out (integration:80) SocketException: Connection timed out", DebugException="System.Net.Http.HttpRequestException: Connection timed out (integration:80)") ---> System.Net.Http.HttpRequestException: Connection timed out (integration:80) ---> System.Net.Sockets.SocketException: Connection timed out at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token) at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) --- End of inner exception stack trace --- at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.InjectNewHttp11ConnectionAsync(QueueItem queueItem) at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.SocketsHttpHandler.<SendAsync>g__CreateHandlerAndSendAsync\|115_0(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Web.GrpcWebHandler.SendAsyncCore(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Balancer.Internal.BalancerHttpHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken) at Grpc.Net.Client.Internal.GrpcCall`2.RunCall(HttpRequestMessage request, Nullable`1 timeout) --- End of inner exception stack trace --- at Gateway.Services.GrpcServices.Services.GrpcIntegrationService.ProcessSmsQueueMessages(GrpcRequest request) in /src/Hangfire/GrpcServices/Services/GrpcIntegrationService.cs:line 76 at SmsQueueProcessingService.ExecuteAsync(Int32 pageSize) in /src/Hangfire/Jobs/Integration/SmsQueueProcessingService.cs:line 19 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*) at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)

Grpc.Core.RpcException

Grpc.Core.RpcException

Grpc.Core.RpcException

Grpc.Core.RpcException

Grpc.Core.RpcException

Grpc.Core.RpcException

Grpc.Core.RpcException

Grpc.Core.RpcException

Grpc.Core.RpcException

Grpc.Core.RpcException

Grpc.Core.RpcException

Grpc.Core.RpcException

Grpc.Core.RpcException

Grpc.Core.RpcException

Grpc.Core.RpcException

Grpc.Core.RpcException

Grpc.Core.RpcException

Grpc.Core.RpcException

Grpc.Core.RpcException

Grpc.Core.RpcException