Getting issues while running workflow using Selenium grid setup on Team city

We are using Team city on premise 2019.2.2 (build 71923).  We have a selenium grid setup (Hub and node). 
The DevOps server where teamcity agents are running is the Hub server and there are 2 other VMs which act as node servers.

During the work flow execution of UI test automation step on the node servers, we see different types of error logs on teamcity. 
We checked with our infrastructure team, And they don't see any connectivity issue between the hub and node servers. 
But they pointed out the java.exe stops running. Can you please help us troubleshooting the issue? 

Error log messages. We have masked the IPs in the log.

1.Error forwarding the new session Error forwarding the request Failed to connect to /xx.xx.xx.xx:52800
2. The HTTP request to the remote WebDriver server for URL http://yy.yy.yy.yyy:4444/wd/hub/session timed out after 200 seconds.
3. Error forwarding the new session Empty pool of VM for setup Capabilities {acceptInsecureCerts: true, browserName: chrome, goog:chromeOptions: {args: [lang=en-GB, start-maximized, verbose, v=1, no-sandbox, user-data-dir=c:\automation...], localState: {browser: {enabled_labs_experiments: [calculate-native-win-occlus...]}}, prefs: {download.default_direct
4. Unexpected error. System.Net.WebException: Unable to connect to the remote server ---> System.Net.Sockets.SocketException: No connection could be made because the target machine actively refused it yy.yy.yy.yyy:4444
   at System.Net.Sockets.Socket.DoConnect(EndPoint endPointSnapshot, SocketAddress socketAddress)
   at System.Net.ServicePoint.ConnectSocketInternal(Boolean connectFailure, Socket s4, Socket s6, Socket& socket, IPAddress& address, ConnectSocketState state, IAsyncResult asyncResult, Exception& exception)