TeamCIty Integration with Selenium remote testing using IE Driver

All test cases are passing when scripts using Chrome Driver but failing when using IE Driver.

We are getting issue when Team City is on another machine.

TeamCity running the tests as a background process. Because of this, scripts are failing since the scripts run based on UI (visible) elements of the application.

 We are able to run the script without any error using pom file through command prompt on the Team City server directly using IE Driver.

Please provide your valuable inputs

Thanks