TeamCity says '404 error' upon startup

Earlier today I had modified a VCSRoot (it's a perforce root), then kicked off a build that uses that root.  I got some kind of SQLException in the gui then all hell broke loose.  All the projects started reporting that they couldn't connect to the VCS server, then toggled back to normal, but none of the builds would run.

I decided to bounce everything.  So I went to the system services (the server runs on windows XP), shutdown the buildserver, then the build agent.  Rebooted the machine; now just going to the base server page (ie, http://myserver:8080/) I seea basic Apache Tomcat 404 error page.


Looking in the teamcity-server.log I see a bajillion of these stack traces -- what should I do at this point?

[2009-10-15 14:29:58,707]  ERROR -   jetbrains.buildServer.SERVER -

org.springframework.jdbc.UncategorizedSQLException: Error executing update with params:[1255631398707, 5]; uncategorized SQLException for SQL [UPDATE agent SET LAST_BINDING_TIMESTAMP = ? WHERE ID=?]; SQL state [S1000]; error code [-29]; File input/output error: E:/TeamCity/DataDir/system/buildserver.log in statement [UPDATE agent SET LAST_BINDING_TIMESTAMP = ? WHERE ID=?]; nested exception is java.sql.SQLException: File input/output error: E:/TeamCity/DataDir/system/buildserver.log in statement [UPDATE agent SET LAST_BINDING_TIMESTAMP = ? WHERE ID=?]
    at jetbrains.buildServer.serverSide.impl.query.GenericQuery.executeUpdate(GenericQuery.java:37)
    at jetbrains.buildServer.serverSide.impl.query.GenericQuery$3.run(GenericQuery.java)
    at jetbrains.buildServer.serverSide.impl.query.GenericQuery$3.run(GenericQuery.java:1)
    at jetbrains.buildServer.serverSide.impl.DBFacade$4.doInConnection(DBFacade.java:1)
    at jetbrains.buildServer.serverSide.impl.DBFacade$5.doInConnection(DBFacade.java:2)
    at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:341)
    at jetbrains.buildServer.serverSide.impl.DBFacade._runSql(DBFacade.java:81)
    at jetbrains.buildServer.serverSide.impl.DBFacade.runSql(DBFacade.java:56)
    at jetbrains.buildServer.serverSide.impl.query.GenericQuery.executeUpdate(GenericQuery.java:63)
    at jetbrains.buildServer.serverSide.impl.AgentPersistenceFacade.setBindingTimestamp(AgentPersistenceFacade.java:215)
    at jetbrains.buildServer.serverSide.impl.AbstractBuildAgent.persistCommunicationTimestamp(AbstractBuildAgent.java:9)
    at jetbrains.buildServer.serverSide.impl.AbstractBuildAgent.setCommunicationTimestamp(AbstractBuildAgent.java:41)
    at jetbrains.buildServer.serverSide.impl.XmlRpcBasedAgent$AgentTargetProxy.call(XmlRpcBasedAgent.java:9)
    at jetbrains.buildServer.serverSide.impl.XmlRpcBasedAgent.ping(XmlRpcBasedAgent.java:54)
    at jetbrains.buildServer.serverSide.impl.auth.SecuredBuildAgent.ping(SecuredBuildAgent.java:73)
    at jetbrains.buildServer.serverSide.impl.BuildAgentManagerImpl.pingAllAgents(BuildAgentManagerImpl.java:103)
    at jetbrains.buildServer.serverSide.impl.auth.SecuredBuildAgentManager.pingAllAgents(SecuredBuildAgentManager.java:8)
    at jetbrains.buildServer.serverSide.impl.BuildServerRunner$1.doSomething(BuildServerRunner.java:3)
    at jetbrains.buildServer.serverSide.impl.BuildServerRunner$BuildServerWorker.run(BuildServerRunner.java:31)
    at java.lang.Thread.run(Thread.java:595)
Caused by: java.sql.SQLException: File input/output error: E:/TeamCity/DataDir/system/buildserver.log in statement [UPDATE agent SET LAST_BINDING_TIMESTAMP = ? WHERE ID=?]
    at org.hsqldb.jdbc.Util.throwError(Unknown Source)
    at org.hsqldb.jdbc.jdbcPreparedStatement.executeUpdate(Unknown Source)
    at org.apache.commons.dbcp.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:102)
    at jetbrains.buildServer.serverSide.impl.query.GenericQuery.executeUpdate(GenericQuery.java:108)
    ... 19 more

2 comments
Comment actions Permalink

More related info -- looking in the server stdout.log I see the following from the last time I tried to startup the service.

Is there something you can do by just clicking and editing stuff in the webservice that can hose the Spring files???

---------- stdout_20091015.log ----------------------------

TeamCity data directory: E:/TeamCity/DataDir
Database settings are not specified via E:\TeamCity\DataDir\config\database.properties.
Using internal database.
Log4J configuraiton file c:\TeamCity\conf\teamcity-server-log4j.xml will be monitored with interval 10 seconds.
[2009-10-15 14:39:32,159]  ERROR - work.web.context.ContextLoader - Context initialization failed
org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'defaultMessageProcessorFactory' defined in URL [jar:file:/C:/TeamCity/webapps/ROOT/WEB-INF/lib/server.jar!/META-INF/buildServerSpring.xml]: Unsatisfied dependency expressed through constructor argument with index 0 of type [jetbrains.buildServer.serverSide.BuildServerEx]: Error creating bean with name 'buildServer' defined in URL [jar:file:/C:/TeamCity/webapps/ROOT/WEB-INF/lib/server.jar!/META-INF/buildServerSpring.xml]: Cannot resolve reference to bean 'dbFacade' while setting bean property 'db'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'dbFacade' defined in URL [jar:file:/C:/TeamCity/webapps/ROOT/WEB-INF/lib/server.jar!/META-INF/buildServerSpring.xml]: Instantiation of bean failed; nested exception is org.springframework.beans.BeanInstantiationException: Could not instantiate bean class [jetbrains.buildServer.serverSide.impl.DBFacade]: Constructor threw exception; nested exception is java.lang.RuntimeException: org.apache.commons.dbcp.SQLNestedException: Cannot create PoolableConnectionFactory (File input/output error)
Related cause: org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'dbSettings' defined in URL [jar:file:/C:/TeamCity/webapps/ROOT/WEB-INF/lib/server.jar!/META-INF/buildServerSpring.xml]: Unsatisfied dependency expressed through constructor argument with index 0 of type [java.lang.String]: No unique bean of type [java.lang.String] is defined: Unsatisfied dependency of type [class java.lang.String]: expected at least 1 matching bean
Related cause: org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'dbSettings' defined in URL [jar:file:/C:/TeamCity/webapps/ROOT/WEB-INF/lib/server.jar!/META-INF/buildServerSpring.xml]: Unsatisfied dependency expressed through constructor argument with index 0 of type [java.lang.String]: No unique bean of type [java.lang.String] is defined: Unsatisfied dependency of type [class java.lang.String]: expected at least 1 matching bean
    at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:570)
    at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:190)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:923)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:833)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:440)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory$1.run(AbstractAutowireCapableBeanFactory.java:409)
    at java.security.AccessController.doPrivileged(Native Method)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:380)
    at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:264)
    at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:217)
    at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:261)
    at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:185)
    at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:164)
    at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:429)
    at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:729)
    at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:381)
    at org.springframework.web.context.ContextLoader.createWebApplicationContext(ContextLoader.java:255)
    at org.springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:199)
    at org.springframework.web.context.ContextLoaderListener.contextInitialized(ContextLoaderListener.java:45)
    at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:3843)
    at org.apache.catalina.core.StandardContext.start(StandardContext.java:4342)
    at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:791)
    at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:771)
    at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:525)
    at org.apache.catalina.startup.HostConfig.deployDirectory(HostConfig.java:926)
    at org.apache.catalina.startup.HostConfig.deployDirectories(HostConfig.java:889)
    at org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:492)
    at org.apache.catalina.startup.HostConfig.start(HostConfig.java:1149)
    at org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:311)
    at org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:117)
    at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1053)
    at org.apache.catalina.core.StandardHost.start(StandardHost.java:719)
    at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1045)
    at org.apache.catalina.core.StandardEngine.start(StandardEngine.java:443)
    at org.apache.catalina.core.StandardService.start(StandardService.java:516)
    at org.apache.catalina.core.StandardServer.start(StandardServer.java:710)
    at org.apache.catalina.startup.Catalina.start(Catalina.java:578)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:585)
    at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:288)
    at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:413)
Related cause:
org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'dbSettings' defined in URL [jar:file:/C:/TeamCity/webapps/ROOT/WEB-INF/lib/server.jar!/META-INF/buildServerSpring.xml]: Unsatisfied dependency expressed through constructor argument with index 0 of type [java.lang.String]: No unique bean of type [java.lang.String] is defined: Unsatisfied dependency of type [class java.lang.String]: expected at least 1 matching bean
    at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:570)
    at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:190)
(clipped the rest, they all looked the same.)

0
Comment actions Permalink

SOLVED -- one of our disks was full.

0

Please sign in to leave a comment.