TeamCity fails to detect all changes for ClearCase delivery
We have TeamCity running 5.1.2 with ClearCase 7.1.1 on Linux. One of my users made a delivery this morning of an activity that contained 44 changed files. TeamCity detected only some of the changes (12 out of the 44).
Here's the ClearCase view of the activity:
clt lsact -l DS00086077
activity "DS00086077"
2010-09-29T04:45:00-04:00 by Barbara Jochems (BarbaraJ.Domain Users@vm-bjochems)
"Integration activity created by deliver on 9/29/2010 4:44:35 AM.
"
owner: barbaraj
group: unknown
stream: dx_8.5_int@/vobs_dx_pvob
title: deliver barbaraj_dx_8.5 on 20100929.044435.
change set versions:
/vobs_dx_qa/si/designer.core/src/com/progress/dataxtend/si/designer/core/databases@@/main/dx_8.5_int/2
/vobs_dx/si/plugins/com.progress.dataxtend.si.datasources.jdbc.adapter.hibernate3/src/com/progress/dataxtend/si/hibernate3/codegen/DBMappingGen.vm@@/main/dx_main/dx_8.5_int/1
/vobs_dx/si/plugins/com.progress.dataxtend.si.core/src/com/pantero/tools/importer/database/JDBCAdapter.java@@/main/dx_main/dx_8.5_int/4
/vobs_dx/si/plugins/com.progress.dataxtend.si.core/src/com/pantero/tools/importer/database/MSSqlJDBCAdapter.java@@/main/dx_main/dx_8.5_int/3
/vobs_dx/si/plugins/com.progress.dataxtend.si.core/src/com/pantero/tools/importer/database/MYSQLJDBCAdapter.java@@/main/dx_main/dx_8.5_int/4
/vobs_dx/si/plugins/com.progress.dataxtend.si.datasources.jdbc.adapter.hibernate3/src/com/progress/dataxtend/si/hibernate3/codegen/HibernateGenerationUtils.java@@/main/dx_main/dx_8.5_int/2
/vobs_dx/si/plugins/com.progress.dataxtend.si.core/src/com/pantero/tools/importer/database/SybaseASE15JDBCAdapter.java@@/main/dx_main/dx_8.5_int/3
/vobs_dx_qa/si/build-qa.xml@@/main/dx_main/dx_8.5_int/12
/vobs_dx_qa/si/core/config/scripts/writeback/testWriteBackHSQLDB-identity.sql@@/main/dx_main/dx_8.5_int/2
/vobs_dx_qa/si/core/config/scripts/writeback/testWriteBackHSQLDB-sequence.sql@@/main/dx_main/dx_8.5_int/2
/vobs_dx_qa/si/core/src/com/pantero/ameriquest/DatabaseTypeTests.java@@/main/dx_main/dx_8.5_int/2
/vobs_dx_qa/si/core/src/com/pantero/ameriquest/TestTypeTestHSQL.java@@/main/dx_main/dx_8.5_int/2
/vobs_dx_qa/si/core/src/com/pantero/ameriquest/TestTypeTestMySQL.java@@/main/dx_main/dx_8.5_int/2
/vobs_dx_qa/si/core/config/ExchangeModel/DataSources/TypeTestDatabase.pdb@@/main/dx_main/dx_8.5_int/1
/vobs_dx_qa/si/core/config/ExchangeModel/DataSources/TypeTestDatabase.psd@@/main/dx_main/dx_8.5_int/2
/vobs_dx_qa/si/core/config/scripts/typetest/create_hsql_schema.sql@@/main/dx_main/dx_8.5_int/1
/vobs_dx_qa/si/core/config/scripts/typetest/create_mssql_schema.sql@@/main/dx_main/dx_8.5_int/1
/vobs_dx_qa/si/core/config/scripts/typetest/create_oracle_schema.sql@@/main/dx_main/dx_8.5_int/2
/vobs_dx_qa/si/core/src/com/pantero/ameriquest/TestTypeTestTimesTen.java@@/main/dx_main/dx_8.5_int/2
/vobs_dx_qa/si/core/config/scripts/typetest/create_teradata_schema.sql@@/main/dx_main/dx_8.5_int/1
/vobs_dx_qa/si/build/bedford.db.test.properties.tmpl@@/main/dx_main/dx_8.5_int/3
/vobs_dx_qa/si/core/config/scripts/writeback/testWriteBackOracle.sql@@/main/dx_main/dx_8.5_int/2
/vobs_dx_qa/si/core/config/scripts/writeback/testWriteBackPGSQL.sql@@/main/dx_main/dx_8.5_int/2
/vobs_dx_qa/si/core/src/com/pantero/ameriquest/TestTypeTestPostgreSQL.java@@/main/dx_main/dx_8.5_int/2
/vobs_dx_qa/si/core/config/scripts/typetest/create_pgsql_schema.sql@@/main/dx_main/dx_8.5_int/1
/vobs_dx_qa/si/core/src/com/pantero/ameriquest/AmeriquestTestHSQLAdapter.java@@/main/dx_main/dx_8.5_int/2
/vobs_dx_qa/si/core/src/com/pantero/ameriquest/AmeriquestTestDatabaseAdapter.java@@/main/dx_main/dx_8.5_int/3
/vobs_dx_qa/si/core/src/com/pantero/ameriquest/TranslationTestCase.java@@/main/dx_main/dx_8.5_int/4
/vobs_dx_qa/si/core/src/com/pantero/ameriquest/AmeriquestTestMYSQLAdapter.java@@/main/dx_main/dx_8.5_int/2
/vobs_dx_qa/si/core/config/scripts/typetest/create_sybase_schema.sql@@/main/dx_main/dx_8.5_int/1
/vobs_dx_qa/si/core/config/scripts/writeback/testWriteBackDB29-identity.sql.tmpl@@/main/dx_main/dx_8.5_int/2
/vobs_dx_qa/si/core/config/scripts/typetest/create_db29_schema.sql.tmpl@@/main/dx_main/dx_8.5_int/1
/vobs_dx_qa/si/core/config/scripts/writeback/testWriteBackDB29-sequence.sql.tmpl@@/main/dx_main/dx_8.5_int/2
/vobs_dx_qa/si/designer.core/src/com/progress/dataxtend/si/designer/core/databases/TestAmeriquestImporterMySQL.java@@/main/dx_8.5_int/1
/vobs_dx_qa/si/designer.core/src/com/progress/dataxtend/si/designer/core/databases/TestAmeriquestImporterSybaseASE15.java@@/main/dx_8.5_int/1
/vobs_dx_qa/si/designer.core/src/com/progress/dataxtend/si/designer/core/databases/TestAmeriquestImporterDDOracle11g.java@@/main/dx_8.5_int/1
/vobs_dx_qa/si/designer.core/src/com/progress/dataxtend/si/designer/core/databases/TestAmeriquestImporterTimesTen.java@@/main/dx_8.5_int/1
/vobs_dx_qa/si/designer.core/src/com/progress/dataxtend/si/designer/core/databases/TestAmeriquestImporterPostgreSQL.java@@/main/dx_8.5_int/1
/vobs_dx_qa/si/designer.core/src/com/progress/dataxtend/si/designer/core/databases/TestAmeriquestImporterSqlServer.java@@/main/dx_8.5_int/1
/vobs_dx_qa/si/designer.core/src/com/progress/dataxtend/si/designer/core/databases/TestAmeriquestImporterDB29.java@@/main/dx_8.5_int/1
/vobs_dx_qa/si/designer.core/src/com/progress/dataxtend/si/designer/core/databases/AmeriquestImporterTestCase.java@@/main/dx_8.5_int/1
/vobs_dx_qa/si/designer.core/src/com/progress/dataxtend/si/designer/core/databases/TestAmeriquestImporterTeradata12.java@@/main/dx_8.5_int/1
/vobs_dx_qa/si/designer.core/src/com/progress/dataxtend/si/designer/core/databases/TestAmeriquestImporterOracle10.java@@/main/dx_8.5_int/1
/vobs_dx_qa/si/designer.core/src/com/progress/dataxtend/si/designer/core/databases/TestAmeriquestImporterHSQL.java@@/main/dx_8.5_int/1
clearquest record id: DS00086077
clearquest record State: Complete
TeamCity has only these changes listed:
29 Sep 10 04:48barbaraj (12 files)
DS00086077
Run build with this change
| edited |
vobs_dx_qa/si/build/bedford.db.test.properties.tmpl (rev. si@@/main/dx_main/dx_8.5_int/2/build@@/main/dx_main/dx_8.5_int/1/bedford.db.test.properties.tmpl@@/main/dx_main/dx_8.5_int/3) 
|
| edited |
vobs_dx_qa/si/core/config/scripts/typetest/create_oracle_schema.sql (rev. si@@/main/dx_main/dx_8.5_int/2/core@@/main/dx_main/dx_8.5_int/1/config@@/main/dx_main/3/scripts@@/main/dx_main/2/typetest@@/main/dx_main/1/create_oracle_schema.sql@@/main/dx_main/dx_8.5_int/2)
|
| edited |
vobs_dx_qa/si/core/config/scripts/writeback/testWriteBackDB29-identity.sql.tmpl (rev. si@@/main/dx_main/dx_8.5_int/2/core@@/main/dx_main/dx_8.5_int/1/config@@/main/dx_main/3/scripts@@/main/dx_main/2/writeback@@/main/dx_main/1/testWriteBackDB29-identity.sql.tmpl@@/main/dx_main/dx_8.5_int/2)
|
| edited |
vobs_dx_qa/si/core/config/scripts/writeback/testWriteBackDB29-sequence.sql.tmpl (rev. si@@/main/dx_main/dx_8.5_int/2/core@@/main/dx_main/dx_8.5_int/1/config@@/main/dx_main/3/scripts@@/main/dx_main/2/writeback@@/main/dx_main/1/testWriteBackDB29-sequence.sql.tmpl@@/main/dx_main/dx_8.5_int/2)
|
| edited |
vobs_dx_qa/si/core/config/scripts/writeback/testWriteBackOracle.sql (rev. si@@/main/dx_main/dx_8.5_int/2/core@@/main/dx_main/dx_8.5_int/1/config@@/main/dx_main/3/scripts@@/main/dx_main/2/writeback@@/main/dx_main/1/testWriteBackOracle.sql@@/main/dx_main/dx_8.5_int/2)
|
| edited |
vobs_dx_qa/si/core/config/scripts/writeback/testWriteBackPGSQL.sql (rev. si@@/main/dx_main/dx_8.5_int/2/core@@/main/dx_main/dx_8.5_int/1/config@@/main/dx_main/3/scripts@@/main/dx_main/2/writeback@@/main/dx_main/1/testWriteBackPGSQL.sql@@/main/dx_main/dx_8.5_int/2)
|
| edited |
vobs_dx_qa/si/core/src/com/pantero/ameriquest/AmeriquestTestDatabaseAdapter.java (rev. si@@/main/dx_main/dx_8.5_int/2/core@@/main/dx_main/dx_8.5_int/1/src@@/main/dx_main/3/com@@/main/dx_main/3/pantero@@/main/dx_main/dx_8.5_int/1/ameriquest@@/main/dx_main/3/AmeriquestTestDatabaseAdapter.java@@/main/dx_main/dx_8.5_int/3)
|
| edited |
vobs_dx_qa/si/core/src/com/pantero/ameriquest/AmeriquestTestHSQLAdapter.java (rev. si@@/main/dx_main/dx_8.5_int/2/core@@/main/dx_main/dx_8.5_int/1/src@@/main/dx_main/3/com@@/main/dx_main/3/pantero@@/main/dx_main/dx_8.5_int/1/ameriquest@@/main/dx_main/3/AmeriquestTestHSQLAdapter.java@@/main/dx_main/dx_8.5_int/2)
|
| edited |
vobs_dx_qa/si/core/src/com/pantero/ameriquest/AmeriquestTestMYSQLAdapter.java (rev. si@@/main/dx_main/dx_8.5_int/2/core@@/main/dx_main/dx_8.5_int/1/src@@/main/dx_main/3/com@@/main/dx_main/3/pantero@@/main/dx_main/dx_8.5_int/1/ameriquest@@/main/dx_main/3/AmeriquestTestMYSQLAdapter.java@@/main/dx_main/dx_8.5_int/2)
|
| edited |
vobs_dx_qa/si/core/src/com/pantero/ameriquest/TestTypeTestPostgreSQL.java (rev. si@@/main/dx_main/dx_8.5_int/2/core@@/main/dx_main/dx_8.5_int/1/src@@/main/dx_main/3/com@@/main/dx_main/3/pantero@@/main/dx_main/dx_8.5_int/1/ameriquest@@/main/dx_main/3/TestTypeTestPostgreSQL.java@@/main/dx_main/dx_8.5_int/2)
|
| edited |
vobs_dx_qa/si/core/src/com/pantero/ameriquest/TestTypeTestTimesTen.java (rev. si@@/main/dx_main/dx_8.5_int/2/core@@/main/dx_main/dx_8.5_int/1/src@@/main/dx_main/3/com@@/main/dx_main/3/pantero@@/main/dx_main/dx_8.5_int/1/ameriquest@@/main/dx_main/3/TestTypeTestTimesTen.java@@/main/dx_main/dx_8.5_int/2)
|
| edited |
vobs_dx_qa/si/core/src/com/pantero/ameriquest/TranslationTestCase.java (rev. si@@/main/dx_main/dx_8.5_int/2/core@@/main/dx_main/dx_8.5_int/1/src@@/main/dx_main/3/com@@/main/dx_main/3/pantero@@/main/dx_main/dx_8.5_int/1/ameriquest@@/main/dx_main/3/TranslationTestCase.java@@/main/dx_main/dx_8.5_int/4)
|
At this point, it appears that the logfiles no longer have the command that was run to detect what changes were delivered. I have made a subsequent change just now and TeamCity correctly picked it up.
I also have a second TC server running on a different machine that I have been using to test my changes before moving them to the production server. It failed to detect my developer's changes completely. That is, there's no mention of the delivery whatsoever. It did pick up my subsequent change correctly though. This test server is running 5.1.4 plus a patch.
Please sign in to leave a comment.
I just ran the command myself and it shows 17 changes:
I just uploaded another set of logfiles that you might find helpful:
prgs_tclogs_601_20110118.zip
Ben delivered
TeamCity only detected 14 files:
18 Jan 11 10:07broussea (14 files)
Activity:
DS00087897
Description:
merge from madrid 8.4.99
View change details
Run build with this change
Download patch
Download patch to IDE
Changed: 14 files (14 modified)
edited vobs_dx_qa/si/systemtest/test-resources/Reports/CR83585/ExchangeModelTranslationsReport.xml (rev. si@@/main/dx_main/dx_8.5_int/2/systemtest@@/main/dx_main/dx_8.5_int/1/test-resources@@/main/dx_main/2/Reports@@/main/dx_main/dx_8.5_int/1/CR83585@@/main/dx_8.5_int/1/ExchangeModelTranslationsReport.xml@@/main/dx_8.5_int/3)
edited vobs_dx_qa/si/systemtest/test-resources/Reports/CR83585/ExchangeModelTranslationsReport_false_false.xml (rev. si@@/main/dx_main/dx_8.5_int/2/systemtest@@/main/dx_main/dx_8.5_int/1/test-resources@@/main/dx_main/2/Reports@@/main/dx_main/dx_8.5_int/1/CR83585@@/main/dx_8.5_int/1/ExchangeModelTranslationsReport_false_false.xml@@/main/dx_8.5_int/3)
edited vobs_dx_qa/si/systemtest/test-resources/Reports/CR83585/ExchangeModelTranslationsReport_false_true.xml (rev. si@@/main/dx_main/dx_8.5_int/2/systemtest@@/main/dx_main/dx_8.5_int/1/test-resources@@/main/dx_main/2/Reports@@/main/dx_main/dx_8.5_int/1/CR83585@@/main/dx_8.5_int/1/ExchangeModelTranslationsReport_false_true.xml@@/main/dx_8.5_int/3)
edited vobs_dx_qa/si/systemtest/test-resources/Reports/CR83585/ExchangeModelTranslationsReport_true_false.xml (rev. si@@/main/dx_main/dx_8.5_int/2/systemtest@@/main/dx_main/dx_8.5_int/1/test-resources@@/main/dx_main/2/Reports@@/main/dx_main/dx_8.5_int/1/CR83585@@/main/dx_8.5_int/1/ExchangeModelTranslationsReport_true_false.xml@@/main/dx_8.5_int/3)
edited vobs_dx_qa/si/systemtest/test-resources/Reports/CatalystSID/ExchangeModelTranslationsReport_false_false.xml (rev. si@@/main/dx_main/dx_8.5_int/2/systemtest@@/main/dx_main/dx_8.5_int/1/test-resources@@/main/dx_main/2/Reports@@/main/dx_main/dx_8.5_int/1/CatalystSID@@/main/dx_main/dx_8.5_int/1/ExchangeModelTranslationsReport_false_false.xml@@/main/dx_8.5_int/3)
edited vobs_dx_qa/si/systemtest/test-resources/Reports/CatalystSID/ExchangeModelTranslationsReport_false_true.xml (rev. si@@/main/dx_main/dx_8.5_int/2/systemtest@@/main/dx_main/dx_8.5_int/1/test-resources@@/main/dx_main/2/Reports@@/main/dx_main/dx_8.5_int/1/CatalystSID@@/main/dx_main/dx_8.5_int/1/ExchangeModelTranslationsReport_false_true.xml@@/main/dx_8.5_int/3)
edited vobs_dx_qa/si/systemtest/test-resources/Reports/CatalystSID/ExchangeModelTranslationsReport_true_false.xml (rev. si@@/main/dx_main/dx_8.5_int/2/systemtest@@/main/dx_main/dx_8.5_int/1/test-resources@@/main/dx_main/2/Reports@@/main/dx_main/dx_8.5_int/1/CatalystSID@@/main/dx_main/dx_8.5_int/1/ExchangeModelTranslationsReport_true_false.xml@@/main/dx_8.5_int/3)
edited vobs_dx_qa/si/systemtest/test-resources/Reports/IBMSDP/ExchangeModelTranslationsReport.xml (rev. si@@/main/dx_main/dx_8.5_int/2/systemtest@@/main/dx_main/dx_8.5_int/1/test-resources@@/main/dx_main/2/Reports@@/main/dx_main/dx_8.5_int/1/IBMSDP@@/main/dx_main/dx_8.5_int/1/ExchangeModelTranslationsReport.xml@@/main/dx_main/dx_8.5_int/3)
edited vobs_dx_qa/si/systemtest/test-resources/Reports/IBMSDP/ExchangeModelTranslationsReport_false_false.xml (rev. si@@/main/dx_main/dx_8.5_int/2/systemtest@@/main/dx_main/dx_8.5_int/1/test-resources@@/main/dx_main/2/Reports@@/main/dx_main/dx_8.5_int/1/IBMSDP@@/main/dx_main/dx_8.5_int/1/ExchangeModelTranslationsReport_false_false.xml@@/main/dx_8.5_int/3)
edited vobs_dx_qa/si/systemtest/test-resources/Reports/IBMSDP/ExchangeModelTranslationsReport_false_true.xml (rev. si@@/main/dx_main/dx_8.5_int/2/systemtest@@/main/dx_main/dx_8.5_int/1/test-resources@@/main/dx_main/2/Reports@@/main/dx_main/dx_8.5_int/1/IBMSDP@@/main/dx_main/dx_8.5_int/1/ExchangeModelTranslationsReport_false_true.xml@@/main/dx_8.5_int/3)
edited vobs_dx_qa/si/systemtest/test-resources/Reports/IBMSDP/ExchangeModelTranslationsReport_true_false.xml (rev. si@@/main/dx_main/dx_8.5_int/2/systemtest@@/main/dx_main/dx_8.5_int/1/test-resources@@/main/dx_main/2/Reports@@/main/dx_main/dx_8.5_int/1/IBMSDP@@/main/dx_main/dx_8.5_int/1/ExchangeModelTranslationsReport_true_false.xml@@/main/dx_8.5_int/3)
edited vobs_dx_qa/si/systemtest/test-resources/Reports/TelstraMediator/ExchangeModelTranslationsReport.xml (rev. si@@/main/dx_main/dx_8.5_int/2/systemtest@@/main/dx_main/dx_8.5_int/1/test-resources@@/main/dx_main/2/Reports@@/main/dx_main/dx_8.5_int/1/TelstraMediator@@/main/dx_main/dx_8.5_int/2/ExchangeModelTranslationsReport.xml@@/main/dx_main/dx_8.5_int/3)
edited vobs_dx_qa/si/systemtest/test-resources/Reports/TelstraMediator/ExchangeModelTranslationsReport_false_false.xml (rev. si@@/main/dx_main/dx_8.5_int/2/systemtest@@/main/dx_main/dx_8.5_int/1/test-resources@@/main/dx_main/2/Reports@@/main/dx_main/dx_8.5_int/1/TelstraMediator@@/main/dx_main/dx_8.5_int/2/ExchangeModelTranslationsReport_false_false.xml@@/main/dx_8.5_int/3)
edited vobs_dx_qa/si/systemtest/test-resources/Reports/TelstraMediator/ExchangeModelTranslationsReport_false_true.xml (rev. si@@/main/dx_main/dx_8.5_int/2/systemtest@@/main/dx_main/dx_8.5_int/1/test-resources@@/main/dx_main/2/Reports@@/main/dx_main/dx_8.5_int/1/TelstraMediator@@/main/dx_main/dx_8.5_int/2/ExchangeModelTranslationsReport_false_true.xml@@/main/dx_8.5_int/3)
Bill,
"lshistory" showed not all items again. Can it be related to some permission problems? E.g. if TC user has no permissions on some of the files...
I doubt that it's a permission problem. The TeamCity server is running as the account "dxbld" which is a regular user. I just ran the same command as the same user and I get the same results:
One thing I forgot to point out is that this server has several builds on the same stream. That is, one build is using a snapshot view on the dx_8.5_int stream. The other build is using a dynamic view. You had suggested to us to use a snapshot view so I setup another build awhile ago with this. Even they show different results:
The one that uses a snapshot view for the version control shows this:
DS00087874
The build that uses a dynamic view for the version control shows this (12 files instead of 8)
DS00087874
One more thing to add. The data that I have given thus far has all been with 6.0.1 running on the machine uxoslnxbld2. The production server is running 5.1.5 and for Esther's delivery, it shows:
14 Jan 11 18:43esther (3 files)
DS00087874
It's using a dynamic view. So we have 3 different sets of data from TC.
Bill,
I do not know yet why "lshistory" shows different count of changes for different calls but seems it is a cause of the problem. TC properly detects all the changes "lshistory" showed.
To check it I suggest you to install the second 6.0.1 TC server. If two same servers detect different changes then "lshistory" is the cause.
Can you explain the algorithm that TeamCity uses to detect changes? I mean, is it just running "cleartool lshistory -eventid -since <timestamp>" over and over again with different timestamps? What is the timestamp interval used?
We see this issue when a developer has a long delivery that takes more than a minute. Here's an example:
uxpssoldev1(bsmith): clt lsact -l DS00087874
activity "DS00087874"
2011-01-14T18:37:31-05:00 by Esther Jesurum (esther.Rdl@vm-estherxp)
"Integration activity created by deliver on 1/14/2011 6:35:52 PM.
This particular delivery took about a minute and a half.
If you can describe what TeamCity is doing to detect changes, I can run it by IBM Rational Support to see if there's a bug in ClearCase or there's a flaw in your algorithm.
The second question I have is what is the algorithm that TeamCity uses to determine what files should be shipped to the agent? Even though TeamCity fails to list all of the changed files in the changeset, it still seems to deliver all of the changed files to the agent. Seems like there's a different algorithm used there.
But more disturbingly, occasionally TeamCity fails to deliver all of the changed files to the agent.
TC ClearCase integration uses the same algorithm (and the same code) for both detecting changes and building patch for an agent.
About detecting changes, it is scheduled according to the VCS root settings (see "Changes Checking Interval" settings group on the VCS root settings page) and can be also triggered for a build and manually with "Check for pending changes" action. When checking for changes is triggered TC calls "lshistory" with "-since" parameter equal to the previous changes checking date and parses its output to detect the changes related to the certain VCS root.
I have opened a support case with Rational ClearCase Support to get some more info on "cleartool lshistory ... -since" command that TeamCity is using. This issue comes up whenever a Developer does a large checkin. This morning, I did a delivery that took several minutes to complete. TeamCity only showed one change.
I uploaded the logfiles to the ftp server:
prgs_tclogs_601_20110201.zip
I ran this command which shows 131 files.
uxpssoldev1(pradam): clt lshistory -since 01-February-2011.10:27:34 -all
--02-01T10:27 pradam create directory version "/vobs_dx_3rdparty/si@@/main/dx_main/dx_8.5_int/2"
"Added directory element "ant"."
--02-01T10:27 pradam create directory version "/vobs_dx_3rdparty/si/ant@@/main/dx_8.5_int/1"
"Added directory element "apache-ant-1.8.2".
Added directory element "extlibs"."
--02-01T10:27 pradam create directory version "/vobs_dx_3rdparty/si/ant/extlibs@@/main/dx_8.5_int/1"
"Added file element "PROGRESS_README.TXT".
[stuff deleted]
Which showed all of the files that were checked in as part of the delivery. Mind you that the checkin took several minutes but it was all recorded at 01-February-2011.10:27:34. If I changed the time to 01-February-2011.10:27:35, I get no files listed. So from ClearCase perspective, the entire delivery happened in that instant.
I'm thinking that TeamCity ran its "lshistory -since ..." command during the delivery and only a handful of files were checked in which it listed. Then a minute later, it runs the same command but with a different timestamp (1 minute later) and lists no further changes. But if it had run the same command with the same timestamp multiple times, it would have detected all of the files.
It seems that lshistory might be a flawed way to determine what files have changed for ClearCase UCM. I'm asking Rational for some clarification on the behavior and will post their response.
In the meantime, I was trying to parse the TeamCity debug logs to see what command it ran and what output it received. Can you tell me how to find them?
I just did the same delivery of files that I did earlier this morning (this time checked in and delivered Ant 1.8.0 instead of 1.8.2). When I did "cleartool deliver -complete", I ran the "cleartool lshistory -since ..." in a loop. I could see that the output grow longer and longer each time I ran it.
Tue Feb 1 23:14:36 EST 2011
clt lshistory -since 01-February-2011.23:14:00 -branch dx_8.5_int -all
BEGIN OUTPUT
END OUTPUT
Tue Feb 1 23:14:42 EST 2011
clt lshistory -since 01-February-2011.23:14:00 -branch dx_8.5_int -all
BEGIN OUTPUT
--02-01T23:14 bsmith create version "/vobs_dx_3rdparty/si/ant@@/main/pradam_dx_8.5_2/3/apache-ant-1.8.0/main/pradam_dx_8.5_2/1/lib/main/pradam_dx_8.5_2/1/xml-apis.jar@@/main/dx_8.5_int/1"
END OUTPUT
Tue Feb 1 23:14:47 EST 2011
clt lshistory -since 01-February-2011.23:14:00 -branch dx_8.5_int -all
BEGIN OUTPUT
--02-01T23:14 bsmith create version "/vobs_dx_3rdparty/si/ant@@/main/pradam_dx_8.5_2/3/apache-ant-1.8.0/main/pradam_dx_8.5_2/1/lib/main/pradam_dx_8.5_2/1/libraries.properties@@/main/dx_8.5_int/1"
--02-01T23:14 bsmith create version "/vobs_dx_3rdparty/si/ant@@/main/pradam_dx_8.5_2/3/apache-ant-1.8.0/main/pradam_dx_8.5_2/1/lib/main/pradam_dx_8.5_2/1/xercesImpl.jar@@/main/dx_8.5_int/1"
--02-01T23:14 bsmith create version "/vobs_dx_3rdparty/si/ant@@/main/pradam_dx_8.5_2/3/apache-ant-1.8.0/main/pradam_dx_8.5_2/1/lib/main/pradam_dx_8.5_2/1/xml-apis.jar@@/main/dx_8.5_int/1"
END OUTPUT
Tue Feb 1 23:14:53 EST 2011
clt lshistory -since 01-February-2011.23:14:00 -branch dx_8.5_int -all
BEGIN OUTPUT
--02-01T23:14 bsmith create version "/vobs_dx_3rdparty/si/ant@@/main/pradam_dx_8.5_2/3/apache-ant-1.8.0/main/pradam_dx_8.5_2/1/lib/main/pradam_dx_8.5_2/1/ant-trax-1.8.0.pom.sha512@@/main/dx_8.5_int/1"
--02-01T23:14 bsmith create version "/vobs_dx_3rdparty/si/ant@@/main/pradam_dx_8.5_2/3/apache-ant-1.8.0/main/pradam_dx_8.5_2/1/lib/main/pradam_dx_8.5_2/1/ant-trax.jar@@/main/dx_8.5_int/1"
--02-01T23:14 bsmith create version "/vobs_dx_3rdparty/si/ant@@/main/pradam_dx_8.5_2/3/apache-ant-1.8.0/main/pradam_dx_8.5_2/1/lib/main/pradam_dx_8.5_2/1/ant.jar@@/main/dx_8.5_int/1"
--02-01T23:14 bsmith create version "/vobs_dx_3rdparty/si/ant@@/main/pradam_dx_8.5_2/3/apache-ant-1.8.0/main/pradam_dx_8.5_2/1/lib/main/pradam_dx_8.5_2/1/libraries.properties@@/main/dx_8.5_int/1"
--02-01T23:14 bsmith create version "/vobs_dx_3rdparty/si/ant@@/main/pradam_dx_8.5_2/3/apache-ant-1.8.0/main/pradam_dx_8.5_2/1/lib/main/pradam_dx_8.5_2/1/xercesImpl.jar@@/main/dx_8.5_int/1"
--02-01T23:14 bsmith create version "/vobs_dx_3rdparty/si/ant@@/main/pradam_dx_8.5_2/3/apache-ant-1.8.0/main/pradam_dx_8.5_2/1/lib/main/pradam_dx_8.5_2/1/xml-apis.jar@@/main/dx_8.5_int/1"
END OUTPUT
Tue Feb 1 23:14:59 EST 2011
clt lshistory -since 01-February-2011.23:14:00 -branch dx_8.5_int -all
BEGIN OUTPUT
--02-01T23:14 bsmith create version "/vobs_dx_3rdparty/si/ant@@/main/pradam_dx_8.5_2/3/apache-ant-1.8.0/main/pradam_dx_8.5_2/1/lib/main/pradam_dx_8.5_2/1/ant-trax-1.8.0.pom@@/main/dx_8.5_int/1"
--02-01T23:14 bsmith create version "/vobs_dx_3rdparty/si/ant@@/main/pradam_dx_8.5_2/3/apache-ant-1.8.0/main/pradam_dx_8.5_2/1/lib/main/pradam_dx_8.5_2/1/ant-trax-1.8.0.pom.md5@@/main/dx_8.5_int/1"
--02-01T23:14 bsmith create version "/vobs_dx_3rdparty/si/ant@@/main/pradam_dx_8.5_2/3/apache-ant-1.8.0/main/pradam_dx_8.5_2/1/lib/main/pradam_dx_8.5_2/1/ant-trax-1.8.0.pom.sha1@@/main/dx_8.5_int/1"
--02-01T23:14 bsmith create version "/vobs_dx_3rdparty/si/ant@@/main/pradam_dx_8.5_2/3/apache-ant-1.8.0/main/pradam_dx_8.5_2/1/lib/main/pradam_dx_8.5_2/1/ant-trax-1.8.0.pom.sha512@@/main/dx_8.5_int/1"
--02-01T23:14 bsmith create version "/vobs_dx_3rdparty/si/ant@@/main/pradam_dx_8.5_2/3/apache-ant-1.8.0/main/pradam_dx_8.5_2/1/lib/main/pradam_dx_8.5_2/1/ant-trax.jar@@/main/dx_8.5_int/1"
--02-01T23:14 bsmith create version "/vobs_dx_3rdparty/si/ant@@/main/pradam_dx_8.5_2/3/apache-ant-1.8.0/main/pradam_dx_8.5_2/1/lib/main/pradam_dx_8.5_2/1/ant.jar@@/main/dx_8.5_int/1"
--02-01T23:14 bsmith create version "/vobs_dx_3rdparty/si/ant@@/main/pradam_dx_8.5_2/3/apache-ant-1.8.0/main/pradam_dx_8.5_2/1/lib/main/pradam_dx_8.5_2/1/libraries.properties@@/main/dx_8.5_int/1"
--02-01T23:14 bsmith create version "/vobs_dx_3rdparty/si/ant@@/main/pradam_dx_8.5_2/3/apache-ant-1.8.0/main/pradam_dx_8.5_2/1/lib/main/pradam_dx_8.5_2/1/xercesImpl.jar@@/main/dx_8.5_int/1"
--02-01T23:14 bsmith create version "/vobs_dx_3rdparty/si/ant@@/main/pradam_dx_8.5_2/3/apache-ant-1.8.0/main/pradam_dx_8.5_2/1/lib/main/pradam_dx_8.5_2/1/xml-apis.jar@@/main/dx_8.5_int/1"
END OUTPUT
Tue Feb 1 23:15:05 EST 2011
clt lshistory -since 01-February-2011.23:14:00 -branch dx_8.5_int -all
BEGIN OUTPUT
--02-01T23:14 bsmith create version "/vobs_dx_3rdparty/si/ant@@/main/pradam_dx_8.5_2/3/apache-ant-1.8.0/main/pradam_dx_8.5_2/1/lib/main/pradam_dx_8.5_2/1/ant-testutil-1.8.0.pom.sha1@@/main/dx_8.5_int/1"
--02-01T23:14 bsmith create version "/vobs_dx_3rdparty/si/ant@@/main/pradam_dx_8.5_2/3/apache-ant-1.8.0/main/pradam_dx_8.5_2/1/lib/main/pradam_dx_8.5_2/1/ant-testutil-1.8.0.pom.sha512@@/main/dx_8.5_int/1"
--02-01T23:14 bsmith create version "/vobs_dx_3rdparty/si/ant@@/main/pradam_dx_8.5_2/3/apache-ant-1.8.0/main/pradam_dx_8.5_2/1/lib/main/pradam_dx_8.5_2/1/ant-testutil.jar@@/main/dx_8.5_int/1"
--02-01T23:14 bsmith create version "/vobs_dx_3rdparty/si/ant@@/main/pradam_dx_8.5_2/3/apache-ant-1.8.0/main/pradam_dx_8.5_2/1/lib/main/pradam_dx_8.5_2/1/ant-trax-1.8.0.pom@@/main/dx_8.5_int/1"
--02-01T23:14 bsmith create version "/vobs_dx_3rdparty/si/ant@@/main/pradam_dx_8.5_2/3/apache-ant-1.8.0/main/pradam_dx_8.5_2/1/lib/main/pradam_dx_8.5_2/1/ant-trax-1.8.0.pom.md5@@/main/dx_8.5_int/1"
--02-01T23:14 bsmith create version "/vobs_dx_3rdparty/si/ant@@/main/pradam_dx_8.5_2/3/apache-ant-1.8.0/main/pradam_dx_8.5_2/1/lib/main/pradam_dx_8.5_2/1/ant-trax-1.8.0.pom.sha1@@/main/dx_8.5_int/1"
--02-01T23:14 bsmith create version "/vobs_dx_3rdparty/si/ant@@/main/pradam_dx_8.5_2/3/apache-ant-1.8.0/main/pradam_dx_8.5_2/1/lib/main/pradam_dx_8.5_2/1/ant-trax-1.8.0.pom.sha512@@/main/dx_8.5_int/1"
--02-01T23:14 bsmith create version "/vobs_dx_3rdparty/si/ant@@/main/pradam_dx_8.5_2/3/apache-ant-1.8.0/main/pradam_dx_8.5_2/1/lib/main/pradam_dx_8.5_2/1/ant-trax.jar@@/main/dx_8.5_int/1"
--02-01T23:14 bsmith create version "/vobs_dx_3rdparty/si/ant@@/main/pradam_dx_8.5_2/3/apache-ant-1.8.0/main/pradam_dx_8.5_2/1/lib/main/pradam_dx_8.5_2/1/ant.jar@@/main/dx_8.5_int/1"
--02-01T23:14 bsmith create version "/vobs_dx_3rdparty/si/ant@@/main/pradam_dx_8.5_2/3/apache-ant-1.8.0/main/pradam_dx_8.5_2/1/lib/main/pradam_dx_8.5_2/1/libraries.properties@@/main/dx_8.5_int/1"
--02-01T23:14 bsmith create version "/vobs_dx_3rdparty/si/ant@@/main/pradam_dx_8.5_2/3/apache-ant-1.8.0/main/pradam_dx_8.5_2/1/lib/main/pradam_dx_8.5_2/1/xercesImpl.jar@@/main/dx_8.5_int/1"
--02-01T23:14 bsmith create version "/vobs_dx_3rdparty/si/ant@@/main/pradam_dx_8.5_2/3/apache-ant-1.8.0/main/pradam_dx_8.5_2/1/lib/main/pradam_dx_8.5_2/1/xml-apis.jar@@/main/dx_8.5_int/1"
I have to believe that the algorithm that TeamCity uses to detect changes for UCM deliveries must be flawed. It might work for base clearcase but not UCM deliveries. Looking at the output in the TC clearcase logfile, it seems that it runs the "lshistory -since" command once and each time it runs it, it changes the timestamp for the -since argument. This explains why TC doesn't detect all of the changes in a long delivery.
Bill,
Can you please try the latest TeamCity EAP? I implemented the workaround for your issue, hope it helps.
Thanks Maxim. I'll try the EAP version out in my prototype area to see how it does.
At first glance, it does seem that 6.5 EAP might solve the issue. I need to run some builds and look at the changesets more closely. But I haven't been able to do this because I can't get the agents connected due to this problem: http://devnet.jetbrains.net/message/5288995#5288995