[16:24:11.615] New invocation is queued and will start shortly
[16:24:13.197] Starting the invocation (attempt 1)
[16:24:13.246] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/528aed3affcd4d4922cfd17632d2547ecedada53"
[16:24:13.246] Popped gitiles commit info from properties and tags
[16:24:13.246] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:24:13.246] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:24:13.246] Buildbucket request:
{
"requestId": "8900513125476674176",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "528aed3affcd4d4922cfd17632d2547ecedada53",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8900513125476674176"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:24:14.219] Scheduled build:
{
"id": "8735083063001619713",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 22984,
"createdBy": "project:chromium",
"createTime": "2024-10-03T16:24:13.348082218Z",
"updateTime": "2024-10-03T16:24:13.348082218Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "528aed3affcd4d4922cfd17632d2547ecedada53",
"ref": "refs/heads/main"
}
}
}
[16:24:14.219] Task URL: https://cr-buildbucket.appspot.com/build/8735083063001619713
[16:24:14.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:2:0) after 5m49s
[16:24:15.246] Received PubSub notification, asking Buildbucket for the build status
[16:24:15.269] Build status: SCHEDULED
[16:25:28.449] Received PubSub notification, asking Buildbucket for the build status
[16:25:28.477] Build status: STARTED
[16:30:03.307] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:2:0)
[16:30:03.354] Build status: STARTED
[16:30:03.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:5:0) after 1m17s
[16:31:20.377] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:5:0)
[16:31:20.401] Build status: STARTED
[16:31:20.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:6:0) after 9m22s
[16:40:42.417] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:6:0)
[16:40:42.442] Build status: STARTED
[16:40:42.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:7:0) after 7m15s
[16:47:57.502] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:7:0)
[16:47:57.559] Build status: STARTED
[16:47:57.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:8:0) after 1m41s
[16:49:38.644] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:8:0)
[16:49:38.705] Build status: STARTED
[16:49:38.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:9:0) after 9m7s
[16:58:45.717] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:9:0)
[16:58:45.826] Build status: STARTED
[16:58:45.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:10:0) after 6m13s
[17:04:58.845] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:10:0)
[17:04:58.944] Build status: STARTED
[17:04:58.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:11:0) after 4m0s
[17:08:58.982] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:11:0)
[17:08:59.015] Build status: STARTED
[17:08:59.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:12:0) after 5m0s
[17:13:59.033] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:12:0)
[17:13:59.051] Build status: STARTED
[17:13:59.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:13:0) after 9m58s
[17:23:57.177] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:13:0)
[17:23:57.240] Build status: STARTED
[17:23:57.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:14:0) after 5m58s
[17:29:55.290] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:14:0)
[17:29:55.323] Build status: STARTED
[17:29:55.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:15:0) after 2m32s
[17:32:27.338] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:15:0)
[17:32:27.370] Build status: STARTED
[17:32:27.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:16:0) after 6m52s
[17:39:19.488] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:16:0)
[17:39:19.507] Build status: STARTED
[17:39:19.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:17:0) after 6m45s
[17:46:04.579] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:17:0)
[17:46:04.601] Build status: STARTED
[17:46:04.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:18:0) after 4m12s
[17:50:16.672] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:18:0)
[17:50:16.691] Build status: STARTED
[17:50:16.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:19:0) after 6m49s
[17:57:05.712] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:19:0)
[17:57:05.729] Build status: STARTED
[17:57:05.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:20:0) after 8m37s
[18:05:42.716] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:20:0)
[18:05:42.736] Build status: STARTED
[18:05:42.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:21:0) after 4m22s
[18:10:04.754] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:21:0)
[18:10:04.860] Build status: STARTED
[18:10:04.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:22:0) after 8m54s
[18:18:58.878] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:22:0)
[18:18:58.932] Build status: STARTED
[18:18:58.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:23:0) after 8m42s
[18:27:41.074] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:23:0)
[18:27:41.100] Build status: STARTED
[18:27:41.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:24:0) after 5m51s
[18:33:32.231] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:24:0)
[18:33:32.253] Build status: STARTED
[18:33:32.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:25:0) after 2m7s
[18:35:39.278] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:25:0)
[18:35:39.298] Build status: STARTED
[18:35:39.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:26:0) after 6m50s
[18:42:29.316] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:26:0)
[18:42:29.341] Build status: STARTED
[18:42:29.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:27:0) after 9m51s
[18:52:20.360] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:27:0)
[18:52:20.386] Build status: STARTED
[18:52:20.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:28:0) after 3m55s
[18:56:15.407] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:28:0)
[18:56:15.426] Build status: STARTED
[18:56:15.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:29:0) after 1m19s
[18:57:34.494] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:29:0)
[18:57:34.512] Build status: STARTED
[18:57:34.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:30:0) after 5m52s
[19:03:26.537] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:30:0)
[19:03:26.560] Build status: STARTED
[19:03:26.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:31:0) after 6m9s
[19:09:35.581] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:31:0)
[19:09:35.599] Build status: STARTED
[19:09:35.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:32:0) after 4m12s
[19:13:47.626] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:32:0)
[19:13:47.644] Build status: STARTED
[19:13:47.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:33:0) after 6m42s
[19:20:29.714] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:33:0)
[19:20:29.732] Build status: STARTED
[19:20:29.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:34:0) after 5m59s
[19:26:28.757] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:34:0)
[19:26:28.822] Build status: STARTED
[19:26:28.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:35:0) after 4m48s
[19:31:16.840] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:35:0)
[19:31:16.856] Build status: STARTED
[19:31:16.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:36:0) after 8m27s
[19:39:43.873] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:36:0)
[19:39:43.891] Build status: STARTED
[19:39:43.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:37:0) after 9m29s
[19:49:12.917] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:37:0)
[19:49:12.933] Build status: STARTED
[19:49:12.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:38:0) after 2m5s
[19:51:17.953] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:38:0)
[19:51:17.971] Build status: STARTED
[19:51:17.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:39:0) after 4m47s
[19:56:04.991] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:39:0)
[19:56:05.010] Build status: STARTED
[19:56:05.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:40:0) after 8m49s
[20:04:54.127] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:40:0)
[20:04:54.149] Build status: STARTED
[20:04:54.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:41:0) after 5m13s
[20:10:07.173] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:41:0)
[20:10:07.240] Build status: STARTED
[20:10:07.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:42:0) after 5m38s
[20:15:45.326] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:42:0)
[20:15:45.349] Build status: STARTED
[20:15:45.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:43:0) after 5m2s
[20:20:47.346] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:43:0)
[20:20:47.362] Build status: STARTED
[20:20:47.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:44:0) after 7m4s
[20:27:51.426] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:44:0)
[20:27:51.444] Build status: STARTED
[20:27:51.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:45:0) after 7m36s
[20:35:27.567] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:45:0)
[20:35:27.582] Build status: STARTED
[20:35:27.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:46:0) after 6m12s
[20:41:39.610] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:46:0)
[20:41:39.634] Build status: STARTED
[20:41:39.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:47:0) after 8m30s
[20:50:09.707] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:47:0)
[20:50:09.726] Build status: STARTED
[20:50:09.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8900513125476674176:48:0) after 2m50s
[20:51:02.515] Received PubSub notification, asking Buildbucket for the build status
[20:51:02.533] Build:
{
"id": "8735083063001619713",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 22984,
"createdBy": "project:chromium",
"createTime": "2024-10-03T16:24:13.348082218Z",
"startTime": "2024-10-03T16:25:28.129003962Z",
"endTime": "2024-10-03T20:51:02.126539260Z",
"updateTime": "2024-10-03T20:51:02.126539260Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "528aed3affcd4d4922cfd17632d2547ecedada53",
"ref": "refs/heads/main"
}
}
}
[20:51:02.533] Invocation finished in 4h26m50.929209291s with status FAILED