[16:24:15.213] New invocation is queued and will start shortly
[16:24:16.418] Starting the invocation (attempt 1)
[16:24:16.452] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/4f90a3b28a020a8168a710326c506ff7a1d5ac25"
[16:24:16.452] Popped gitiles commit info from properties and tags
[16:24:16.452] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:24:16.452] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:24:16.452] Buildbucket request:
{
"requestId": "8931769075107753232",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4f90a3b28a020a8168a710326c506ff7a1d5ac25",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8931769075107753232"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:24:17.121] Scheduled build:
{
"id": "8766339013079920401",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 18144,
"createdBy": "project:chromium",
"createTime": "2023-10-24T16:24:16.523077377Z",
"updateTime": "2023-10-24T16:24:16.523077377Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4f90a3b28a020a8168a710326c506ff7a1d5ac25",
"ref": "refs/heads/main"
}
}
}
[16:24:17.121] Task URL: https://cr-buildbucket.appspot.com/build/8766339013079920401
[16:24:17.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:2:0) after 7m9s
[16:24:17.194] Received PubSub notification, asking Buildbucket for the build status
[16:24:17.222] Build status: SCHEDULED
[16:24:18.032] Received PubSub notification, asking Buildbucket for the build status
[16:24:18.055] Build status: STARTED
[16:31:26.163] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:2:0)
[16:31:26.190] Build status: STARTED
[16:31:26.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:5:0) after 4m18s
[16:35:44.266] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:5:0)
[16:35:44.285] Build status: STARTED
[16:35:44.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:6:0) after 3m11s
[16:38:55.381] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:6:0)
[16:38:55.410] Build status: STARTED
[16:38:55.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:7:0) after 7m23s
[16:46:18.427] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:7:0)
[16:46:18.448] Build status: STARTED
[16:46:18.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:8:0) after 6m41s
[16:52:59.569] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:8:0)
[16:52:59.585] Build status: STARTED
[16:52:59.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:9:0) after 6m44s
[16:59:43.801] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:9:0)
[16:59:43.896] Build status: STARTED
[16:59:43.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:10:0) after 7m44s
[17:07:28.006] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:10:0)
[17:07:28.033] Build status: STARTED
[17:07:28.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:11:0) after 1m38s
[17:09:06.428] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:11:0)
[17:09:06.505] Build status: STARTED
[17:09:06.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:12:0) after 7m56s
[17:17:02.530] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:12:0)
[17:17:02.556] Build status: STARTED
[17:17:02.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:13:0) after 3m49s
[17:20:51.577] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:13:0)
[17:20:51.627] Build status: STARTED
[17:20:51.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:14:0) after 2m56s
[17:23:47.700] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:14:0)
[17:23:47.758] Build status: STARTED
[17:23:47.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:15:0) after 1m48s
[17:25:35.799] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:15:0)
[17:25:35.831] Build status: STARTED
[17:25:35.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:16:0) after 2m1s
[17:27:36.874] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:16:0)
[17:27:36.897] Build status: STARTED
[17:27:36.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:17:0) after 7m27s
[17:35:03.976] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:17:0)
[17:35:03.996] Build status: STARTED
[17:35:03.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:18:0) after 4m16s
[17:39:20.082] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:18:0)
[17:39:20.102] Build status: STARTED
[17:39:20.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:19:0) after 5m21s
[17:44:41.123] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:19:0)
[17:44:41.143] Build status: STARTED
[17:44:41.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:20:0) after 2m7s
[17:46:48.166] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:20:0)
[17:46:48.195] Build status: STARTED
[17:46:48.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:21:0) after 1m36s
[17:48:24.240] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:21:0)
[17:48:24.272] Build status: STARTED
[17:48:24.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:22:0) after 9m17s
[17:57:41.322] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:22:0)
[17:57:41.385] Build status: STARTED
[17:57:41.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:23:0) after 1m42s
[17:59:23.466] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:23:0)
[17:59:23.540] Build status: STARTED
[17:59:23.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:24:0) after 2m13s
[18:01:36.546] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:24:0)
[18:01:36.570] Build status: STARTED
[18:01:36.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:25:0) after 8m32s
[18:10:08.642] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:25:0)
[18:10:08.695] Build status: STARTED
[18:10:08.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:26:0) after 4m4s
[18:14:12.749] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:26:0)
[18:14:12.823] Build status: STARTED
[18:14:12.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:27:0) after 1m26s
[18:15:38.847] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:27:0)
[18:15:38.872] Build status: STARTED
[18:15:38.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:28:0) after 2m39s
[18:18:17.953] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:28:0)
[18:18:17.971] Build status: STARTED
[18:18:17.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:29:0) after 5m54s
[18:24:12.068] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:29:0)
[18:24:12.091] Build status: STARTED
[18:24:12.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:30:0) after 6m33s
[18:30:45.149] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:30:0)
[18:30:45.182] Build status: STARTED
[18:30:45.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:31:0) after 3m43s
[18:34:28.380] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:31:0)
[18:34:28.403] Build status: STARTED
[18:34:28.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:32:0) after 3m12s
[18:37:40.436] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:32:0)
[18:37:40.453] Build status: STARTED
[18:37:40.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:33:0) after 5m52s
[18:43:32.525] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:33:0)
[18:43:32.557] Build status: STARTED
[18:43:32.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:34:0) after 1m21s
[18:44:53.707] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:34:0)
[18:44:53.732] Build status: STARTED
[18:44:53.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:35:0) after 4m12s
[18:49:05.757] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:35:0)
[18:49:05.777] Build status: STARTED
[18:49:05.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:36:0) after 9m55s
[18:59:00.764] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:36:0)
[18:59:00.895] Build status: STARTED
[18:59:00.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:37:0) after 5m59s
[19:04:59.916] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:37:0)
[19:05:00.011] Build status: STARTED
[19:05:00.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:38:0) after 1m45s
[19:06:45.039] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:38:0)
[19:06:45.066] Build status: STARTED
[19:06:45.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:39:0) after 2m1s
[19:08:46.044] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:39:0)
[19:08:46.063] Build status: STARTED
[19:08:46.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:40:0) after 3m8s
[19:11:54.168] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:40:0)
[19:11:54.199] Build status: STARTED
[19:11:54.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:41:0) after 8m10s
[19:20:04.176] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:41:0)
[19:20:04.196] Build status: STARTED
[19:20:04.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:42:0) after 8m40s
[19:28:44.255] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:42:0)
[19:28:44.276] Build status: STARTED
[19:28:44.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:43:0) after 7m42s
[19:36:26.297] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:43:0)
[19:36:26.363] Build status: STARTED
[19:36:26.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8931769075107753232:44:0) after 9m10s
[19:36:50.029] Received PubSub notification, asking Buildbucket for the build status
[19:36:50.091] Build:
{
"id": "8766339013079920401",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 18144,
"createdBy": "project:chromium",
"createTime": "2023-10-24T16:24:16.523077377Z",
"startTime": "2023-10-24T16:24:17.511763Z",
"endTime": "2023-10-24T19:36:49.811628508Z",
"updateTime": "2023-10-24T19:36:49.811628508Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4f90a3b28a020a8168a710326c506ff7a1d5ac25",
"ref": "refs/heads/main"
}
}
}
[19:36:50.091] Invocation finished in 3h12m34.885132674s with status FAILED