[17:50:57.050] New invocation is queued and will start shortly
[17:50:58.080] Starting the invocation (attempt 1)
[17:50:58.113] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9f5d4d790ee11ab8f7e8080be60307fac5d09f49"
[17:50:58.113] Popped gitiles commit info from properties and tags
[17:50:58.113] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:50:58.113] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:50:58.114] Buildbucket request:
{
"requestId": "8922703923944940640",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9f5d4d790ee11ab8f7e8080be60307fac5d09f49",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8922703923944940640"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:50:58.777] Scheduled build:
{
"id": "8757273862098823473",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 31144,
"createdBy": "project:chromium",
"createTime": "2024-02-01T17:50:58.188348713Z",
"updateTime": "2024-02-01T17:50:58.188348713Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9f5d4d790ee11ab8f7e8080be60307fac5d09f49",
"ref": "refs/heads/main"
}
},
"canary": true
}
[17:50:58.777] Task URL: https://cr-buildbucket.appspot.com/build/8757273862098823473
[17:50:58.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:2:0) after 6m54s
[17:50:59.754] Received PubSub notification, asking Buildbucket for the build status
[17:50:59.782] Build status: SCHEDULED
[17:51:02.659] Received PubSub notification, asking Buildbucket for the build status
[17:51:02.758] Build status: STARTED
[17:57:52.802] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:2:0)
[17:57:52.821] Build status: STARTED
[17:57:52.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:5:0) after 6m58s
[18:04:50.855] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:5:0)
[18:04:50.881] Build status: STARTED
[18:04:50.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:6:0) after 8m40s
[18:13:31.134] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:6:0)
[18:13:31.172] Build status: STARTED
[18:13:31.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:7:0) after 3m43s
[18:17:14.373] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:7:0)
[18:17:14.409] Build status: STARTED
[18:17:14.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:8:0) after 9m8s
[18:26:22.534] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:8:0)
[18:26:22.748] Build status: STARTED
[18:26:22.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:9:0) after 7m5s
[18:33:27.833] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:9:0)
[18:33:27.856] Build status: STARTED
[18:33:27.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:10:0) after 7m59s
[18:41:26.968] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:10:0)
[18:41:26.986] Build status: STARTED
[18:41:26.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:11:0) after 1m32s
[18:42:59.007] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:11:0)
[18:42:59.028] Build status: STARTED
[18:42:59.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:12:0) after 8m29s
[18:51:28.056] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:12:0)
[18:51:28.074] Build status: STARTED
[18:51:28.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:13:0) after 1m1s
[18:52:29.147] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:13:0)
[18:52:29.210] Build status: STARTED
[18:52:29.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:14:0) after 3m52s
[18:56:21.230] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:14:0)
[18:56:21.255] Build status: STARTED
[18:56:21.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:15:0) after 3m29s
[18:59:50.287] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:15:0)
[18:59:50.312] Build status: STARTED
[18:59:50.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:16:0) after 3m59s
[19:03:49.450] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:16:0)
[19:03:49.470] Build status: STARTED
[19:03:49.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:17:0) after 2m31s
[19:06:20.507] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:17:0)
[19:06:20.536] Build status: STARTED
[19:06:20.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:18:0) after 7m34s
[19:13:54.570] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:18:0)
[19:13:54.589] Build status: STARTED
[19:13:54.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:19:0) after 5m33s
[19:19:27.663] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:19:0)
[19:19:27.683] Build status: STARTED
[19:19:27.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:20:0) after 9m42s
[19:29:09.686] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:20:0)
[19:29:09.706] Build status: STARTED
[19:29:09.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:21:0) after 6m2s
[19:35:11.689] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:21:0)
[19:35:11.716] Build status: STARTED
[19:35:11.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:22:0) after 5m33s
[19:40:44.846] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:22:0)
[19:40:44.866] Build status: STARTED
[19:40:44.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:23:0) after 9m39s
[19:50:23.960] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:23:0)
[19:50:23.976] Build status: STARTED
[19:50:23.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:24:0) after 6m7s
[19:56:30.999] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:24:0)
[19:56:31.041] Build status: STARTED
[19:56:31.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:25:0) after 2m43s
[19:59:14.065] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:25:0)
[19:59:14.092] Build status: STARTED
[19:59:14.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:26:0) after 9m1s
[20:08:15.160] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:26:0)
[20:08:15.182] Build status: STARTED
[20:08:15.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:27:0) after 7m18s
[20:15:33.265] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:27:0)
[20:15:33.330] Build status: STARTED
[20:15:33.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:28:0) after 7m28s
[20:23:01.305] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:28:0)
[20:23:01.384] Build status: STARTED
[20:23:01.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:29:0) after 1m8s
[20:24:09.483] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:29:0)
[20:24:09.653] Build status: STARTED
[20:24:09.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:30:0) after 4m19s
[20:28:28.755] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:30:0)
[20:28:28.772] Build status: STARTED
[20:28:28.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:31:0) after 4m31s
[20:32:59.794] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:31:0)
[20:32:59.819] Build status: STARTED
[20:32:59.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:32:0) after 5m3s
[20:38:02.880] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:32:0)
[20:38:02.910] Build status: STARTED
[20:38:02.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:33:0) after 1m34s
[20:39:36.938] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:33:0)
[20:39:36.957] Build status: STARTED
[20:39:36.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:34:0) after 8m57s
[20:48:34.015] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:34:0)
[20:48:34.034] Build status: STARTED
[20:48:34.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:35:0) after 8m4s
[20:56:38.039] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:35:0)
[20:56:38.058] Build status: STARTED
[20:56:38.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:36:0) after 3m40s
[21:00:18.217] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:36:0)
[21:00:18.273] Build status: STARTED
[21:00:18.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:37:0) after 3m58s
[21:04:16.321] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:37:0)
[21:04:16.393] Build status: STARTED
[21:04:16.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:38:0) after 6m45s
[21:11:01.502] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:38:0)
[21:11:01.522] Build status: STARTED
[21:11:01.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:39:0) after 1m4s
[21:12:05.550] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:39:0)
[21:12:05.571] Build status: STARTED
[21:12:05.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:40:0) after 5m56s
[21:18:01.605] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:40:0)
[21:18:01.643] Build status: STARTED
[21:18:01.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:41:0) after 4m47s
[21:22:48.667] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:41:0)
[21:22:48.684] Build status: STARTED
[21:22:48.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:42:0) after 7m56s
[21:30:44.734] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:42:0)
[21:30:44.767] Build status: STARTED
[21:30:44.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:43:0) after 4m28s
[21:35:12.810] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:43:0)
[21:35:12.836] Build status: STARTED
[21:35:12.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:44:0) after 7m26s
[21:42:38.878] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:44:0)
[21:42:38.898] Build status: STARTED
[21:42:38.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:45:0) after 9m53s
[21:52:31.976] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:45:0)
[21:52:31.992] Build status: STARTED
[21:52:31.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:46:0) after 9m47s
[22:02:19.017] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:46:0)
[22:02:19.169] Build status: STARTED
[22:02:19.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:47:0) after 4m28s
[22:06:47.208] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:47:0)
[22:06:47.251] Build status: STARTED
[22:06:47.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:48:0) after 5m27s
[22:12:14.286] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:48:0)
[22:12:14.306] Build status: STARTED
[22:12:14.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:49:0) after 7m6s
[22:19:20.352] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:49:0)
[22:19:20.389] Build status: STARTED
[22:19:20.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:50:0) after 9m20s
[22:28:40.570] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:50:0)
[22:28:40.591] Build status: STARTED
[22:28:40.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:51:0) after 9m43s
[22:38:23.624] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:51:0)
[22:38:23.749] Build status: STARTED
[22:38:23.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:52:0) after 5m16s
[22:43:39.805] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:52:0)
[22:43:39.823] Build status: STARTED
[22:43:39.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:53:0) after 4m17s
[22:47:57.001] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:53:0)
[22:47:57.025] Build status: STARTED
[22:47:57.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:54:0) after 4m34s
[22:52:31.058] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:54:0)
[22:52:31.079] Build status: STARTED
[22:52:31.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:55:0) after 6m32s
[22:59:03.125] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:55:0)
[22:59:03.190] Build status: STARTED
[22:59:03.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:56:0) after 7m17s
[23:06:20.233] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:56:0)
[23:06:20.272] Build status: STARTED
[23:06:20.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:57:0) after 8m15s
[23:14:35.391] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:57:0)
[23:14:35.417] Build status: STARTED
[23:14:35.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:58:0) after 8m42s
[23:23:17.508] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:58:0)
[23:23:17.531] Build status: STARTED
[23:23:17.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:59:0) after 8m37s
[23:31:54.587] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:59:0)
[23:31:54.606] Build status: STARTED
[23:31:54.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:60:0) after 6m31s
[23:38:25.686] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:60:0)
[23:38:25.706] Build status: STARTED
[23:38:25.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8922703923944940640:61:0) after 8m37s
[23:45:08.486] Received PubSub notification, asking Buildbucket for the build status
[23:45:08.502] Build:
{
"id": "8757273862098823473",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 31144,
"createdBy": "project:chromium",
"createTime": "2024-02-01T17:50:58.188348713Z",
"startTime": "2024-02-01T17:50:59.836722Z",
"endTime": "2024-02-01T23:45:05.335585Z",
"updateTime": "2024-02-01T23:45:05.335585Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9f5d4d790ee11ab8f7e8080be60307fac5d09f49",
"ref": "refs/heads/main"
}
},
"canary": true
}
[23:45:08.502] Invocation finished in 5h54m11.457935676s with status FAILED