[19:27:00.929] New invocation is queued and will start shortly
[19:27:02.091] Starting the invocation (attempt 1)
[19:27:02.130] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/b971d9f204199caca6415c99327248cc30611808"
[19:27:02.130] Popped gitiles commit info from properties and tags
[19:27:02.130] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:27:02.131] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:27:02.131] Buildbucket request:
{
"requestId": "8836177777166384304",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacCoverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b971d9f204199caca6415c99327248cc30611808",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8836177777166384304"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacCoverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:27:02.831] Scheduled build:
{
"id": "8670747715178636161",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacCoverage"
},
"number": 93944,
"createdBy": "project:chromium",
"createTime": "2026-09-13T19:27:02.203046073Z",
"updateTime": "2026-09-13T19:27:02.203046073Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b971d9f204199caca6415c99327248cc30611808",
"ref": "refs/heads/main"
}
},
"canary": true
}
[19:27:02.831] Task URL: https://cr-buildbucket.appspot.com/build/8670747715178636161
[19:27:02.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:2:0) after 5m22s
[19:27:03.787] Received PubSub notification, asking Buildbucket for the build status
[19:27:03.837] Build status: SCHEDULED
[19:27:06.776] Received PubSub notification, asking Buildbucket for the build status
[19:27:06.796] Build status: STARTED
[19:32:24.871] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:2:0)
[19:32:25.002] Build status: STARTED
[19:32:25.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:5:0) after 4m25s
[19:36:50.155] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:5:0)
[19:36:50.173] Build status: STARTED
[19:36:50.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:6:0) after 6m18s
[19:43:08.302] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:6:0)
[19:43:08.320] Build status: STARTED
[19:43:08.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:7:0) after 5m12s
[19:48:20.335] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:7:0)
[19:48:20.354] Build status: STARTED
[19:48:20.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:8:0) after 9m0s
[19:57:20.357] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:8:0)
[19:57:20.376] Build status: STARTED
[19:57:20.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:9:0) after 9m24s
[20:06:44.543] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:9:0)
[20:06:44.571] Build status: STARTED
[20:06:44.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:10:0) after 5m55s
[20:12:39.666] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:10:0)
[20:12:39.685] Build status: STARTED
[20:12:39.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:11:0) after 2m21s
[20:15:01.085] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:11:0)
[20:15:01.108] Build status: STARTED
[20:15:01.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:12:0) after 8m8s
[20:23:09.320] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:12:0)
[20:23:09.340] Build status: STARTED
[20:23:09.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:13:0) after 1m46s
[20:24:55.579] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:13:0)
[20:24:55.600] Build status: STARTED
[20:24:55.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:14:0) after 2m57s
[20:27:52.963] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:14:0)
[20:27:52.982] Build status: STARTED
[20:27:52.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:15:0) after 4m53s
[20:32:45.996] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:15:0)
[20:32:46.151] Build status: STARTED
[20:32:46.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:16:0) after 4m55s
[20:37:41.168] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:16:0)
[20:37:41.186] Build status: STARTED
[20:37:41.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:17:0) after 4m25s
[20:42:06.199] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:17:0)
[20:42:06.257] Build status: STARTED
[20:42:06.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:18:0) after 7m42s
[20:49:48.297] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:18:0)
[20:49:48.312] Build status: STARTED
[20:49:48.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:19:0) after 1m36s
[20:51:24.376] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:19:0)
[20:51:24.393] Build status: STARTED
[20:51:24.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:20:0) after 9m41s
[21:01:05.408] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:20:0)
[21:01:05.429] Build status: STARTED
[21:01:05.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:21:0) after 2m12s
[21:03:17.448] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:21:0)
[21:03:17.467] Build status: STARTED
[21:03:17.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:22:0) after 5m2s
[21:08:19.484] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:22:0)
[21:08:19.501] Build status: STARTED
[21:08:19.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:23:0) after 4m33s
[21:12:52.601] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:23:0)
[21:12:52.622] Build status: STARTED
[21:12:52.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:24:0) after 9m34s
[21:22:26.854] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:24:0)
[21:22:26.872] Build status: STARTED
[21:22:26.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:25:0) after 5m20s
[21:27:46.915] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:25:0)
[21:27:46.933] Build status: STARTED
[21:27:46.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:26:0) after 8m31s
[21:36:17.953] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:26:0)
[21:36:17.973] Build status: STARTED
[21:36:17.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:27:0) after 7m42s
[21:43:59.990] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:27:0)
[21:44:00.008] Build status: STARTED
[21:44:00.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:28:0) after 7m27s
[21:51:27.026] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:28:0)
[21:51:27.052] Build status: STARTED
[21:51:27.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:29:0) after 5m20s
[21:56:47.334] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:29:0)
[21:56:47.475] Build status: STARTED
[21:56:47.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:30:0) after 8m4s
[22:04:51.590] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:30:0)
[22:04:51.608] Build status: STARTED
[22:04:51.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:31:0) after 8m57s
[22:13:49.063] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:31:0)
[22:13:49.083] Build status: STARTED
[22:13:49.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:32:0) after 3m10s
[22:16:59.052] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:32:0)
[22:16:59.120] Build status: STARTED
[22:16:59.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:33:0) after 2m46s
[22:19:45.136] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:33:0)
[22:19:45.172] Build status: STARTED
[22:19:45.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:34:0) after 8m1s
[22:27:46.238] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:34:0)
[22:27:46.268] Build status: STARTED
[22:27:46.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:35:0) after 2m56s
[22:30:42.287] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:35:0)
[22:30:42.309] Build status: STARTED
[22:30:42.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:36:0) after 3m28s
[22:34:10.471] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:36:0)
[22:34:10.491] Build status: STARTED
[22:34:10.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:37:0) after 3m46s
[22:37:56.510] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:37:0)
[22:37:56.531] Build status: STARTED
[22:37:56.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:38:0) after 5m59s
[22:43:55.549] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:38:0)
[22:43:55.568] Build status: STARTED
[22:43:55.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:39:0) after 5m56s
[22:49:51.772] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:39:0)
[22:49:51.789] Build status: STARTED
[22:49:51.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836177777166384304:40:0) after 4m47s
[22:50:27.273] Received PubSub notification, asking Buildbucket for the build status
[22:50:27.296] Build:
{
"id": "8670747715178636161",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacCoverage"
},
"number": 93944,
"createdBy": "project:chromium",
"createTime": "2026-09-13T19:27:02.203046073Z",
"startTime": "2026-09-13T19:27:06.438010871Z",
"endTime": "2026-09-13T22:50:26.809382824Z",
"updateTime": "2026-09-13T22:50:26.809382824Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b971d9f204199caca6415c99327248cc30611808",
"ref": "refs/heads/main"
}
},
"canary": true
}
[22:50:27.297] Invocation finished in 3h23m26.372016426s with status FAILED