[10:51:14.290] New invocation is queued and will start shortly
[10:51:15.437] Starting the invocation (attempt 1)
[10:51:15.470] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a4fa04e8ff0881cb0615a87fa101600818055896"
[10:51:15.470] Popped gitiles commit info from properties and tags
[10:51:15.470] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:51:15.470] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:51:15.470] Buildbucket request:
{
"requestId": "8987778951865859312",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a4fa04e8ff0881cb0615a87fa101600818055896",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8987778951865859312"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:51:16.011] Scheduled build:
{
"id": "8822348889911701265",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 27524,
"createdBy": "project:chromium",
"createTime": "2022-02-13T10:51:15.524503949Z",
"updateTime": "2022-02-13T10:51:15.524503949Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a4fa04e8ff0881cb0615a87fa101600818055896",
"ref": "refs/heads/main"
}
},
"canary": true
}
[10:51:16.011] Task URL: https://cr-buildbucket.appspot.com/build/8822348889911701265
[10:51:16.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:2:0) after 4m11s
[10:55:27.136] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:2:0)
[10:55:27.156] Build status: SCHEDULED
[10:55:27.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:3:0) after 2m27s
[10:57:54.287] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:3:0)
[10:57:54.307] Build status: SCHEDULED
[10:57:54.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:4:0) after 3m2s
[11:00:56.328] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:4:0)
[11:00:56.359] Build status: SCHEDULED
[11:00:56.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:5:0) after 8m36s
[11:09:32.558] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:5:0)
[11:09:32.581] Build status: SCHEDULED
[11:09:32.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:6:0) after 3m16s
[11:12:48.803] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:6:0)
[11:12:48.823] Build status: SCHEDULED
[11:12:48.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:7:0) after 7m51s
[11:20:39.839] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:7:0)
[11:20:39.857] Build status: SCHEDULED
[11:20:39.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:8:0) after 7m45s
[11:21:14.034] Received PubSub notification, asking Buildbucket for the build status
[11:21:14.071] Build status: STARTED
[11:28:24.868] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:8:0)
[11:28:24.893] Build status: STARTED
[11:28:24.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:10:0) after 7m29s
[11:35:54.323] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:10:0)
[11:35:54.347] Build status: STARTED
[11:35:54.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:11:0) after 9m46s
[11:45:40.366] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:11:0)
[11:45:40.388] Build status: STARTED
[11:45:40.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:12:0) after 8m19s
[11:53:59.415] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:12:0)
[11:53:59.467] Build status: STARTED
[11:53:59.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:13:0) after 2m36s
[11:56:36.068] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:13:0)
[11:56:36.100] Build status: STARTED
[11:56:36.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:14:0) after 4m53s
[12:01:29.124] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:14:0)
[12:01:29.151] Build status: STARTED
[12:01:29.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:15:0) after 3m22s
[12:04:51.327] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:15:0)
[12:04:51.347] Build status: STARTED
[12:04:51.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:16:0) after 7m0s
[12:11:51.406] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:16:0)
[12:11:51.474] Build status: STARTED
[12:11:51.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:17:0) after 3m4s
[12:14:55.490] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:17:0)
[12:14:55.513] Build status: STARTED
[12:14:55.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:18:0) after 3m27s
[12:18:22.531] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:18:0)
[12:18:22.554] Build status: STARTED
[12:18:22.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:19:0) after 5m12s
[12:23:34.571] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:19:0)
[12:23:34.598] Build status: STARTED
[12:23:34.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:20:0) after 3m14s
[12:26:48.720] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:20:0)
[12:26:48.757] Build status: STARTED
[12:26:48.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:21:0) after 1m15s
[12:28:04.665] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:21:0)
[12:28:04.712] Build status: STARTED
[12:28:04.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:22:0) after 3m55s
[12:32:00.695] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:22:0)
[12:32:00.980] Build status: STARTED
[12:32:00.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:23:0) after 7m6s
[12:39:07.000] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:23:0)
[12:39:07.018] Build status: STARTED
[12:39:07.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:24:0) after 7m58s
[12:47:05.114] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:24:0)
[12:47:05.154] Build status: STARTED
[12:47:05.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:25:0) after 7m28s
[12:54:33.246] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:25:0)
[12:54:33.265] Build status: STARTED
[12:54:33.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:26:0) after 9m38s
[13:04:11.301] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:26:0)
[13:04:11.324] Build status: STARTED
[13:04:11.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:27:0) after 6m5s
[13:10:16.388] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:27:0)
[13:10:16.409] Build status: STARTED
[13:10:16.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:28:0) after 7m10s
[13:17:26.549] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:28:0)
[13:17:26.571] Build status: STARTED
[13:17:26.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:29:0) after 4m18s
[13:21:44.592] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:29:0)
[13:21:44.612] Build status: STARTED
[13:21:44.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:30:0) after 2m48s
[13:24:32.598] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:30:0)
[13:24:32.617] Build status: STARTED
[13:24:32.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:31:0) after 5m1s
[13:29:33.818] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:31:0)
[13:29:33.839] Build status: STARTED
[13:29:33.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:32:0) after 3m23s
[13:32:56.857] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:32:0)
[13:32:56.876] Build status: STARTED
[13:32:56.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:33:0) after 1m26s
[13:34:22.899] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:33:0)
[13:34:22.919] Build status: STARTED
[13:34:22.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:34:0) after 7m26s
[13:41:48.936] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:34:0)
[13:41:48.987] Build status: STARTED
[13:41:48.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:35:0) after 3m29s
[13:45:18.286] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:35:0)
[13:45:18.307] Build status: STARTED
[13:45:18.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:36:0) after 4m30s
[13:49:48.334] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:36:0)
[13:49:48.374] Build status: STARTED
[13:49:48.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:37:0) after 5m37s
[13:55:25.631] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:37:0)
[13:55:25.650] Build status: STARTED
[13:55:25.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:38:0) after 2m32s
[13:57:57.668] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:38:0)
[13:57:57.689] Build status: STARTED
[13:57:57.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:39:0) after 7m36s
[14:05:33.711] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:39:0)
[14:05:33.751] Build status: STARTED
[14:05:33.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:40:0) after 6m56s
[14:12:29.768] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:40:0)
[14:12:29.793] Build status: STARTED
[14:12:29.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:41:0) after 9m15s
[14:21:44.926] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:41:0)
[14:21:44.952] Build status: STARTED
[14:21:44.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:42:0) after 4m26s
[14:26:10.971] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:42:0)
[14:26:10.991] Build status: STARTED
[14:26:10.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:43:0) after 3m58s
[14:30:09.131] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:43:0)
[14:30:09.149] Build status: STARTED
[14:30:09.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:44:0) after 5m0s
[14:35:09.370] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:44:0)
[14:35:09.388] Build status: STARTED
[14:35:09.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:45:0) after 1m54s
[14:37:03.402] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:45:0)
[14:37:03.424] Build status: STARTED
[14:37:03.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:46:0) after 2m57s
[14:40:00.543] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:46:0)
[14:40:00.562] Build status: STARTED
[14:40:00.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:47:0) after 1m18s
[14:41:18.589] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:47:0)
[14:41:18.610] Build status: STARTED
[14:41:18.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:48:0) after 7m23s
[14:48:41.629] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:48:0)
[14:48:41.671] Build status: STARTED
[14:48:41.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:49:0) after 9m31s
[14:58:12.889] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:49:0)
[14:58:12.913] Build status: STARTED
[14:58:12.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:50:0) after 1m0s
[14:59:12.934] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:50:0)
[14:59:12.956] Build status: STARTED
[14:59:12.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:51:0) after 4m36s
[15:03:48.979] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:51:0)
[15:03:49.005] Build status: STARTED
[15:03:49.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:52:0) after 5m42s
[15:09:31.022] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:52:0)
[15:09:31.159] Build status: STARTED
[15:09:31.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:53:0) after 1m18s
[15:10:49.177] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:53:0)
[15:10:49.198] Build status: STARTED
[15:10:49.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:54:0) after 2m52s
[15:13:41.336] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:54:0)
[15:13:41.357] Build status: STARTED
[15:13:41.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:55:0) after 5m37s
[15:19:18.378] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:55:0)
[15:19:18.398] Build status: STARTED
[15:19:18.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:56:0) after 5m3s
[15:24:21.467] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:56:0)
[15:24:21.485] Build status: STARTED
[15:24:21.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:57:0) after 8m50s
[15:33:11.508] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:57:0)
[15:33:11.574] Build status: STARTED
[15:33:11.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:58:0) after 4m37s
[15:37:48.557] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:58:0)
[15:37:48.593] Build status: STARTED
[15:37:48.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:59:0) after 7m15s
[15:45:03.694] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:59:0)
[15:45:03.721] Build status: STARTED
[15:45:03.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:60:0) after 3m50s
[15:48:53.878] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:60:0)
[15:48:53.899] Build status: STARTED
[15:48:53.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:61:0) after 5m35s
[15:54:29.252] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:61:0)
[15:54:29.283] Build status: STARTED
[15:54:29.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:62:0) after 2m23s
[15:56:52.339] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:62:0)
[15:56:52.362] Build status: STARTED
[15:56:52.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:63:0) after 9m2s
[16:05:54.381] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:63:0)
[16:05:54.449] Build status: STARTED
[16:05:54.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:64:0) after 8m4s
[16:13:58.472] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:64:0)
[16:13:58.494] Build status: STARTED
[16:13:58.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:65:0) after 8m48s
[16:22:46.767] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:65:0)
[16:22:46.851] Build status: STARTED
[16:22:46.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:66:0) after 8m23s
[16:31:09.873] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:66:0)
[16:31:09.893] Build status: STARTED
[16:31:09.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:67:0) after 6m4s
[16:37:13.920] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:67:0)
[16:37:13.940] Build status: STARTED
[16:37:13.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:68:0) after 4m6s
[16:41:20.174] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:68:0)
[16:41:20.193] Build status: STARTED
[16:41:20.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:69:0) after 8m43s
[16:50:03.464] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:69:0)
[16:50:03.484] Build status: STARTED
[16:50:03.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:70:0) after 7m49s
[16:57:52.502] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:70:0)
[16:57:52.519] Build status: STARTED
[16:57:52.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:71:0) after 2m10s
[17:00:02.571] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:71:0)
[17:00:02.606] Build status: STARTED
[17:00:02.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:72:0) after 6m10s
[17:06:12.625] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:72:0)
[17:06:12.651] Build status: STARTED
[17:06:12.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:73:0) after 2m47s
[17:08:59.805] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:73:0)
[17:08:59.868] Build status: STARTED
[17:08:59.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:74:0) after 5m9s
[17:14:08.897] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:74:0)
[17:14:08.919] Build status: STARTED
[17:14:08.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:75:0) after 4m58s
[17:19:06.947] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:75:0)
[17:19:06.969] Build status: STARTED
[17:19:06.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:76:0) after 6m59s
[17:26:05.993] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:76:0)
[17:26:06.012] Build status: STARTED
[17:26:06.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:77:0) after 9m14s
[17:35:20.132] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:77:0)
[17:35:20.151] Build status: STARTED
[17:35:20.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:78:0) after 5m50s
[17:41:10.174] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:78:0)
[17:41:10.195] Build status: STARTED
[17:41:10.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:79:0) after 4m54s
[17:46:05.071] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:79:0)
[17:46:05.098] Build status: STARTED
[17:46:05.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:80:0) after 4m55s
[17:51:00.118] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:80:0)
[17:51:00.144] Build status: STARTED
[17:51:00.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:81:0) after 7m39s
[17:58:39.378] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:81:0)
[17:58:39.397] Build status: STARTED
[17:58:39.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:82:0) after 1m25s
[18:00:04.420] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:82:0)
[18:00:04.447] Build status: STARTED
[18:00:04.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:83:0) after 2m48s
[18:02:52.675] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:83:0)
[18:02:52.696] Build status: STARTED
[18:02:52.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:84:0) after 4m0s
[18:06:52.919] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:84:0)
[18:06:52.942] Build status: STARTED
[18:06:52.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:85:0) after 9m53s
[18:16:45.961] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:85:0)
[18:16:45.980] Build status: STARTED
[18:16:45.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:86:0) after 6m17s
[18:23:02.961] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:86:0)
[18:23:02.984] Build status: STARTED
[18:23:02.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:87:0) after 6m1s
[18:29:04.002] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:87:0)
[18:29:04.025] Build status: STARTED
[18:29:04.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:88:0) after 5m54s
[18:34:58.256] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:88:0)
[18:34:58.278] Build status: STARTED
[18:34:58.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:89:0) after 5m11s
[18:40:09.305] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:89:0)
[18:40:09.333] Build status: STARTED
[18:40:09.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:90:0) after 7m11s
[18:47:20.790] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:90:0)
[18:47:20.812] Build status: STARTED
[18:47:20.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:91:0) after 4m35s
[18:51:56.008] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:91:0)
[18:51:56.027] Build status: STARTED
[18:51:56.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:92:0) after 1m3s
[18:52:59.151] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:92:0)
[18:52:59.172] Build status: STARTED
[18:52:59.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:93:0) after 3m53s
[18:56:52.292] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:93:0)
[18:56:52.326] Build status: STARTED
[18:56:52.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:94:0) after 9m25s
[19:06:17.448] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:94:0)
[19:06:17.465] Build status: STARTED
[19:06:17.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:95:0) after 3m3s
[19:09:20.535] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:95:0)
[19:09:20.560] Build status: STARTED
[19:09:20.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:96:0) after 3m21s
[19:12:41.580] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:96:0)
[19:12:41.600] Build status: STARTED
[19:12:41.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:97:0) after 8m15s
[19:20:56.652] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:97:0)
[19:20:56.673] Build status: STARTED
[19:20:56.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:98:0) after 9m22s
[19:30:19.372] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:98:0)
[19:30:19.390] Build status: STARTED
[19:30:19.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:99:0) after 5m33s
[19:35:52.901] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:99:0)
[19:35:52.924] Build status: STARTED
[19:35:52.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:100:0) after 1m57s
[19:37:49.949] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:100:0)
[19:37:49.968] Build status: STARTED
[19:37:49.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:101:0) after 4m34s
[19:42:23.982] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:101:0)
[19:42:24.041] Build status: STARTED
[19:42:24.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:102:0) after 9m45s
[19:52:09.141] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:102:0)
[19:52:09.172] Build status: STARTED
[19:52:09.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:103:0) after 8m10s
[20:00:19.636] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:103:0)
[20:00:19.661] Build status: STARTED
[20:00:19.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:104:0) after 3m3s
[20:03:22.924] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:104:0)
[20:03:22.964] Build status: STARTED
[20:03:22.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:105:0) after 4m58s
[20:08:21.187] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:105:0)
[20:08:21.207] Build status: STARTED
[20:08:21.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:106:0) after 3m20s
[20:11:42.155] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:106:0)
[20:11:42.178] Build status: STARTED
[20:11:42.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:107:0) after 9m48s
[20:21:30.297] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:107:0)
[20:21:30.314] Build status: STARTED
[20:21:30.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:108:0) after 5m48s
[20:27:18.333] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:108:0)
[20:27:18.360] Build status: STARTED
[20:27:18.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:109:0) after 2m52s
[20:30:10.576] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:109:0)
[20:30:10.606] Build status: STARTED
[20:30:10.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:110:0) after 5m33s
[20:35:43.631] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:110:0)
[20:35:43.653] Build status: STARTED
[20:35:43.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:111:0) after 2m38s
[20:38:21.692] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:111:0)
[20:38:21.721] Build status: STARTED
[20:38:21.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:112:0) after 9m38s
[20:47:59.750] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:112:0)
[20:47:59.783] Build status: STARTED
[20:47:59.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:113:0) after 5m15s
[20:53:15.380] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:113:0)
[20:53:15.467] Build status: STARTED
[20:53:15.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:114:0) after 3m32s
[20:56:47.647] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:114:0)
[20:56:47.667] Build status: STARTED
[20:56:47.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:115:0) after 4m45s
[21:01:32.689] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:115:0)
[21:01:32.711] Build status: STARTED
[21:01:32.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:116:0) after 4m44s
[21:06:16.807] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:116:0)
[21:06:16.840] Build status: STARTED
[21:06:16.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:117:0) after 5m42s
[21:11:58.946] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:117:0)
[21:11:58.966] Build status: STARTED
[21:11:58.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:118:0) after 4m35s
[21:16:33.987] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:118:0)
[21:16:34.054] Build status: STARTED
[21:16:34.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:119:0) after 1m25s
[21:17:59.090] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:119:0)
[21:17:59.112] Build status: STARTED
[21:17:59.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:120:0) after 1m14s
[21:19:13.227] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:120:0)
[21:19:13.251] Build status: STARTED
[21:19:13.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:121:0) after 6m7s
[21:25:20.611] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:121:0)
[21:25:20.641] Build status: STARTED
[21:25:20.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:122:0) after 4m52s
[21:30:12.956] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:122:0)
[21:30:13.008] Build status: STARTED
[21:30:13.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:123:0) after 3m58s
[21:34:11.046] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:123:0)
[21:34:11.068] Build status: STARTED
[21:34:11.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:124:0) after 1m27s
[21:35:38.132] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:124:0)
[21:35:38.148] Build status: STARTED
[21:35:38.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:125:0) after 6m2s
[21:41:40.372] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:125:0)
[21:41:40.394] Build status: STARTED
[21:41:40.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:126:0) after 1m51s
[21:43:31.714] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:126:0)
[21:43:31.742] Build status: STARTED
[21:43:31.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:127:0) after 5m13s
[21:48:45.038] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:127:0)
[21:48:45.064] Build status: STARTED
[21:48:45.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:128:0) after 4m3s
[21:52:48.223] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:128:0)
[21:52:48.300] Build status: STARTED
[21:52:48.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:129:0) after 1m0s
[21:53:48.329] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:129:0)
[21:53:48.352] Build status: STARTED
[21:53:48.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:130:0) after 3m7s
[21:56:55.376] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:130:0)
[21:56:55.420] Build status: STARTED
[21:56:55.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:131:0) after 3m25s
[22:00:20.444] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:131:0)
[22:00:20.476] Build status: STARTED
[22:00:20.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:132:0) after 7m38s
[22:07:58.650] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:132:0)
[22:07:58.734] Build status: STARTED
[22:07:58.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8987778951865859312:133:0) after 5m58s
[22:10:35.209] Received PubSub notification, asking Buildbucket for the build status
[22:10:35.227] Build:
{
"id": "8822348889911701265",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 27524,
"createdBy": "project:chromium",
"createTime": "2022-02-13T10:51:15.524503949Z",
"startTime": "2022-02-13T11:21:13.186183Z",
"endTime": "2022-02-13T22:10:34.517376588Z",
"updateTime": "2022-02-13T22:10:34.517376588Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a4fa04e8ff0881cb0615a87fa101600818055896",
"ref": "refs/heads/main"
}
},
"canary": true
}
[22:10:35.227] Invocation finished in 11h19m20.950897688s with status FAILED