[19:54:05.181] New invocation is queued and will start shortly
[19:54:06.285] Starting the invocation (attempt 1)
[19:54:06.320] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/65214a21cdde985a60ccdf4186d5689a7a6f30ce"
[19:54:06.320] Popped gitiles commit info from properties and tags
[19:54:06.320] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:54:06.322] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:54:06.322] Buildbucket request:
{
"requestId": "8957576008991800896",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "65214a21cdde985a60ccdf4186d5689a7a6f30ce",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8957576008991800896"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOS"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:54:06.817] Scheduled build:
{
"id": "8792145947065529537",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 24908,
"createdBy": "project:chromium",
"createTime": "2023-01-12T19:54:06.396744750Z",
"updateTime": "2023-01-12T19:54:06.396744750Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "65214a21cdde985a60ccdf4186d5689a7a6f30ce",
"ref": "refs/heads/main"
}
},
"canary": true
}
[19:54:06.817] Task URL: https://cr-buildbucket.appspot.com/build/8792145947065529537
[19:54:06.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:2:0) after 7m15s
[19:56:52.185] Received PubSub notification, asking Buildbucket for the build status
[19:56:52.205] Build status: STARTED
[20:01:21.850] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:2:0)
[20:01:21.879] Build status: STARTED
[20:01:21.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:4:0) after 1m42s
[20:03:03.956] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:4:0)
[20:03:03.978] Build status: STARTED
[20:03:03.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:5:0) after 7m59s
[20:11:03.038] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:5:0)
[20:11:03.075] Build status: STARTED
[20:11:03.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:6:0) after 4m29s
[20:15:32.102] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:6:0)
[20:15:32.196] Build status: STARTED
[20:15:32.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:7:0) after 2m3s
[20:17:35.391] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:7:0)
[20:17:35.429] Build status: STARTED
[20:17:35.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:8:0) after 9m7s
[20:26:42.487] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:8:0)
[20:26:42.508] Build status: STARTED
[20:26:42.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:9:0) after 5m50s
[20:32:32.592] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:9:0)
[20:32:32.615] Build status: STARTED
[20:32:32.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:10:0) after 9m38s
[20:42:10.649] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:10:0)
[20:42:10.674] Build status: STARTED
[20:42:10.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:11:0) after 8m12s
[20:50:22.674] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:11:0)
[20:50:22.782] Build status: STARTED
[20:50:22.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:12:0) after 1m9s
[20:51:31.884] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:12:0)
[20:51:31.909] Build status: STARTED
[20:51:31.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:13:0) after 6m26s
[20:57:57.934] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:13:0)
[20:57:57.957] Build status: STARTED
[20:57:57.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:14:0) after 7m59s
[21:05:56.994] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:14:0)
[21:05:57.018] Build status: STARTED
[21:05:57.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:15:0) after 1m5s
[21:07:02.093] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:15:0)
[21:07:02.200] Build status: STARTED
[21:07:02.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:16:0) after 4m27s
[21:11:29.194] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:16:0)
[21:11:29.223] Build status: STARTED
[21:11:29.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:17:0) after 6m20s
[21:17:49.403] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:17:0)
[21:17:49.432] Build status: STARTED
[21:17:49.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:18:0) after 9m52s
[21:27:41.754] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:18:0)
[21:27:41.788] Build status: STARTED
[21:27:41.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:19:0) after 6m42s
[21:34:24.270] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:19:0)
[21:34:24.291] Build status: STARTED
[21:34:24.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:20:0) after 2m58s
[21:37:22.311] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:20:0)
[21:37:22.391] Build status: STARTED
[21:37:22.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:21:0) after 5m3s
[21:42:25.467] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:21:0)
[21:42:25.486] Build status: STARTED
[21:42:25.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:22:0) after 7m16s
[21:49:41.562] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:22:0)
[21:49:41.580] Build status: STARTED
[21:49:41.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:23:0) after 1m17s
[21:50:58.895] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:23:0)
[21:50:58.924] Build status: STARTED
[21:50:58.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:24:0) after 9m7s
[22:00:05.946] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:24:0)
[22:00:05.966] Build status: STARTED
[22:00:05.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:25:0) after 3m33s
[22:03:39.004] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:25:0)
[22:03:39.046] Build status: STARTED
[22:03:39.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:26:0) after 2m9s
[22:05:48.306] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:26:0)
[22:05:48.357] Build status: STARTED
[22:05:48.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:27:0) after 9m20s
[22:15:08.544] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:27:0)
[22:15:08.629] Build status: STARTED
[22:15:08.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:28:0) after 3m47s
[22:18:57.133] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:28:0)
[22:18:57.214] Build status: STARTED
[22:18:57.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:29:0) after 4m40s
[22:23:37.727] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:29:0)
[22:23:37.755] Build status: STARTED
[22:23:37.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:30:0) after 9m17s
[22:32:54.784] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:30:0)
[22:32:54.807] Build status: STARTED
[22:32:54.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:31:0) after 3m24s
[22:36:18.800] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:31:0)
[22:36:18.821] Build status: STARTED
[22:36:18.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:32:0) after 6m29s
[22:42:47.873] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:32:0)
[22:42:47.897] Build status: STARTED
[22:42:47.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:33:0) after 4m40s
[22:47:27.997] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:33:0)
[22:47:28.045] Build status: STARTED
[22:47:28.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:34:0) after 2m9s
[22:49:37.112] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:34:0)
[22:49:37.132] Build status: STARTED
[22:49:37.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:35:0) after 7m52s
[22:57:29.253] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:35:0)
[22:57:29.276] Build status: STARTED
[22:57:29.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:36:0) after 8m1s
[23:05:30.317] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:36:0)
[23:05:30.358] Build status: STARTED
[23:05:30.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:37:0) after 1m1s
[23:06:31.433] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:37:0)
[23:06:31.451] Build status: STARTED
[23:06:31.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:38:0) after 5m43s
[23:12:14.531] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:38:0)
[23:12:14.658] Build status: STARTED
[23:12:14.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:39:0) after 6m35s
[23:18:49.687] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:39:0)
[23:18:49.707] Build status: STARTED
[23:18:49.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:40:0) after 8m31s
[23:27:20.918] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:40:0)
[23:27:20.986] Build status: STARTED
[23:27:20.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:41:0) after 8m31s
[23:35:52.011] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:41:0)
[23:35:52.032] Build status: STARTED
[23:35:52.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:42:0) after 4m31s
[23:40:23.118] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:42:0)
[23:40:23.140] Build status: STARTED
[23:40:23.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:43:0) after 8m53s
[23:49:16.242] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:43:0)
[23:49:16.271] Build status: STARTED
[23:49:16.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:44:0) after 9m11s
[23:58:27.290] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:44:0)
[23:58:27.312] Build status: STARTED
[23:58:27.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:45:0) after 9m28s
[00:07:55.556] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:45:0)
[00:07:55.602] Build status: STARTED
[00:07:55.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:46:0) after 6m42s
[00:14:37.628] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:46:0)
[00:14:37.647] Build status: STARTED
[00:14:37.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:47:0) after 3m24s
[00:18:01.955] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:47:0)
[00:18:01.975] Build status: STARTED
[00:18:01.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:48:0) after 4m13s
[00:22:15.085] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:48:0)
[00:22:15.109] Build status: STARTED
[00:22:15.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:49:0) after 3m9s
[00:25:24.136] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:49:0)
[00:25:24.156] Build status: STARTED
[00:25:24.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:50:0) after 4m55s
[00:30:19.591] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:50:0)
[00:30:19.618] Build status: STARTED
[00:30:19.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:51:0) after 8m41s
[00:39:00.596] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:51:0)
[00:39:00.623] Build status: STARTED
[00:39:00.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:52:0) after 7m25s
[00:46:25.645] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:52:0)
[00:46:25.668] Build status: STARTED
[00:46:25.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:53:0) after 3m17s
[00:49:42.693] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:53:0)
[00:49:42.726] Build status: STARTED
[00:49:42.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:54:0) after 7m40s
[00:57:22.764] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:54:0)
[00:57:22.787] Build status: STARTED
[00:57:22.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:55:0) after 3m33s
[01:00:56.390] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:55:0)
[01:00:56.410] Build status: STARTED
[01:00:56.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:56:0) after 5m2s
[01:05:58.434] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:56:0)
[01:05:58.458] Build status: STARTED
[01:05:58.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:57:0) after 3m36s
[01:09:34.493] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:57:0)
[01:09:34.519] Build status: STARTED
[01:09:34.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:58:0) after 4m25s
[01:13:59.565] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:58:0)
[01:13:59.593] Build status: STARTED
[01:13:59.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:59:0) after 4m36s
[01:18:35.616] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:59:0)
[01:18:35.643] Build status: STARTED
[01:18:35.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:60:0) after 3m23s
[01:21:58.835] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:60:0)
[01:21:58.859] Build status: STARTED
[01:21:58.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:61:0) after 2m2s
[01:24:00.937] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:61:0)
[01:24:00.976] Build status: STARTED
[01:24:00.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:62:0) after 3m36s
[01:27:37.122] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:62:0)
[01:27:37.146] Build status: STARTED
[01:27:37.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:63:0) after 6m9s
[01:33:46.173] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:63:0)
[01:33:46.196] Build status: STARTED
[01:33:46.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:64:0) after 5m20s
[01:39:06.351] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:64:0)
[01:39:06.374] Build status: STARTED
[01:39:06.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:65:0) after 3m18s
[01:42:24.399] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:65:0)
[01:42:24.421] Build status: STARTED
[01:42:24.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:66:0) after 6m32s
[01:48:56.730] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:66:0)
[01:48:56.752] Build status: STARTED
[01:48:56.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:67:0) after 3m37s
[01:52:33.909] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:67:0)
[01:52:33.928] Build status: STARTED
[01:52:33.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:68:0) after 4m25s
[01:56:58.969] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:68:0)
[01:56:58.999] Build status: STARTED
[01:56:58.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:8957576008991800896:69:0) after 3m42s
[01:57:27.744] Received PubSub notification, asking Buildbucket for the build status
[01:57:27.768] Build:
{
"id": "8792145947065529537",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 24908,
"createdBy": "project:chromium",
"createTime": "2023-01-12T19:54:06.396744750Z",
"startTime": "2023-01-12T19:56:51.639323Z",
"endTime": "2023-01-13T01:57:27.235173036Z",
"updateTime": "2023-01-13T01:57:27.235173036Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "65214a21cdde985a60ccdf4186d5689a7a6f30ce",
"ref": "refs/heads/main"
}
},
"canary": true
}
[01:57:27.768] Invocation finished in 6h3m22.59276129s with status FAILED