[20:56:32.638] New invocation is queued and will start shortly
[20:56:33.734] Starting the invocation (attempt 1)
[20:56:33.764] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/107197cd616a76aa298f6e7d82ebbb6cc4daa0cf"
[20:56:33.764] Popped gitiles commit info from properties and tags
[20:56:33.764] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:56:33.764] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:56:33.764] Buildbucket request:
{
"requestId": "8995441611465077440",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "107197cd616a76aa298f6e7d82ebbb6cc4daa0cf",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8995441611465077440"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:56:34.409] Scheduled build:
{
"id": "8830011549556110449",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23584,
"createdBy": "project:chromium",
"createTime": "2021-11-20T20:56:33.825981244Z",
"updateTime": "2021-11-20T20:56:33.825981244Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "107197cd616a76aa298f6e7d82ebbb6cc4daa0cf",
"ref": "refs/heads/main"
}
}
}
[20:56:34.409] Task URL: https://cr-buildbucket.appspot.com/build/8830011549556110449
[20:56:34.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:2:0) after 2m45s
[20:59:09.624] Received PubSub notification, asking Buildbucket for the build status
[20:59:09.653] Build status: STARTED
[20:59:19.491] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:2:0)
[20:59:19.523] Build status: STARTED
[20:59:19.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:4:0) after 9m24s
[21:08:43.541] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:4:0)
[21:08:43.571] Build status: STARTED
[21:08:43.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:5:0) after 2m45s
[21:11:28.597] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:5:0)
[21:11:28.631] Build status: STARTED
[21:11:28.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:6:0) after 2m57s
[21:14:25.687] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:6:0)
[21:14:25.718] Build status: STARTED
[21:14:25.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:7:0) after 8m7s
[21:22:32.740] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:7:0)
[21:22:32.797] Build status: STARTED
[21:22:32.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:8:0) after 3m58s
[21:26:30.815] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:8:0)
[21:26:30.846] Build status: STARTED
[21:26:30.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:9:0) after 6m28s
[21:32:58.878] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:9:0)
[21:32:58.969] Build status: STARTED
[21:32:58.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:10:0) after 8m24s
[21:41:22.987] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:10:0)
[21:41:23.056] Build status: STARTED
[21:41:23.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:11:0) after 6m0s
[21:47:23.078] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:11:0)
[21:47:23.207] Build status: STARTED
[21:47:23.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:12:0) after 6m7s
[21:53:30.235] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:12:0)
[21:53:30.280] Build status: STARTED
[21:53:30.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:13:0) after 1m49s
[21:55:19.397] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:13:0)
[21:55:19.430] Build status: STARTED
[21:55:19.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:14:0) after 2m41s
[21:58:00.549] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:14:0)
[21:58:00.595] Build status: STARTED
[21:58:00.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:15:0) after 9m55s
[22:07:55.613] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:15:0)
[22:07:55.647] Build status: STARTED
[22:07:55.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:16:0) after 4m1s
[22:11:56.728] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:16:0)
[22:11:56.766] Build status: STARTED
[22:11:56.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:17:0) after 5m6s
[22:17:02.926] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:17:0)
[22:17:02.958] Build status: STARTED
[22:17:02.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:18:0) after 7m54s
[22:24:57.093] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:18:0)
[22:24:57.137] Build status: STARTED
[22:24:57.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:19:0) after 1m40s
[22:26:37.160] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:19:0)
[22:26:37.217] Build status: STARTED
[22:26:37.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:20:0) after 8m40s
[22:35:17.236] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:20:0)
[22:35:17.282] Build status: STARTED
[22:35:17.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:21:0) after 2m1s
[22:37:18.284] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:21:0)
[22:37:18.317] Build status: STARTED
[22:37:18.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:22:0) after 2m53s
[22:40:11.337] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:22:0)
[22:40:11.394] Build status: STARTED
[22:40:11.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:23:0) after 4m44s
[22:44:56.038] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:23:0)
[22:44:56.070] Build status: STARTED
[22:44:56.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:24:0) after 3m1s
[22:47:57.538] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:24:0)
[22:47:57.570] Build status: STARTED
[22:47:57.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:25:0) after 4m54s
[22:52:51.670] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:25:0)
[22:52:51.706] Build status: STARTED
[22:52:51.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:26:0) after 6m10s
[22:59:01.915] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:26:0)
[22:59:01.972] Build status: STARTED
[22:59:01.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:27:0) after 3m51s
[23:02:53.379] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:27:0)
[23:02:53.416] Build status: STARTED
[23:02:53.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:28:0) after 8m15s
[23:11:08.662] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:28:0)
[23:11:08.703] Build status: STARTED
[23:11:08.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:29:0) after 1m0s
[23:12:08.855] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:29:0)
[23:12:08.886] Build status: STARTED
[23:12:08.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:30:0) after 1m29s
[23:13:37.957] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:30:0)
[23:13:38.000] Build status: STARTED
[23:13:38.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:31:0) after 4m41s
[23:18:19.026] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:31:0)
[23:18:19.063] Build status: STARTED
[23:18:19.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:32:0) after 1m2s
[23:19:21.526] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:32:0)
[23:19:21.575] Build status: STARTED
[23:19:21.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:33:0) after 7m21s
[23:26:43.012] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:33:0)
[23:26:43.047] Build status: STARTED
[23:26:43.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:34:0) after 9m32s
[23:36:15.077] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:34:0)
[23:36:15.158] Build status: STARTED
[23:36:15.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:35:0) after 9m38s
[23:45:53.192] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:35:0)
[23:45:53.226] Build status: STARTED
[23:45:53.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:36:0) after 9m32s
[23:55:25.231] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:36:0)
[23:55:25.267] Build status: STARTED
[23:55:25.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:37:0) after 8m5s
[00:03:30.482] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:37:0)
[00:03:30.517] Build status: STARTED
[00:03:30.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:38:0) after 5m16s
[00:08:46.545] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:38:0)
[00:08:46.582] Build status: STARTED
[00:08:46.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:39:0) after 7m29s
[00:16:15.635] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:39:0)
[00:16:15.669] Build status: STARTED
[00:16:15.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:40:0) after 8m26s
[00:24:41.667] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:40:0)
[00:24:41.703] Build status: STARTED
[00:24:41.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:41:0) after 6m37s
[00:31:18.723] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:41:0)
[00:31:18.778] Build status: STARTED
[00:31:18.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:42:0) after 5m30s
[00:36:48.897] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:42:0)
[00:36:48.931] Build status: STARTED
[00:36:48.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:43:0) after 7m20s
[00:44:08.960] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:43:0)
[00:44:08.994] Build status: STARTED
[00:44:08.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:44:0) after 5m18s
[00:49:27.019] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:44:0)
[00:49:27.101] Build status: STARTED
[00:49:27.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:45:0) after 7m52s
[00:57:19.142] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:45:0)
[00:57:19.172] Build status: STARTED
[00:57:19.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:46:0) after 1m19s
[00:58:38.986] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:46:0)
[00:58:39.015] Build status: STARTED
[00:58:39.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:47:0) after 6m37s
[01:05:16.136] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:47:0)
[01:05:16.167] Build status: STARTED
[01:05:16.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:48:0) after 4m36s
[01:09:52.271] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:48:0)
[01:09:52.308] Build status: STARTED
[01:09:52.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:49:0) after 1m10s
[01:11:02.326] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:49:0)
[01:11:02.378] Build status: STARTED
[01:11:02.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:50:0) after 2m8s
[01:13:10.409] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:50:0)
[01:13:10.442] Build status: STARTED
[01:13:10.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:51:0) after 1m40s
[01:14:50.464] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:51:0)
[01:14:50.496] Build status: STARTED
[01:14:50.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:52:0) after 7m43s
[01:22:34.336] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:52:0)
[01:22:34.366] Build status: STARTED
[01:22:34.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:53:0) after 8m56s
[01:31:30.639] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:53:0)
[01:31:30.671] Build status: STARTED
[01:31:30.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:54:0) after 2m33s
[01:34:03.692] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:54:0)
[01:34:03.754] Build status: STARTED
[01:34:03.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:55:0) after 9m49s
[01:43:52.835] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:55:0)
[01:43:52.925] Build status: STARTED
[01:43:52.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:56:0) after 5m24s
[01:49:17.045] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:56:0)
[01:49:17.077] Build status: STARTED
[01:49:17.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:57:0) after 3m34s
[01:52:51.200] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:57:0)
[01:52:51.233] Build status: STARTED
[01:52:51.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:58:0) after 1m33s
[01:54:24.252] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:58:0)
[01:54:24.283] Build status: STARTED
[01:54:24.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:59:0) after 3m16s
[01:57:40.309] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:59:0)
[01:57:40.348] Build status: STARTED
[01:57:40.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:60:0) after 1m3s
[01:58:43.464] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:60:0)
[01:58:43.535] Build status: STARTED
[01:58:43.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:61:0) after 1m38s
[02:00:21.655] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:61:0)
[02:00:21.697] Build status: STARTED
[02:00:21.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:62:0) after 2m24s
[02:02:45.837] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:62:0)
[02:02:45.865] Build status: STARTED
[02:02:45.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:63:0) after 7m7s
[02:09:52.914] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:63:0)
[02:09:52.956] Build status: STARTED
[02:09:52.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:64:0) after 1m21s
[02:11:14.037] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:64:0)
[02:11:14.081] Build status: STARTED
[02:11:14.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:65:0) after 4m32s
[02:15:46.169] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:65:0)
[02:15:46.202] Build status: STARTED
[02:15:46.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995441611465077440:66:0) after 5m57s
[02:16:22.707] Received PubSub notification, asking Buildbucket for the build status
[02:16:22.736] Build:
{
"id": "8830011549556110449",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23584,
"createdBy": "project:chromium",
"createTime": "2021-11-20T20:56:33.825981244Z",
"startTime": "2021-11-20T20:59:08.966339Z",
"endTime": "2021-11-21T02:16:22.058584758Z",
"updateTime": "2021-11-21T02:16:22.058584758Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "107197cd616a76aa298f6e7d82ebbb6cc4daa0cf",
"ref": "refs/heads/main"
}
}
}
[02:16:22.736] Invocation finished in 5h19m50.115213904s with status FAILED