[17:58:21.492] New invocation is queued and will start shortly
[17:58:22.577] Starting the invocation (attempt 1)
[17:58:22.605] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e1f324aa681af54101c1f2d173d92adb80e37088"
[17:58:22.605] Popped gitiles commit info from properties and tags
[17:58:22.605] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:58:22.606] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:58:22.606] Buildbucket request:
{
"requestId": "8955499559759514736",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e1f324aa681af54101c1f2d173d92adb80e37088",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8955499559759514736"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:58:23.198] Scheduled build:
{
"id": "8790069497803012657",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 28907,
"createdBy": "project:chromium",
"createTime": "2023-02-04T17:58:22.727859014Z",
"updateTime": "2023-02-04T17:58:22.727859014Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e1f324aa681af54101c1f2d173d92adb80e37088",
"ref": "refs/heads/main"
}
}
}
[17:58:23.198] Task URL: https://cr-buildbucket.appspot.com/build/8790069497803012657
[17:58:23.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:2:0) after 3m27s
[18:00:51.318] Received PubSub notification, asking Buildbucket for the build status
[18:00:51.353] Build status: STARTED
[18:01:50.350] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:2:0)
[18:01:50.370] Build status: STARTED
[18:01:50.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:4:0) after 7m58s
[18:09:48.588] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:4:0)
[18:09:48.623] Build status: STARTED
[18:09:48.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:5:0) after 6m7s
[18:15:56.293] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:5:0)
[18:15:56.334] Build status: STARTED
[18:15:56.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:6:0) after 7m34s
[18:23:30.593] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:6:0)
[18:23:30.617] Build status: STARTED
[18:23:30.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:7:0) after 3m59s
[18:27:29.731] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:7:0)
[18:27:29.759] Build status: STARTED
[18:27:29.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:8:0) after 5m44s
[18:33:13.776] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:8:0)
[18:33:13.798] Build status: STARTED
[18:33:13.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:9:0) after 6m9s
[18:39:22.903] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:9:0)
[18:39:22.946] Build status: STARTED
[18:39:22.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:10:0) after 7m50s
[18:47:12.973] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:10:0)
[18:47:12.996] Build status: STARTED
[18:47:12.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:11:0) after 1m39s
[18:48:52.261] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:11:0)
[18:48:52.543] Build status: STARTED
[18:48:52.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:12:0) after 2m6s
[18:50:59.185] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:12:0)
[18:50:59.206] Build status: STARTED
[18:50:59.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:13:0) after 8m40s
[18:59:39.223] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:13:0)
[18:59:39.246] Build status: STARTED
[18:59:39.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:14:0) after 4m48s
[19:04:27.284] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:14:0)
[19:04:27.308] Build status: STARTED
[19:04:27.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:15:0) after 3m16s
[19:07:43.324] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:15:0)
[19:07:43.346] Build status: STARTED
[19:07:43.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:16:0) after 5m40s
[19:13:23.367] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:16:0)
[19:13:23.395] Build status: STARTED
[19:13:23.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:17:0) after 6m44s
[19:20:08.164] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:17:0)
[19:20:08.188] Build status: STARTED
[19:20:08.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:18:0) after 3m34s
[19:23:42.206] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:18:0)
[19:23:42.243] Build status: STARTED
[19:23:42.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:19:0) after 8m45s
[19:32:27.269] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:19:0)
[19:32:27.340] Build status: STARTED
[19:32:27.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:20:0) after 4m47s
[19:37:14.996] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:20:0)
[19:37:15.027] Build status: STARTED
[19:37:15.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:21:0) after 2m50s
[19:40:05.165] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:21:0)
[19:40:05.188] Build status: STARTED
[19:40:05.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:22:0) after 7m40s
[19:47:45.205] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:22:0)
[19:47:45.229] Build status: STARTED
[19:47:45.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:23:0) after 7m30s
[19:55:15.251] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:23:0)
[19:55:15.275] Build status: STARTED
[19:55:15.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:24:0) after 3m7s
[19:58:22.752] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:24:0)
[19:58:22.773] Build status: STARTED
[19:58:22.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:25:0) after 3m7s
[20:01:30.655] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:25:0)
[20:01:30.675] Build status: STARTED
[20:01:30.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:26:0) after 3m14s
[20:04:44.695] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:26:0)
[20:04:44.716] Build status: STARTED
[20:04:44.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:27:0) after 3m5s
[20:07:49.919] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:27:0)
[20:07:49.939] Build status: STARTED
[20:07:49.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:28:0) after 3m17s
[20:11:07.254] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:28:0)
[20:11:07.276] Build status: STARTED
[20:11:07.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:29:0) after 2m52s
[20:13:59.305] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:29:0)
[20:13:59.330] Build status: STARTED
[20:13:59.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:30:0) after 1m49s
[20:15:48.407] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:30:0)
[20:15:48.442] Build status: STARTED
[20:15:48.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:31:0) after 8m28s
[20:24:16.786] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:31:0)
[20:24:16.811] Build status: STARTED
[20:24:16.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:32:0) after 7m53s
[20:32:09.833] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:32:0)
[20:32:09.864] Build status: STARTED
[20:32:09.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:33:0) after 7m11s
[20:39:21.422] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:33:0)
[20:39:21.451] Build status: STARTED
[20:39:21.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:34:0) after 2m18s
[20:41:40.056] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:34:0)
[20:41:40.084] Build status: STARTED
[20:41:40.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:35:0) after 8m45s
[20:50:25.125] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:35:0)
[20:50:25.144] Build status: STARTED
[20:50:25.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:36:0) after 6m13s
[20:56:38.259] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:36:0)
[20:56:38.281] Build status: STARTED
[20:56:38.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:37:0) after 5m4s
[21:01:42.296] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:37:0)
[21:01:42.319] Build status: STARTED
[21:01:42.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:38:0) after 9m52s
[21:11:34.335] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:38:0)
[21:11:34.357] Build status: STARTED
[21:11:34.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:39:0) after 2m55s
[21:14:29.755] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:39:0)
[21:14:29.776] Build status: STARTED
[21:14:29.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:40:0) after 9m48s
[21:24:18.211] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:40:0)
[21:24:18.240] Build status: STARTED
[21:24:18.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:41:0) after 3m42s
[21:28:00.262] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:41:0)
[21:28:00.327] Build status: STARTED
[21:28:00.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:42:0) after 2m46s
[21:30:46.359] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:42:0)
[21:30:46.378] Build status: STARTED
[21:30:46.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:43:0) after 9m48s
[21:40:34.410] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:43:0)
[21:40:34.432] Build status: STARTED
[21:40:34.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:44:0) after 6m31s
[21:47:06.242] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:44:0)
[21:47:06.263] Build status: STARTED
[21:47:06.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:45:0) after 8m19s
[21:55:25.473] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:45:0)
[21:55:25.503] Build status: STARTED
[21:55:25.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:46:0) after 7m45s
[22:03:10.568] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:46:0)
[22:03:10.590] Build status: STARTED
[22:03:10.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:47:0) after 8m38s
[22:11:48.869] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:47:0)
[22:11:48.890] Build status: STARTED
[22:11:48.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:48:0) after 1m8s
[22:12:56.907] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:48:0)
[22:12:56.925] Build status: STARTED
[22:12:56.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:49:0) after 5m48s
[22:18:44.945] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:49:0)
[22:18:44.967] Build status: STARTED
[22:18:44.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:50:0) after 2m12s
[22:20:57.360] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:50:0)
[22:20:57.384] Build status: STARTED
[22:20:57.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:51:0) after 3m58s
[22:24:55.524] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:51:0)
[22:24:55.543] Build status: STARTED
[22:24:55.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:52:0) after 6m5s
[22:31:00.563] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:52:0)
[22:31:00.586] Build status: STARTED
[22:31:00.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:53:0) after 4m47s
[22:35:47.609] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:53:0)
[22:35:47.630] Build status: STARTED
[22:35:47.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:54:0) after 2m10s
[22:37:57.649] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:54:0)
[22:37:57.693] Build status: STARTED
[22:37:57.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:55:0) after 2m11s
[22:40:08.802] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:55:0)
[22:40:08.827] Build status: STARTED
[22:40:08.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:56:0) after 9m22s
[22:49:30.851] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:56:0)
[22:49:30.870] Build status: STARTED
[22:49:30.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:57:0) after 8m32s
[22:58:02.887] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:57:0)
[22:58:02.939] Build status: STARTED
[22:58:02.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:58:0) after 4m48s
[23:02:50.965] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:58:0)
[23:02:50.983] Build status: STARTED
[23:02:50.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955499559759514736:59:0) after 7m19s
[23:05:16.886] Received PubSub notification, asking Buildbucket for the build status
[23:05:16.906] Build:
{
"id": "8790069497803012657",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 28907,
"createdBy": "project:chromium",
"createTime": "2023-02-04T17:58:22.727859014Z",
"startTime": "2023-02-04T18:00:50.734903Z",
"endTime": "2023-02-04T23:05:13.422373020Z",
"updateTime": "2023-02-04T23:05:13.422373020Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e1f324aa681af54101c1f2d173d92adb80e37088",
"ref": "refs/heads/main"
}
}
}
[23:05:16.906] Invocation finished in 5h6m55.429183538s with status FAILED