[04:07:06.423] New invocation is queued and will start shortly
[04:07:07.621] Starting the invocation (attempt 1)
[04:07:07.656] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5105fe77e507509cd78a3a721596f8090fd0150f"
[04:07:07.656] Popped gitiles commit info from properties and tags
[04:07:07.656] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:07:07.657] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:07:07.657] Buildbucket request:
{
"requestId": "8995867507608451824",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5105fe77e507509cd78a3a721596f8090fd0150f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8995867507608451824"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:07:08.233] Scheduled build:
{
"id": "8830437445581910609",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23563,
"createdBy": "project:chromium",
"createTime": "2021-11-16T04:07:07.724807377Z",
"updateTime": "2021-11-16T04:07:07.724807377Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5105fe77e507509cd78a3a721596f8090fd0150f",
"ref": "refs/heads/main"
}
}
}
[04:07:08.233] Task URL: https://cr-buildbucket.appspot.com/build/8830437445581910609
[04:07:08.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:2:0) after 7m45s
[04:09:38.754] Received PubSub notification, asking Buildbucket for the build status
[04:09:38.810] Build status: STARTED
[04:14:53.354] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:2:0)
[04:14:53.444] Build status: STARTED
[04:14:53.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:4:0) after 2m30s
[04:17:23.814] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:4:0)
[04:17:23.844] Build status: STARTED
[04:17:23.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:5:0) after 2m33s
[04:19:57.152] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:5:0)
[04:19:57.180] Build status: STARTED
[04:19:57.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:6:0) after 5m28s
[04:25:25.214] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:6:0)
[04:25:25.270] Build status: STARTED
[04:25:25.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:7:0) after 4m54s
[04:30:19.294] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:7:0)
[04:30:19.352] Build status: STARTED
[04:30:19.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:8:0) after 8m25s
[04:38:44.568] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:8:0)
[04:38:44.594] Build status: STARTED
[04:38:44.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:9:0) after 8m21s
[04:47:05.606] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:9:0)
[04:47:05.640] Build status: STARTED
[04:47:05.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:10:0) after 2m27s
[04:49:32.673] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:10:0)
[04:49:32.763] Build status: STARTED
[04:49:32.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:11:0) after 3m1s
[04:52:33.795] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:11:0)
[04:52:33.831] Build status: STARTED
[04:52:33.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:12:0) after 9m49s
[05:02:23.167] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:12:0)
[05:02:23.201] Build status: STARTED
[05:02:23.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:13:0) after 6m14s
[05:08:37.229] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:13:0)
[05:08:37.259] Build status: STARTED
[05:08:37.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:14:0) after 2m20s
[05:10:57.289] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:14:0)
[05:10:57.320] Build status: STARTED
[05:10:57.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:15:0) after 9m28s
[05:20:25.353] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:15:0)
[05:20:25.384] Build status: STARTED
[05:20:25.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:16:0) after 5m54s
[05:26:19.442] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:16:0)
[05:26:19.476] Build status: STARTED
[05:26:19.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:17:0) after 9m57s
[05:36:16.546] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:17:0)
[05:36:16.575] Build status: STARTED
[05:36:16.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:18:0) after 5m45s
[05:42:01.787] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:18:0)
[05:42:01.824] Build status: STARTED
[05:42:01.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:19:0) after 5m47s
[05:47:49.142] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:19:0)
[05:47:49.174] Build status: STARTED
[05:47:49.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:20:0) after 7m2s
[05:54:51.203] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:20:0)
[05:54:51.254] Build status: STARTED
[05:54:51.254] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:21:0) after 3m9s
[05:58:00.287] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:21:0)
[05:58:00.317] Build status: STARTED
[05:58:00.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:22:0) after 2m4s
[06:00:04.473] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:22:0)
[06:00:04.507] Build status: STARTED
[06:00:04.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:23:0) after 8m48s
[06:08:52.534] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:23:0)
[06:08:52.568] Build status: STARTED
[06:08:52.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:24:0) after 9m45s
[06:18:37.693] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:24:0)
[06:18:37.758] Build status: STARTED
[06:18:37.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:25:0) after 1m57s
[06:20:34.818] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:25:0)
[06:20:34.903] Build status: STARTED
[06:20:34.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:26:0) after 4m50s
[06:25:24.978] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:26:0)
[06:25:25.043] Build status: STARTED
[06:25:25.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:27:0) after 6m4s
[06:31:29.200] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:27:0)
[06:31:29.268] Build status: STARTED
[06:31:29.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:28:0) after 5m21s
[06:36:50.293] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:28:0)
[06:36:50.320] Build status: STARTED
[06:36:50.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:29:0) after 7m40s
[06:44:30.346] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:29:0)
[06:44:30.387] Build status: STARTED
[06:44:30.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:30:0) after 9m34s
[06:54:04.651] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:30:0)
[06:54:04.743] Build status: STARTED
[06:54:04.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:31:0) after 1m25s
[06:55:29.766] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:31:0)
[06:55:29.819] Build status: STARTED
[06:55:29.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:32:0) after 1m42s
[06:57:12.031] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:32:0)
[06:57:12.058] Build status: STARTED
[06:57:12.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:33:0) after 7m32s
[07:04:44.095] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:33:0)
[07:04:44.137] Build status: STARTED
[07:04:44.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:34:0) after 3m58s
[07:08:42.161] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:34:0)
[07:08:42.292] Build status: STARTED
[07:08:42.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:35:0) after 8m17s
[07:16:59.314] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:35:0)
[07:16:59.345] Build status: STARTED
[07:16:59.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:36:0) after 1m50s
[07:18:49.548] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:36:0)
[07:18:49.581] Build status: STARTED
[07:18:49.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:37:0) after 7m56s
[07:26:45.608] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:37:0)
[07:26:45.641] Build status: STARTED
[07:26:45.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:38:0) after 8m12s
[07:34:57.671] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:38:0)
[07:34:57.711] Build status: STARTED
[07:34:57.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:39:0) after 4m6s
[07:39:04.006] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:39:0)
[07:39:04.064] Build status: STARTED
[07:39:04.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:40:0) after 7m57s
[07:47:01.208] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:40:0)
[07:47:01.362] Build status: STARTED
[07:47:01.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:41:0) after 8m32s
[07:55:33.392] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:41:0)
[07:55:33.426] Build status: STARTED
[07:55:33.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:42:0) after 6m7s
[08:01:40.734] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:42:0)
[08:01:40.766] Build status: STARTED
[08:01:40.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:43:0) after 4m24s
[08:06:04.937] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:43:0)
[08:06:04.986] Build status: STARTED
[08:06:04.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:44:0) after 8m22s
[08:14:27.119] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:44:0)
[08:14:27.151] Build status: STARTED
[08:14:27.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:45:0) after 4m38s
[08:19:05.210] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:45:0)
[08:19:05.240] Build status: STARTED
[08:19:05.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:46:0) after 5m49s
[08:24:54.262] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:46:0)
[08:24:54.302] Build status: STARTED
[08:24:54.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:47:0) after 5m32s
[08:30:26.454] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:47:0)
[08:30:26.503] Build status: STARTED
[08:30:26.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:48:0) after 2m37s
[08:33:03.679] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:48:0)
[08:33:03.708] Build status: STARTED
[08:33:03.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:49:0) after 2m32s
[08:35:35.830] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:49:0)
[08:35:35.910] Build status: STARTED
[08:35:35.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:50:0) after 9m10s
[08:44:45.935] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:50:0)
[08:44:45.981] Build status: STARTED
[08:44:45.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:51:0) after 7m18s
[08:52:04.078] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:51:0)
[08:52:04.111] Build status: STARTED
[08:52:04.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:52:0) after 6m24s
[08:58:28.161] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:52:0)
[08:58:28.205] Build status: STARTED
[08:58:28.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:53:0) after 5m7s
[09:03:35.238] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:53:0)
[09:03:35.271] Build status: STARTED
[09:03:35.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:54:0) after 4m16s
[09:07:51.679] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:54:0)
[09:07:51.713] Build status: STARTED
[09:07:51.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:55:0) after 5m44s
[09:13:35.734] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:55:0)
[09:13:35.873] Build status: STARTED
[09:13:35.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:56:0) after 7m36s
[09:21:11.900] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:56:0)
[09:21:12.001] Build status: STARTED
[09:21:12.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:57:0) after 2m43s
[09:23:55.125] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:57:0)
[09:23:55.157] Build status: STARTED
[09:23:55.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:58:0) after 2m10s
[09:26:05.338] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:58:0)
[09:26:05.384] Build status: STARTED
[09:26:05.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8995867507608451824:59:0) after 5m21s
[09:27:05.025] Received PubSub notification, asking Buildbucket for the build status
[09:27:05.063] Build:
{
"id": "8830437445581910609",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23563,
"createdBy": "project:chromium",
"createTime": "2021-11-16T04:07:07.724807377Z",
"startTime": "2021-11-16T04:09:38.035515Z",
"endTime": "2021-11-16T09:27:04.746802695Z",
"updateTime": "2021-11-16T09:27:04.746802695Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5105fe77e507509cd78a3a721596f8090fd0150f",
"ref": "refs/heads/main"
}
}
}
[09:27:05.063] Invocation finished in 5h19m58.654610736s with status FAILED