[18:52:22.452] New invocation is queued and will start shortly
[18:52:23.519] Starting the invocation (attempt 1)
[18:52:23.552] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5df2786f8b879bdd688e58e0dd5a2312ea702ddc"
[18:52:23.552] Popped gitiles commit info from properties and tags
[18:52:23.552] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:52:23.552] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:52:23.552] Buildbucket request:
{
"requestId": "8928407668404955280",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5df2786f8b879bdd688e58e0dd5a2312ea702ddc",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8928407668404955280"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:52:24.250] Scheduled build:
{
"id": "8762977606535022865",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30969,
"createdBy": "project:chromium",
"createTime": "2023-11-30T18:52:23.612957065Z",
"updateTime": "2023-11-30T18:52:23.612957065Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5df2786f8b879bdd688e58e0dd5a2312ea702ddc",
"ref": "refs/heads/main"
}
}
}
[18:52:24.250] Task URL: https://cr-buildbucket.appspot.com/build/8762977606535022865
[18:52:24.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:2:0) after 7m18s
[18:52:25.152] Received PubSub notification, asking Buildbucket for the build status
[18:52:25.187] Build status: SCHEDULED
[18:53:12.091] Received PubSub notification, asking Buildbucket for the build status
[18:53:12.198] Build status: STARTED
[18:59:42.287] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:2:0)
[18:59:42.319] Build status: STARTED
[18:59:42.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:5:0) after 8m17s
[19:07:59.340] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:5:0)
[19:07:59.428] Build status: STARTED
[19:07:59.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:6:0) after 2m46s
[19:10:45.449] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:6:0)
[19:10:45.499] Build status: STARTED
[19:10:45.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:7:0) after 8m21s
[19:19:06.522] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:7:0)
[19:19:06.544] Build status: STARTED
[19:19:06.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:8:0) after 6m36s
[19:25:42.597] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:8:0)
[19:25:42.626] Build status: STARTED
[19:25:42.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:9:0) after 3m52s
[19:29:34.753] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:9:0)
[19:29:34.775] Build status: STARTED
[19:29:34.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:10:0) after 2m1s
[19:31:35.773] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:10:0)
[19:31:35.791] Build status: STARTED
[19:31:35.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:11:0) after 7m29s
[19:39:04.768] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:11:0)
[19:39:04.788] Build status: STARTED
[19:39:04.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:12:0) after 4m52s
[19:43:56.819] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:12:0)
[19:43:56.849] Build status: STARTED
[19:43:56.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:13:0) after 4m15s
[19:48:11.886] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:13:0)
[19:48:11.907] Build status: STARTED
[19:48:11.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:14:0) after 9m38s
[19:57:49.929] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:14:0)
[19:57:49.980] Build status: STARTED
[19:57:49.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:15:0) after 8m28s
[20:06:18.272] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:15:0)
[20:06:18.311] Build status: STARTED
[20:06:18.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:16:0) after 3m7s
[20:09:25.329] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:16:0)
[20:09:25.351] Build status: STARTED
[20:09:25.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:17:0) after 7m24s
[20:16:49.378] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:17:0)
[20:16:49.401] Build status: STARTED
[20:16:49.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:18:0) after 9m55s
[20:26:44.483] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:18:0)
[20:26:44.521] Build status: STARTED
[20:26:44.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:19:0) after 7m5s
[20:33:49.515] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:19:0)
[20:33:49.536] Build status: STARTED
[20:33:49.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:20:0) after 6m7s
[20:39:56.562] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:20:0)
[20:39:56.583] Build status: STARTED
[20:39:56.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:21:0) after 9m54s
[20:49:50.668] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:21:0)
[20:49:50.724] Build status: STARTED
[20:49:50.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:22:0) after 9m32s
[20:59:22.802] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:22:0)
[20:59:22.830] Build status: STARTED
[20:59:22.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:23:0) after 7m19s
[21:06:42.053] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:23:0)
[21:06:42.070] Build status: STARTED
[21:06:42.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:24:0) after 3m15s
[21:09:57.180] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:24:0)
[21:09:57.203] Build status: STARTED
[21:09:57.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:25:0) after 9m14s
[21:19:11.849] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:25:0)
[21:19:11.873] Build status: STARTED
[21:19:11.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:26:0) after 7m28s
[21:26:39.954] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:26:0)
[21:26:39.974] Build status: STARTED
[21:26:39.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:27:0) after 1m4s
[21:27:43.999] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:27:0)
[21:27:44.070] Build status: STARTED
[21:27:44.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:28:0) after 9m17s
[21:37:01.094] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:28:0)
[21:37:01.132] Build status: STARTED
[21:37:01.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:29:0) after 1m59s
[21:39:00.673] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:29:0)
[21:39:00.722] Build status: STARTED
[21:39:00.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:30:0) after 7m8s
[21:46:08.752] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:30:0)
[21:46:08.769] Build status: STARTED
[21:46:08.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:31:0) after 6m14s
[21:52:23.325] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:31:0)
[21:52:23.399] Build status: STARTED
[21:52:23.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:32:0) after 7m39s
[22:00:02.433] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:32:0)
[22:00:02.460] Build status: STARTED
[22:00:02.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:33:0) after 5m26s
[22:05:28.471] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:33:0)
[22:05:28.493] Build status: STARTED
[22:05:28.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:34:0) after 3m41s
[22:09:09.576] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:34:0)
[22:09:09.597] Build status: STARTED
[22:09:09.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:35:0) after 8m44s
[22:17:53.738] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:35:0)
[22:17:53.754] Build status: STARTED
[22:17:53.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:36:0) after 6m20s
[22:24:14.123] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:36:0)
[22:24:14.143] Build status: STARTED
[22:24:14.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:37:0) after 9m47s
[22:34:01.257] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:37:0)
[22:34:01.288] Build status: STARTED
[22:34:01.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:38:0) after 5m37s
[22:39:38.326] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:38:0)
[22:39:38.365] Build status: STARTED
[22:39:38.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:39:0) after 3m31s
[22:43:09.865] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:39:0)
[22:43:09.950] Build status: STARTED
[22:43:09.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:40:0) after 9m30s
[22:52:39.977] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:40:0)
[22:52:39.999] Build status: STARTED
[22:52:39.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:41:0) after 6m5s
[22:58:45.183] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:41:0)
[22:58:45.227] Build status: STARTED
[22:58:45.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:42:0) after 5m59s
[23:04:44.259] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:42:0)
[23:04:44.278] Build status: STARTED
[23:04:44.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:43:0) after 1m13s
[23:05:57.507] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:43:0)
[23:05:57.549] Build status: STARTED
[23:05:57.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:44:0) after 5m0s
[23:10:57.587] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:44:0)
[23:10:57.609] Build status: STARTED
[23:10:57.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:45:0) after 9m50s
[23:20:47.755] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:45:0)
[23:20:47.775] Build status: STARTED
[23:20:47.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:46:0) after 9m2s
[23:29:49.798] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:46:0)
[23:29:49.824] Build status: STARTED
[23:29:49.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:47:0) after 9m26s
[23:39:16.285] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:47:0)
[23:39:16.309] Build status: STARTED
[23:39:16.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:48:0) after 9m53s
[23:49:09.420] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:48:0)
[23:49:09.439] Build status: STARTED
[23:49:09.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:49:0) after 2m51s
[23:52:00.562] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:49:0)
[23:52:00.581] Build status: STARTED
[23:52:00.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:50:0) after 8m41s
[00:00:41.858] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:50:0)
[00:00:41.903] Build status: STARTED
[00:00:41.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:51:0) after 1m31s
[00:02:12.934] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:51:0)
[00:02:12.952] Build status: STARTED
[00:02:12.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:52:0) after 7m58s
[00:10:10.990] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:52:0)
[00:10:11.064] Build status: STARTED
[00:10:11.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:53:0) after 9m13s
[00:19:24.085] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:53:0)
[00:19:24.121] Build status: STARTED
[00:19:24.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:54:0) after 7m53s
[00:27:17.235] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:54:0)
[00:27:17.255] Build status: STARTED
[00:27:17.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:55:0) after 1m6s
[00:28:23.357] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:55:0)
[00:28:23.396] Build status: STARTED
[00:28:23.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:56:0) after 9m20s
[00:37:43.441] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:56:0)
[00:37:43.461] Build status: STARTED
[00:37:43.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:57:0) after 2m26s
[00:40:09.539] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:57:0)
[00:40:09.556] Build status: STARTED
[00:40:09.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:58:0) after 7m5s
[00:47:14.576] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:58:0)
[00:47:14.751] Build status: STARTED
[00:47:14.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:59:0) after 8m22s
[00:55:36.844] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:59:0)
[00:55:36.903] Build status: STARTED
[00:55:36.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:60:0) after 2m36s
[00:58:12.993] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:60:0)
[00:58:13.070] Build status: STARTED
[00:58:13.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:61:0) after 2m6s
[01:00:19.133] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:61:0)
[01:00:19.163] Build status: STARTED
[01:00:19.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:62:0) after 6m11s
[01:06:30.431] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:62:0)
[01:06:30.455] Build status: STARTED
[01:06:30.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8928407668404955280:63:0) after 7m7s
[01:09:22.314] Received PubSub notification, asking Buildbucket for the build status
[01:09:22.410] Build:
{
"id": "8762977606535022865",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30969,
"createdBy": "project:chromium",
"createTime": "2023-11-30T18:52:23.612957065Z",
"startTime": "2023-11-30T18:53:10.953841Z",
"endTime": "2023-12-01T01:09:21.646483Z",
"updateTime": "2023-12-01T01:09:21.646483Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5df2786f8b879bdd688e58e0dd5a2312ea702ddc",
"ref": "refs/heads/main"
}
}
}
[01:09:22.410] Invocation finished in 6h16m59.965145124s with status FAILED