[20:44:15.022] New invocation is queued and will start shortly
[20:44:16.764] Starting the invocation (attempt 1)
[20:44:16.802] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2ae031812be750c7147b0a907fc2721c796e9f77"
[20:44:16.802] Popped gitiles commit info from properties and tags
[20:44:16.802] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:44:16.802] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:44:16.802] Buildbucket request:
{
"requestId": "9004592678518304656",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2ae031812be750c7147b0a907fc2721c796e9f77",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9004592678518304656"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:44:17.694] Scheduled build:
{
"id": "8839162615820408864",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22915,
"createdBy": "project:chromium",
"createTime": "2021-08-11T20:44:16.961713Z",
"updateTime": "2021-08-11T20:44:17.514899Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2ae031812be750c7147b0a907fc2721c796e9f77",
"ref": "refs/heads/main"
}
}
}
[20:44:17.694] Task URL: https://cr-buildbucket.appspot.com/build/8839162615820408864
[20:44:17.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:2:0) after 8m35s
[20:46:38.031] Received PubSub notification, asking Buildbucket for the build status
[20:46:38.069] Build status: STARTED
[20:52:52.759] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:2:0)
[20:52:52.790] Build status: STARTED
[20:52:52.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:4:0) after 1m8s
[20:54:00.941] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:4:0)
[20:54:00.971] Build status: STARTED
[20:54:00.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:5:0) after 5m36s
[20:59:37.213] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:5:0)
[20:59:37.243] Build status: STARTED
[20:59:37.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:6:0) after 4m37s
[21:04:14.265] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:6:0)
[21:04:14.294] Build status: STARTED
[21:04:14.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:7:0) after 3m57s
[21:08:11.316] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:7:0)
[21:08:11.348] Build status: STARTED
[21:08:11.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:8:0) after 5m25s
[21:13:36.707] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:8:0)
[21:13:36.743] Build status: STARTED
[21:13:36.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:9:0) after 4m33s
[21:18:09.793] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:9:0)
[21:18:09.834] Build status: STARTED
[21:18:09.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:10:0) after 6m20s
[21:24:29.978] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:10:0)
[21:24:30.007] Build status: STARTED
[21:24:30.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:11:0) after 2m35s
[21:27:05.154] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:11:0)
[21:27:05.184] Build status: STARTED
[21:27:05.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:12:0) after 7m15s
[21:34:20.175] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:12:0)
[21:34:20.230] Build status: STARTED
[21:34:20.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:13:0) after 9m55s
[21:44:15.302] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:13:0)
[21:44:15.334] Build status: STARTED
[21:44:15.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:14:0) after 2m37s
[21:46:52.540] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:14:0)
[21:46:52.570] Build status: STARTED
[21:46:52.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:15:0) after 1m35s
[21:48:27.590] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:15:0)
[21:48:27.616] Build status: STARTED
[21:48:27.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:16:0) after 5m28s
[21:53:55.728] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:16:0)
[21:53:55.756] Build status: STARTED
[21:53:55.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:17:0) after 8m43s
[22:02:39.423] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:17:0)
[22:02:39.538] Build status: STARTED
[22:02:39.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:18:0) after 1m1s
[22:03:40.694] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:18:0)
[22:03:40.728] Build status: STARTED
[22:03:40.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:19:0) after 4m44s
[22:08:24.764] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:19:0)
[22:08:24.802] Build status: STARTED
[22:08:24.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:20:0) after 5m53s
[22:14:17.883] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:20:0)
[22:14:17.986] Build status: STARTED
[22:14:17.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:21:0) after 6m20s
[22:20:38.451] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:21:0)
[22:20:38.484] Build status: STARTED
[22:20:38.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:22:0) after 6m37s
[22:27:15.775] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:22:0)
[22:27:15.804] Build status: STARTED
[22:27:15.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:23:0) after 4m41s
[22:31:57.094] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:23:0)
[22:31:57.125] Build status: STARTED
[22:31:57.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:24:0) after 2m29s
[22:34:26.119] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:24:0)
[22:34:26.147] Build status: STARTED
[22:34:26.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:25:0) after 3m46s
[22:38:12.277] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:25:0)
[22:38:12.309] Build status: STARTED
[22:38:12.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:26:0) after 6m51s
[22:45:03.476] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:26:0)
[22:45:03.508] Build status: STARTED
[22:45:03.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:27:0) after 4m40s
[22:49:43.516] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:27:0)
[22:49:43.543] Build status: STARTED
[22:49:43.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:28:0) after 9m52s
[22:59:35.854] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:28:0)
[22:59:35.893] Build status: STARTED
[22:59:35.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:29:0) after 3m59s
[23:03:35.318] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:29:0)
[23:03:35.351] Build status: STARTED
[23:03:35.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:30:0) after 2m51s
[23:06:26.543] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:30:0)
[23:06:26.601] Build status: STARTED
[23:06:26.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:31:0) after 2m56s
[23:09:22.889] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:31:0)
[23:09:22.918] Build status: STARTED
[23:09:22.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:32:0) after 9m1s
[23:18:23.963] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:32:0)
[23:18:24.002] Build status: STARTED
[23:18:24.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:33:0) after 7m51s
[23:26:15.029] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:33:0)
[23:26:15.058] Build status: STARTED
[23:26:15.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:34:0) after 6m28s
[23:32:43.173] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:34:0)
[23:32:43.209] Build status: STARTED
[23:32:43.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:35:0) after 5m18s
[23:38:01.316] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:35:0)
[23:38:01.350] Build status: STARTED
[23:38:01.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:36:0) after 8m22s
[23:46:23.814] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:36:0)
[23:46:23.845] Build status: STARTED
[23:46:23.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:37:0) after 4m26s
[23:50:50.136] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:37:0)
[23:50:50.173] Build status: STARTED
[23:50:50.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:38:0) after 9m17s
[00:00:07.216] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:38:0)
[00:00:07.248] Build status: STARTED
[00:00:07.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:39:0) after 3m27s
[00:03:34.229] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:39:0)
[00:03:34.265] Build status: STARTED
[00:03:34.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:40:0) after 4m51s
[00:08:25.307] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:40:0)
[00:08:25.341] Build status: STARTED
[00:08:25.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:41:0) after 2m14s
[00:10:39.366] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:41:0)
[00:10:39.408] Build status: STARTED
[00:10:39.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:42:0) after 6m7s
[00:16:46.647] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:42:0)
[00:16:46.760] Build status: STARTED
[00:16:46.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:43:0) after 7m42s
[00:24:28.890] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:43:0)
[00:24:28.923] Build status: STARTED
[00:24:28.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:44:0) after 7m7s
[00:31:35.946] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:44:0)
[00:31:35.973] Build status: STARTED
[00:31:35.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:45:0) after 5m14s
[00:36:50.091] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:45:0)
[00:36:50.129] Build status: STARTED
[00:36:50.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:46:0) after 5m39s
[00:42:29.484] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:46:0)
[00:42:29.522] Build status: STARTED
[00:42:29.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:47:0) after 7m50s
[00:50:19.853] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:47:0)
[00:50:19.912] Build status: STARTED
[00:50:19.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:48:0) after 8m37s
[00:58:57.002] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:48:0)
[00:58:57.029] Build status: STARTED
[00:58:57.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:49:0) after 6m40s
[01:05:37.054] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:49:0)
[01:05:37.083] Build status: STARTED
[01:05:37.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:50:0) after 6m55s
[01:12:32.229] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:50:0)
[01:12:32.284] Build status: STARTED
[01:12:32.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:51:0) after 5m11s
[01:17:43.611] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:51:0)
[01:17:43.641] Build status: STARTED
[01:17:43.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:52:0) after 2m42s
[01:20:25.763] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:52:0)
[01:20:25.898] Build status: STARTED
[01:20:25.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:53:0) after 6m45s
[01:27:11.139] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:53:0)
[01:27:11.165] Build status: STARTED
[01:27:11.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:54:0) after 1m9s
[01:28:20.377] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:54:0)
[01:28:20.436] Build status: STARTED
[01:28:20.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:55:0) after 9m50s
[01:38:10.463] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:55:0)
[01:38:10.487] Build status: STARTED
[01:38:10.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:56:0) after 1m51s
[01:40:01.536] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:56:0)
[01:40:01.578] Build status: STARTED
[01:40:01.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:57:0) after 5m42s
[01:45:43.803] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:57:0)
[01:45:43.838] Build status: STARTED
[01:45:43.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:58:0) after 5m32s
[01:51:16.382] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:58:0)
[01:51:16.409] Build status: STARTED
[01:51:16.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:59:0) after 9m55s
[02:01:11.534] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:59:0)
[02:01:11.570] Build status: STARTED
[02:01:11.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:60:0) after 7m15s
[02:08:26.647] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:60:0)
[02:08:26.860] Build status: STARTED
[02:08:26.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9004592678518304656:61:0) after 7m51s
[02:12:20.654] Received PubSub notification, asking Buildbucket for the build status
[02:12:20.679] Build:
{
"id": "8839162615820408864",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22915,
"createdBy": "project:chromium",
"createTime": "2021-08-11T20:44:16.961713Z",
"startTime": "2021-08-11T20:46:36.161618Z",
"endTime": "2021-08-12T02:12:20.156504300Z",
"updateTime": "2021-08-12T02:12:20.156914565Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2ae031812be750c7147b0a907fc2721c796e9f77",
"ref": "refs/heads/main"
}
}
}
[02:12:20.679] Invocation finished in 5h28m5.673709237s with status FAILED