[00:38:18.830] New invocation is queued and will start shortly
[00:38:20.356] Starting the invocation (attempt 1)
[00:38:20.417] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/97b13120a32e3a614fdb91908c37790f87b9fb41"
[00:38:20.417] Popped gitiles commit info from properties and tags
[00:38:20.417] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:38:20.417] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:38:20.418] Buildbucket request:
{
"requestId": "8996514822520575664",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "97b13120a32e3a614fdb91908c37790f87b9fb41",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8996514822520575664"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:38:20.956] Scheduled build:
{
"id": "8831084760103955585",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23529,
"createdBy": "project:chromium",
"createTime": "2021-11-09T00:38:20.490509246Z",
"updateTime": "2021-11-09T00:38:20.490509246Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "97b13120a32e3a614fdb91908c37790f87b9fb41",
"ref": "refs/heads/main"
}
},
"canary": true
}
[00:38:20.956] Task URL: https://cr-buildbucket.appspot.com/build/8831084760103955585
[00:38:20.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:2:0) after 1m38s
[00:39:59.533] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:2:0)
[00:39:59.573] Build status: SCHEDULED
[00:39:59.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:3:0) after 3m55s
[00:40:49.924] Received PubSub notification, asking Buildbucket for the build status
[00:40:49.950] Build status: STARTED
[00:43:55.200] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:3:0)
[00:43:55.234] Build status: STARTED
[00:43:55.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:5:0) after 3m26s
[00:47:21.226] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:5:0)
[00:47:21.309] Build status: STARTED
[00:47:21.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:6:0) after 4m33s
[00:51:54.401] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:6:0)
[00:51:54.443] Build status: STARTED
[00:51:54.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:7:0) after 4m33s
[00:56:27.575] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:7:0)
[00:56:27.603] Build status: STARTED
[00:56:27.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:8:0) after 2m34s
[00:59:01.881] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:8:0)
[00:59:01.916] Build status: STARTED
[00:59:01.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:9:0) after 3m13s
[01:02:15.052] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:9:0)
[01:02:15.086] Build status: STARTED
[01:02:15.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:10:0) after 5m53s
[01:08:08.335] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:10:0)
[01:08:08.361] Build status: STARTED
[01:08:08.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:11:0) after 2m27s
[01:10:35.680] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:11:0)
[01:10:35.734] Build status: STARTED
[01:10:35.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:12:0) after 4m50s
[01:15:25.893] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:12:0)
[01:15:25.931] Build status: STARTED
[01:15:25.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:13:0) after 9m42s
[01:25:08.181] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:13:0)
[01:25:08.215] Build status: STARTED
[01:25:08.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:14:0) after 6m1s
[01:31:09.269] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:14:0)
[01:31:09.309] Build status: STARTED
[01:31:09.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:15:0) after 6m52s
[01:38:01.568] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:15:0)
[01:38:01.596] Build status: STARTED
[01:38:01.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:16:0) after 1m13s
[01:39:14.861] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:16:0)
[01:39:14.909] Build status: STARTED
[01:39:14.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:17:0) after 9m0s
[01:48:15.259] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:17:0)
[01:48:15.286] Build status: STARTED
[01:48:15.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:18:0) after 2m35s
[01:50:50.391] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:18:0)
[01:50:50.424] Build status: STARTED
[01:50:50.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:19:0) after 1m15s
[01:52:05.931] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:19:0)
[01:52:05.971] Build status: STARTED
[01:52:05.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:20:0) after 5m14s
[01:57:19.990] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:20:0)
[01:57:20.047] Build status: STARTED
[01:57:20.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:21:0) after 5m10s
[02:02:30.094] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:21:0)
[02:02:30.130] Build status: STARTED
[02:02:30.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:22:0) after 4m44s
[02:07:14.296] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:22:0)
[02:07:14.326] Build status: STARTED
[02:07:14.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:23:0) after 8m15s
[02:15:29.359] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:23:0)
[02:15:29.389] Build status: STARTED
[02:15:29.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:24:0) after 9m40s
[02:25:09.386] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:24:0)
[02:25:09.415] Build status: STARTED
[02:25:09.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:25:0) after 9m53s
[02:35:02.455] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:25:0)
[02:35:02.487] Build status: STARTED
[02:35:02.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:26:0) after 2m2s
[02:37:04.726] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:26:0)
[02:37:04.793] Build status: STARTED
[02:37:04.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:27:0) after 7m35s
[02:44:39.819] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:27:0)
[02:44:39.850] Build status: STARTED
[02:44:39.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:28:0) after 7m33s
[02:52:12.955] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:28:0)
[02:52:13.074] Build status: STARTED
[02:52:13.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:29:0) after 8m24s
[03:00:37.087] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:29:0)
[03:00:37.171] Build status: STARTED
[03:00:37.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:30:0) after 1m25s
[03:02:02.391] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:30:0)
[03:02:02.427] Build status: STARTED
[03:02:02.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:31:0) after 1m53s
[03:03:55.537] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:31:0)
[03:03:55.568] Build status: STARTED
[03:03:55.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:32:0) after 3m50s
[03:07:45.838] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:32:0)
[03:07:45.868] Build status: STARTED
[03:07:45.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:33:0) after 9m7s
[03:16:52.909] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:33:0)
[03:16:52.944] Build status: STARTED
[03:16:52.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:34:0) after 6m58s
[03:23:50.965] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:34:0)
[03:23:50.996] Build status: STARTED
[03:23:50.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:35:0) after 9m49s
[03:33:40.134] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:35:0)
[03:33:40.181] Build status: STARTED
[03:33:40.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:36:0) after 3m32s
[03:37:12.218] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:36:0)
[03:37:12.258] Build status: STARTED
[03:37:12.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:37:0) after 8m23s
[03:45:35.271] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:37:0)
[03:45:35.301] Build status: STARTED
[03:45:35.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:38:0) after 5m3s
[03:50:38.487] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:38:0)
[03:50:38.592] Build status: STARTED
[03:50:38.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:39:0) after 7m14s
[03:57:52.618] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:39:0)
[03:57:52.649] Build status: STARTED
[03:57:52.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:40:0) after 9m47s
[04:07:39.720] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:40:0)
[04:07:39.842] Build status: STARTED
[04:07:39.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:41:0) after 8m27s
[04:16:06.871] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:41:0)
[04:16:06.910] Build status: STARTED
[04:16:06.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:42:0) after 4m18s
[04:20:25.101] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:42:0)
[04:20:25.137] Build status: STARTED
[04:20:25.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:43:0) after 3m3s
[04:23:28.144] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:43:0)
[04:23:28.192] Build status: STARTED
[04:23:28.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:44:0) after 5m0s
[04:28:28.221] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:44:0)
[04:28:28.259] Build status: STARTED
[04:28:28.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:45:0) after 4m19s
[04:32:47.754] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:45:0)
[04:32:47.793] Build status: STARTED
[04:32:47.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:46:0) after 8m45s
[04:41:32.829] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:46:0)
[04:41:32.863] Build status: STARTED
[04:41:32.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:47:0) after 2m1s
[04:43:34.044] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:47:0)
[04:43:34.089] Build status: STARTED
[04:43:34.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:48:0) after 2m47s
[04:46:23.438] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:48:0)
[04:46:23.538] Build status: STARTED
[04:46:23.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:49:0) after 6m1s
[04:52:24.613] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:49:0)
[04:52:24.647] Build status: STARTED
[04:52:24.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:50:0) after 9m52s
[05:02:16.679] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:50:0)
[05:02:16.756] Build status: STARTED
[05:02:16.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:51:0) after 5m19s
[05:07:35.961] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:51:0)
[05:07:35.992] Build status: STARTED
[05:07:35.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:52:0) after 8m13s
[05:15:49.021] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:52:0)
[05:15:49.075] Build status: STARTED
[05:15:49.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:53:0) after 5m47s
[05:21:36.103] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:53:0)
[05:21:36.136] Build status: STARTED
[05:21:36.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:54:0) after 6m35s
[05:28:11.238] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:54:0)
[05:28:11.286] Build status: STARTED
[05:28:11.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:55:0) after 3m20s
[05:31:31.330] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:55:0)
[05:31:31.365] Build status: STARTED
[05:31:31.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:56:0) after 1m16s
[05:32:47.392] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:56:0)
[05:32:47.420] Build status: STARTED
[05:32:47.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:57:0) after 4m47s
[05:37:34.451] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:57:0)
[05:37:34.491] Build status: STARTED
[05:37:34.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:58:0) after 4m14s
[05:41:48.737] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:58:0)
[05:41:48.769] Build status: STARTED
[05:41:48.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:59:0) after 5m30s
[05:47:18.797] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:59:0)
[05:47:18.828] Build status: STARTED
[05:47:18.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:60:0) after 3m25s
[05:50:43.958] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:60:0)
[05:50:43.986] Build status: STARTED
[05:50:43.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:61:0) after 4m26s
[05:55:10.034] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:61:0)
[05:55:10.068] Build status: STARTED
[05:55:10.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8996514822520575664:62:0) after 8m19s
[05:55:16.957] Received PubSub notification, asking Buildbucket for the build status
[05:55:17.004] Build:
{
"id": "8831084760103955585",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23529,
"createdBy": "project:chromium",
"createTime": "2021-11-09T00:38:20.490509246Z",
"startTime": "2021-11-09T00:40:48.068868Z",
"endTime": "2021-11-09T05:55:16.706671954Z",
"updateTime": "2021-11-09T05:55:16.706671954Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "97b13120a32e3a614fdb91908c37790f87b9fb41",
"ref": "refs/heads/main"
}
},
"canary": true
}
[05:55:17.004] Invocation finished in 5h16m58.202731051s with status FAILED