[22:09:49.138] New invocation is queued and will start shortly
[22:09:50.534] Starting the invocation (attempt 1)
[22:09:50.577] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0c7942d08e1182eea49a70fe51791350ada4fdb4"
[22:09:50.577] Popped gitiles commit info from properties and tags
[22:09:50.577] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:09:50.577] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:09:50.577] Buildbucket request:
{
"requestId": "9007124010064296544",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0c7942d08e1182eea49a70fe51791350ada4fdb4",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9007124010064296544"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:09:51.300] Scheduled build:
{
"id": "8841693947766737984",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22535,
"createdBy": "project:chromium",
"createTime": "2021-07-14T22:09:50.698460Z",
"updateTime": "2021-07-14T22:09:51.162129Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0c7942d08e1182eea49a70fe51791350ada4fdb4",
"ref": "refs/heads/main"
}
},
"canary": true
}
[22:09:51.300] Task URL: https://cr-buildbucket.appspot.com/build/8841693947766737984
[22:09:51.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:2:0) after 8m38s
[22:12:52.994] Received PubSub notification, asking Buildbucket for the build status
[22:12:53.024] Build status: STARTED
[22:18:29.538] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:2:0)
[22:18:29.573] Build status: STARTED
[22:18:29.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:4:0) after 1m39s
[22:20:08.593] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:4:0)
[22:20:08.790] Build status: STARTED
[22:20:08.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:5:0) after 1m39s
[22:21:48.069] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:5:0)
[22:21:48.107] Build status: STARTED
[22:21:48.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:6:0) after 9m56s
[22:31:44.227] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:6:0)
[22:31:44.257] Build status: STARTED
[22:31:44.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:7:0) after 6m59s
[22:38:43.327] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:7:0)
[22:38:43.358] Build status: STARTED
[22:38:43.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:8:0) after 1m42s
[22:40:26.199] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:8:0)
[22:40:26.258] Build status: STARTED
[22:40:26.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:9:0) after 5m31s
[22:45:57.580] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:9:0)
[22:45:57.610] Build status: STARTED
[22:45:57.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:10:0) after 7m52s
[22:53:49.630] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:10:0)
[22:53:49.662] Build status: STARTED
[22:53:49.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:11:0) after 6m55s
[23:00:44.707] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:11:0)
[23:00:44.756] Build status: STARTED
[23:00:44.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:12:0) after 1m38s
[23:02:22.892] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:12:0)
[23:02:22.925] Build status: STARTED
[23:02:22.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:13:0) after 4m33s
[23:06:56.050] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:13:0)
[23:06:56.080] Build status: STARTED
[23:06:56.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:14:0) after 7m54s
[23:14:50.199] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:14:0)
[23:14:50.227] Build status: STARTED
[23:14:50.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:15:0) after 1m9s
[23:15:59.280] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:15:0)
[23:15:59.318] Build status: STARTED
[23:15:59.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:16:0) after 5m48s
[23:21:47.367] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:16:0)
[23:21:47.413] Build status: STARTED
[23:21:47.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:17:0) after 4m56s
[23:26:43.884] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:17:0)
[23:26:43.915] Build status: STARTED
[23:26:43.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:18:0) after 8m37s
[23:35:21.214] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:18:0)
[23:35:21.255] Build status: STARTED
[23:35:21.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:19:0) after 3m39s
[23:39:00.281] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:19:0)
[23:39:00.358] Build status: STARTED
[23:39:00.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:20:0) after 9m44s
[23:48:44.637] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:20:0)
[23:48:44.706] Build status: STARTED
[23:48:44.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:21:0) after 4m59s
[23:53:44.236] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:21:0)
[23:53:44.271] Build status: STARTED
[23:53:44.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:22:0) after 9m19s
[00:03:03.346] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:22:0)
[00:03:03.377] Build status: STARTED
[00:03:03.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:23:0) after 4m56s
[00:07:59.510] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:23:0)
[00:07:59.542] Build status: STARTED
[00:07:59.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:24:0) after 3m24s
[00:11:23.666] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:24:0)
[00:11:23.704] Build status: STARTED
[00:11:23.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:25:0) after 5m51s
[00:17:14.900] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:25:0)
[00:17:14.934] Build status: STARTED
[00:17:14.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:26:0) after 3m38s
[00:20:52.977] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:26:0)
[00:20:53.005] Build status: STARTED
[00:20:53.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:27:0) after 9m3s
[00:29:56.037] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:27:0)
[00:29:56.071] Build status: STARTED
[00:29:56.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:28:0) after 1m35s
[00:31:31.196] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:28:0)
[00:31:31.231] Build status: STARTED
[00:31:31.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:29:0) after 2m29s
[00:34:01.202] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:29:0)
[00:34:01.232] Build status: STARTED
[00:34:01.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:30:0) after 7m54s
[00:41:55.262] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:30:0)
[00:41:55.293] Build status: STARTED
[00:41:55.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:31:0) after 5m23s
[00:47:18.282] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:31:0)
[00:47:18.318] Build status: STARTED
[00:47:18.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:32:0) after 2m10s
[00:49:28.346] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:32:0)
[00:49:28.382] Build status: STARTED
[00:49:28.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:33:0) after 4m28s
[00:53:56.422] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:33:0)
[00:53:56.470] Build status: STARTED
[00:53:56.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:34:0) after 8m9s
[01:02:05.587] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:34:0)
[01:02:05.650] Build status: STARTED
[01:02:05.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:35:0) after 8m9s
[01:10:14.785] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:35:0)
[01:10:14.819] Build status: STARTED
[01:10:14.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:36:0) after 9m41s
[01:19:55.846] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:36:0)
[01:19:55.875] Build status: STARTED
[01:19:55.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:37:0) after 4m50s
[01:24:45.901] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:37:0)
[01:24:45.931] Build status: STARTED
[01:24:45.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:38:0) after 4m31s
[01:29:16.957] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:38:0)
[01:29:16.999] Build status: STARTED
[01:29:16.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:39:0) after 1m40s
[01:30:57.083] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:39:0)
[01:30:57.169] Build status: STARTED
[01:30:57.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:40:0) after 3m59s
[01:34:56.330] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:40:0)
[01:34:56.478] Build status: STARTED
[01:34:56.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:41:0) after 2m56s
[01:37:52.514] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:41:0)
[01:37:52.546] Build status: STARTED
[01:37:52.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:42:0) after 5m0s
[01:42:52.573] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:42:0)
[01:42:52.605] Build status: STARTED
[01:42:52.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:43:0) after 2m18s
[01:45:10.885] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:43:0)
[01:45:10.926] Build status: STARTED
[01:45:10.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:44:0) after 6m44s
[01:51:55.255] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:44:0)
[01:51:56.047] Build status: STARTED
[01:51:56.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:45:0) after 9m8s
[02:01:04.208] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:45:0)
[02:01:04.258] Build status: STARTED
[02:01:04.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:46:0) after 5m8s
[02:06:12.486] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:46:0)
[02:06:12.516] Build status: STARTED
[02:06:12.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:47:0) after 8m54s
[02:15:06.558] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:47:0)
[02:15:06.599] Build status: STARTED
[02:15:06.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:48:0) after 4m4s
[02:19:10.658] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:48:0)
[02:19:10.690] Build status: STARTED
[02:19:10.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:49:0) after 3m33s
[02:22:43.756] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:49:0)
[02:22:43.784] Build status: STARTED
[02:22:43.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:50:0) after 8m1s
[02:30:45.203] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:50:0)
[02:30:45.237] Build status: STARTED
[02:30:45.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:51:0) after 3m11s
[02:33:56.255] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:51:0)
[02:33:56.287] Build status: STARTED
[02:33:56.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:52:0) after 4m45s
[02:38:41.716] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:52:0)
[02:38:41.750] Build status: STARTED
[02:38:41.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:53:0) after 9m18s
[02:47:59.838] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:53:0)
[02:47:59.875] Build status: STARTED
[02:47:59.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:54:0) after 7m5s
[02:55:04.921] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:54:0)
[02:55:06.850] Build status: STARTED
[02:55:06.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:55:0) after 8m55s
[03:04:01.964] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:55:0)
[03:04:01.998] Build status: STARTED
[03:04:01.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:56:0) after 1m54s
[03:05:56.112] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:56:0)
[03:05:56.146] Build status: STARTED
[03:05:56.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:57:0) after 5m9s
[03:11:05.246] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:57:0)
[03:11:05.279] Build status: STARTED
[03:11:05.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:58:0) after 4m39s
[03:15:44.569] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:58:0)
[03:15:44.618] Build status: STARTED
[03:15:44.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007124010064296544:59:0) after 5m14s
[03:17:57.258] Received PubSub notification, asking Buildbucket for the build status
[03:17:57.289] Build:
{
"id": "8841693947766737984",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22535,
"createdBy": "project:chromium",
"createTime": "2021-07-14T22:09:50.698460Z",
"startTime": "2021-07-14T22:12:52.301405Z",
"endTime": "2021-07-15T03:17:56.897871425Z",
"updateTime": "2021-07-15T03:17:56.898377880Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0c7942d08e1182eea49a70fe51791350ada4fdb4",
"ref": "refs/heads/main"
}
},
"canary": true
}
[03:17:57.289] Invocation finished in 5h8m8.166001401s with status FAILED