[20:19:13.361] New invocation is queued and will start shortly
[20:19:14.390] Starting the invocation (attempt 1)
[20:19:14.426] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/1d5891c0781ee1080c5ef80b9b6a58e411215b9c"
[20:19:14.426] Popped gitiles commit info from properties and tags
[20:19:14.426] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:19:14.426] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:19:14.426] Buildbucket request:
{
"requestId": "9009848877176752176",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1d5891c0781ee1080c5ef80b9b6a58e411215b9c",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9009848877176752176"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:19:15.706] Scheduled build:
{
"id": "8844418815255093536",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22333,
"createdBy": "project:chromium",
"createTime": "2021-06-14T20:19:14.559838Z",
"updateTime": "2021-06-14T20:19:15.448986Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1d5891c0781ee1080c5ef80b9b6a58e411215b9c",
"ref": "refs/heads/master"
}
},
"canary": true
}
[20:19:15.706] Task URL: https://cr-buildbucket.appspot.com/build/8844418815255093536
[20:19:15.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:2:0) after 5m22s
[20:24:37.833] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:2:0)
[20:24:37.933] Build status: STARTED
[20:24:37.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:3:0) after 4m26s
[20:24:38.891] Received PubSub notification, asking Buildbucket for the build status
[20:24:38.921] Build status: STARTED
[20:29:04.176] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:3:0)
[20:29:04.216] Build status: STARTED
[20:29:04.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:5:0) after 2m20s
[20:31:24.501] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:5:0)
[20:31:24.553] Build status: STARTED
[20:31:24.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:6:0) after 9m13s
[20:40:37.937] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:6:0)
[20:40:37.986] Build status: STARTED
[20:40:37.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:7:0) after 3m27s
[20:44:05.011] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:7:0)
[20:44:05.071] Build status: STARTED
[20:44:05.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:8:0) after 3m28s
[20:47:33.215] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:8:0)
[20:47:33.412] Build status: STARTED
[20:47:33.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:9:0) after 7m51s
[20:55:24.409] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:9:0)
[20:55:24.471] Build status: STARTED
[20:55:24.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:10:0) after 9m16s
[21:04:40.680] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:10:0)
[21:04:40.726] Build status: STARTED
[21:04:40.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:11:0) after 4m30s
[21:09:10.885] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:11:0)
[21:09:10.982] Build status: STARTED
[21:09:10.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:12:0) after 8m53s
[21:18:04.636] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:12:0)
[21:18:04.741] Build status: STARTED
[21:18:04.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:13:0) after 7m56s
[21:26:00.850] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:13:0)
[21:26:00.896] Build status: STARTED
[21:26:00.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:14:0) after 8m45s
[21:34:46.034] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:14:0)
[21:34:46.065] Build status: STARTED
[21:34:46.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:15:0) after 6m45s
[21:41:31.532] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:15:0)
[21:41:31.596] Build status: STARTED
[21:41:31.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:16:0) after 9m17s
[21:50:48.710] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:16:0)
[21:50:48.793] Build status: STARTED
[21:50:48.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:17:0) after 4m35s
[21:55:23.842] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:17:0)
[21:55:24.121] Build status: STARTED
[21:55:24.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:18:0) after 2m14s
[21:57:38.134] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:18:0)
[21:57:38.189] Build status: STARTED
[21:57:38.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:19:0) after 4m16s
[22:01:54.225] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:19:0)
[22:01:54.270] Build status: STARTED
[22:01:54.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:20:0) after 3m46s
[22:05:40.480] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:20:0)
[22:05:40.519] Build status: STARTED
[22:05:40.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:21:0) after 7m25s
[22:13:05.649] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:21:0)
[22:13:05.787] Build status: STARTED
[22:13:05.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:22:0) after 6m54s
[22:20:00.000] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:22:0)
[22:20:00.044] Build status: STARTED
[22:20:00.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:23:0) after 7m4s
[22:27:04.101] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:23:0)
[22:27:04.131] Build status: STARTED
[22:27:04.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:24:0) after 3m50s
[22:30:54.185] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:24:0)
[22:30:54.217] Build status: STARTED
[22:30:54.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:25:0) after 4m46s
[22:35:40.377] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:25:0)
[22:35:40.405] Build status: STARTED
[22:35:40.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:26:0) after 6m7s
[22:41:47.494] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:26:0)
[22:41:47.542] Build status: STARTED
[22:41:47.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:27:0) after 9m49s
[22:51:36.565] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:27:0)
[22:51:36.755] Build status: STARTED
[22:51:36.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:28:0) after 7m54s
[22:59:30.821] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:28:0)
[22:59:30.854] Build status: STARTED
[22:59:30.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:29:0) after 3m42s
[23:03:12.876] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:29:0)
[23:03:12.905] Build status: STARTED
[23:03:12.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:30:0) after 1m43s
[23:04:56.082] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:30:0)
[23:04:56.303] Build status: STARTED
[23:04:56.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:31:0) after 2m32s
[23:07:28.582] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:31:0)
[23:07:28.615] Build status: STARTED
[23:07:28.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:32:0) after 3m15s
[23:10:43.924] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:32:0)
[23:10:43.959] Build status: STARTED
[23:10:43.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:33:0) after 1m35s
[23:12:19.135] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:33:0)
[23:12:19.173] Build status: STARTED
[23:12:19.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:34:0) after 5m47s
[23:18:06.718] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:34:0)
[23:18:06.744] Build status: STARTED
[23:18:06.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:35:0) after 1m13s
[23:19:19.802] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:35:0)
[23:19:19.827] Build status: STARTED
[23:19:19.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:36:0) after 7m27s
[23:26:47.028] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:36:0)
[23:26:47.053] Build status: STARTED
[23:26:47.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:37:0) after 5m57s
[23:32:44.255] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:37:0)
[23:32:44.284] Build status: STARTED
[23:32:44.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:38:0) after 6m59s
[23:39:43.529] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:38:0)
[23:39:43.556] Build status: STARTED
[23:39:43.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:39:0) after 7m49s
[23:47:32.587] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:39:0)
[23:47:32.709] Build status: STARTED
[23:47:32.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:40:0) after 8m1s
[23:55:33.815] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:40:0)
[23:55:33.843] Build status: STARTED
[23:55:33.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:41:0) after 9m22s
[00:04:55.974] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:41:0)
[00:04:56.009] Build status: STARTED
[00:04:56.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:42:0) after 2m56s
[00:07:51.999] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:42:0)
[00:07:52.042] Build status: STARTED
[00:07:52.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:43:0) after 8m20s
[00:16:12.520] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:43:0)
[00:16:12.573] Build status: STARTED
[00:16:12.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:44:0) after 2m59s
[00:19:11.746] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:44:0)
[00:19:11.782] Build status: STARTED
[00:19:11.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:45:0) after 6m19s
[00:25:30.984] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:45:0)
[00:25:31.017] Build status: STARTED
[00:25:31.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:46:0) after 1m32s
[00:27:03.092] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:46:0)
[00:27:03.119] Build status: STARTED
[00:27:03.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:47:0) after 3m5s
[00:30:08.197] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:47:0)
[00:30:08.227] Build status: STARTED
[00:30:08.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:48:0) after 9m5s
[00:39:13.498] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:48:0)
[00:39:13.525] Build status: STARTED
[00:39:13.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:49:0) after 2m38s
[00:41:51.655] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:49:0)
[00:41:51.806] Build status: STARTED
[00:41:51.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:50:0) after 6m41s
[00:48:32.915] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:50:0)
[00:48:32.948] Build status: STARTED
[00:48:32.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:51:0) after 4m57s
[00:53:29.946] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:51:0)
[00:53:29.975] Build status: STARTED
[00:53:29.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:52:0) after 3m3s
[00:56:33.222] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:52:0)
[00:56:33.255] Build status: STARTED
[00:56:33.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:53:0) after 4m25s
[01:00:58.294] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:53:0)
[01:00:58.324] Build status: STARTED
[01:00:58.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:54:0) after 8m39s
[01:09:37.406] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:54:0)
[01:09:37.437] Build status: STARTED
[01:09:37.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:55:0) after 1m54s
[01:11:31.549] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:55:0)
[01:11:31.670] Build status: STARTED
[01:11:31.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:56:0) after 3m13s
[01:14:45.176] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:56:0)
[01:14:45.314] Build status: STARTED
[01:14:45.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9009848877176752176:57:0) after 9m31s
[01:19:35.688] Received PubSub notification, asking Buildbucket for the build status
[01:19:35.752] Build:
{
"id": "8844418815255093536",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22333,
"createdBy": "project:chromium",
"createTime": "2021-06-14T20:19:14.559838Z",
"startTime": "2021-06-14T20:21:19.409282Z",
"endTime": "2021-06-15T01:19:35.374353350Z",
"updateTime": "2021-06-15T01:19:35.374866483Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1d5891c0781ee1080c5ef80b9b6a58e411215b9c",
"ref": "refs/heads/master"
}
},
"canary": true
}
[01:19:35.752] Invocation finished in 5h0m22.409283336s with status FAILED