[16:04:53.123] New invocation is queued and will start shortly
[16:04:54.326] Starting the invocation (attempt 1)
[16:04:54.358] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9cd26c86784c9693095325c92ea4b864b97ce0b8"
[16:04:54.358] Popped gitiles commit info from properties and tags
[16:04:54.358] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:04:54.358] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:04:54.358] Buildbucket request:
{
"requestId": "9011133236222071056",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9cd26c86784c9693095325c92ea4b864b97ce0b8",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9011133236222071056"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:04:54.849] Scheduled build:
{
"id": "8845703174170490800",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22209,
"createdBy": "project:chromium",
"createTime": "2021-05-31T16:04:54.448383Z",
"updateTime": "2021-05-31T16:04:54.779732Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9cd26c86784c9693095325c92ea4b864b97ce0b8",
"ref": "refs/heads/main"
}
}
}
[16:04:54.849] Task URL: https://cr-buildbucket.appspot.com/build/8845703174170490800
[16:04:54.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:2:0) after 8m40s
[16:07:52.715] Received PubSub notification, asking Buildbucket for the build status
[16:07:52.742] Build status: STARTED
[16:13:34.875] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:2:0)
[16:13:34.901] Build status: STARTED
[16:13:34.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:4:0) after 7m6s
[16:20:40.917] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:4:0)
[16:20:41.018] Build status: STARTED
[16:20:41.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:5:0) after 4m26s
[16:25:07.039] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:5:0)
[16:25:07.065] Build status: STARTED
[16:25:07.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:6:0) after 5m11s
[16:30:18.085] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:6:0)
[16:30:18.113] Build status: STARTED
[16:30:18.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:7:0) after 5m45s
[16:36:03.153] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:7:0)
[16:36:03.183] Build status: STARTED
[16:36:03.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:8:0) after 8m39s
[16:44:42.202] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:8:0)
[16:44:42.231] Build status: STARTED
[16:44:42.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:9:0) after 5m21s
[16:50:03.929] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:9:0)
[16:50:03.960] Build status: STARTED
[16:50:03.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:10:0) after 1m59s
[16:52:03.113] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:10:0)
[16:52:03.157] Build status: STARTED
[16:52:03.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:11:0) after 1m33s
[16:53:36.297] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:11:0)
[16:53:36.324] Build status: STARTED
[16:53:36.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:12:0) after 3m5s
[16:56:41.463] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:12:0)
[16:56:41.494] Build status: STARTED
[16:56:41.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:13:0) after 5m6s
[17:01:47.664] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:13:0)
[17:01:47.692] Build status: STARTED
[17:01:47.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:14:0) after 3m24s
[17:05:12.011] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:14:0)
[17:05:12.038] Build status: STARTED
[17:05:12.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:15:0) after 5m24s
[17:10:36.160] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:15:0)
[17:10:36.188] Build status: STARTED
[17:10:36.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:16:0) after 6m50s
[17:17:26.207] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:16:0)
[17:17:26.246] Build status: STARTED
[17:17:26.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:17:0) after 5m30s
[17:22:56.681] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:17:0)
[17:22:56.730] Build status: STARTED
[17:22:56.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:18:0) after 1m1s
[17:23:57.750] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:18:0)
[17:23:57.779] Build status: STARTED
[17:23:57.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:19:0) after 4m42s
[17:28:39.796] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:19:0)
[17:28:39.827] Build status: STARTED
[17:28:39.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:20:0) after 9m48s
[17:38:27.924] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:20:0)
[17:38:27.959] Build status: STARTED
[17:38:27.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:21:0) after 6m15s
[17:44:43.092] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:21:0)
[17:44:43.116] Build status: STARTED
[17:44:43.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:22:0) after 5m37s
[17:50:20.198] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:22:0)
[17:50:20.229] Build status: STARTED
[17:50:20.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:23:0) after 4m28s
[17:54:48.252] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:23:0)
[17:54:48.280] Build status: STARTED
[17:54:48.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:24:0) after 5m40s
[18:00:28.300] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:24:0)
[18:00:28.354] Build status: STARTED
[18:00:28.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:25:0) after 5m25s
[18:05:53.330] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:25:0)
[18:05:53.396] Build status: STARTED
[18:05:53.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:26:0) after 1m17s
[18:07:10.416] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:26:0)
[18:07:10.461] Build status: STARTED
[18:07:10.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:27:0) after 8m57s
[18:16:07.615] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:27:0)
[18:16:07.656] Build status: STARTED
[18:16:07.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:28:0) after 8m31s
[18:24:38.926] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:28:0)
[18:24:38.963] Build status: STARTED
[18:24:38.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:29:0) after 8m33s
[18:33:12.006] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:29:0)
[18:33:12.035] Build status: STARTED
[18:33:12.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:30:0) after 4m23s
[18:37:35.056] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:30:0)
[18:37:35.097] Build status: STARTED
[18:37:35.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:31:0) after 5m14s
[18:42:49.118] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:31:0)
[18:42:49.150] Build status: STARTED
[18:42:49.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:32:0) after 5m2s
[18:47:51.276] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:32:0)
[18:47:51.306] Build status: STARTED
[18:47:51.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:33:0) after 3m46s
[18:51:37.536] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:33:0)
[18:51:37.565] Build status: STARTED
[18:51:37.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:34:0) after 2m15s
[18:53:52.546] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:34:0)
[18:53:52.573] Build status: STARTED
[18:53:52.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:35:0) after 2m14s
[18:56:06.593] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:35:0)
[18:56:06.629] Build status: STARTED
[18:56:06.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:36:0) after 1m36s
[18:57:42.702] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:36:0)
[18:57:42.732] Build status: STARTED
[18:57:42.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:37:0) after 8m35s
[19:06:17.756] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:37:0)
[19:06:17.809] Build status: STARTED
[19:06:17.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:38:0) after 1m44s
[19:08:01.872] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:38:0)
[19:08:01.898] Build status: STARTED
[19:08:01.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:39:0) after 2m27s
[19:10:28.918] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:39:0)
[19:10:28.961] Build status: STARTED
[19:10:28.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:40:0) after 3m59s
[19:14:28.011] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:40:0)
[19:14:28.038] Build status: STARTED
[19:14:28.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:41:0) after 2m48s
[19:17:16.096] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:41:0)
[19:17:16.139] Build status: STARTED
[19:17:16.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:42:0) after 4m50s
[19:22:06.302] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:42:0)
[19:22:06.338] Build status: STARTED
[19:22:06.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:43:0) after 4m56s
[19:27:02.394] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:43:0)
[19:27:02.423] Build status: STARTED
[19:27:02.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:44:0) after 7m34s
[19:34:36.466] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:44:0)
[19:34:36.497] Build status: STARTED
[19:34:36.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:45:0) after 6m57s
[19:41:33.519] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:45:0)
[19:41:33.550] Build status: STARTED
[19:41:33.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:46:0) after 5m20s
[19:46:53.613] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:46:0)
[19:46:53.648] Build status: STARTED
[19:46:53.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:47:0) after 5m29s
[19:52:22.734] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:47:0)
[19:52:22.767] Build status: STARTED
[19:52:22.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:48:0) after 3m32s
[19:55:54.793] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:48:0)
[19:55:54.824] Build status: STARTED
[19:55:54.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:49:0) after 5m24s
[20:01:18.848] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:49:0)
[20:01:18.881] Build status: STARTED
[20:01:18.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:50:0) after 7m21s
[20:08:40.002] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:50:0)
[20:08:40.059] Build status: STARTED
[20:08:40.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:51:0) after 3m18s
[20:11:58.081] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:51:0)
[20:11:58.112] Build status: STARTED
[20:11:58.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:52:0) after 7m14s
[20:19:12.335] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:52:0)
[20:19:12.424] Build status: STARTED
[20:19:12.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:53:0) after 9m38s
[20:28:50.795] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:53:0)
[20:28:50.819] Build status: STARTED
[20:28:50.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:54:0) after 4m35s
[20:33:26.038] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:54:0)
[20:33:26.067] Build status: STARTED
[20:33:26.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:55:0) after 9m14s
[20:42:40.217] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:55:0)
[20:42:40.248] Build status: STARTED
[20:42:40.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011133236222071056:56:0) after 7m16s
[20:47:16.671] Received PubSub notification, asking Buildbucket for the build status
[20:47:16.704] Build:
{
"id": "8845703174170490800",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22209,
"createdBy": "project:chromium",
"createTime": "2021-05-31T16:04:54.448383Z",
"startTime": "2021-05-31T16:07:52.038293Z",
"endTime": "2021-05-31T20:47:16.177190850Z",
"updateTime": "2021-05-31T20:47:16.177586070Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9cd26c86784c9693095325c92ea4b864b97ce0b8",
"ref": "refs/heads/main"
}
}
}
[20:47:16.704] Invocation finished in 4h42m23.595737802s with status FAILED