[11:44:26.656] New invocation is queued and will start shortly
[11:44:27.768] Starting the invocation (attempt 1)
[11:44:27.803] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/48d9faf15a0252e872dc16cb1e3b5a53dae9a798"
[11:44:27.803] Popped gitiles commit info from properties and tags
[11:44:27.803] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:44:27.803] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:44:27.803] Buildbucket request:
{
"requestId": "8999281419165132352",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "48d9faf15a0252e872dc16cb1e3b5a53dae9a798",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8999281419165132352"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:44:28.292] Scheduled build:
{
"id": "8833851357235245809",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23323,
"createdBy": "project:chromium",
"createTime": "2021-10-09T11:44:27.862807872Z",
"updateTime": "2021-10-09T11:44:28.119191217Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "48d9faf15a0252e872dc16cb1e3b5a53dae9a798",
"ref": "refs/heads/main"
}
}
}
[11:44:28.292] Task URL: https://cr-buildbucket.appspot.com/build/8833851357235245809
[11:44:28.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:2:0) after 5m30s
[11:46:47.558] Received PubSub notification, asking Buildbucket for the build status
[11:46:47.585] Build status: STARTED
[11:49:58.512] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:2:0)
[11:49:58.538] Build status: STARTED
[11:49:58.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:4:0) after 2m47s
[11:52:46.047] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:4:0)
[11:52:46.076] Build status: STARTED
[11:52:46.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:5:0) after 5m34s
[11:58:20.093] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:5:0)
[11:58:20.222] Build status: STARTED
[11:58:20.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:6:0) after 2m39s
[12:00:59.529] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:6:0)
[12:00:59.553] Build status: STARTED
[12:00:59.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:7:0) after 7m59s
[12:08:58.652] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:7:0)
[12:08:58.689] Build status: STARTED
[12:08:58.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:8:0) after 7m44s
[12:16:42.707] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:8:0)
[12:16:42.750] Build status: STARTED
[12:16:42.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:9:0) after 4m42s
[12:21:25.146] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:9:0)
[12:21:25.174] Build status: STARTED
[12:21:25.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:10:0) after 7m33s
[12:28:58.398] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:10:0)
[12:28:58.448] Build status: STARTED
[12:28:58.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:11:0) after 9m1s
[12:37:59.470] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:11:0)
[12:37:59.502] Build status: STARTED
[12:37:59.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:12:0) after 5m2s
[12:43:01.559] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:12:0)
[12:43:01.605] Build status: STARTED
[12:43:01.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:13:0) after 6m48s
[12:49:49.597] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:13:0)
[12:49:49.624] Build status: STARTED
[12:49:49.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:14:0) after 4m58s
[12:54:47.643] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:14:0)
[12:54:47.673] Build status: STARTED
[12:54:47.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:15:0) after 5m51s
[13:00:39.093] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:15:0)
[13:00:39.129] Build status: STARTED
[13:00:39.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:16:0) after 5m34s
[13:06:13.126] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:16:0)
[13:06:13.175] Build status: STARTED
[13:06:13.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:17:0) after 2m17s
[13:08:30.495] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:17:0)
[13:08:30.531] Build status: STARTED
[13:08:30.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:18:0) after 1m55s
[13:10:25.757] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:18:0)
[13:10:25.786] Build status: STARTED
[13:10:25.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:19:0) after 6m34s
[13:17:00.096] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:19:0)
[13:17:00.129] Build status: STARTED
[13:17:00.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:20:0) after 3m46s
[13:20:46.599] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:20:0)
[13:20:46.625] Build status: STARTED
[13:20:46.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:21:0) after 2m17s
[13:23:03.875] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:21:0)
[13:23:03.904] Build status: STARTED
[13:23:03.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:22:0) after 5m55s
[13:28:59.073] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:22:0)
[13:28:59.102] Build status: STARTED
[13:28:59.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:23:0) after 6m47s
[13:35:46.998] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:23:0)
[13:35:47.035] Build status: STARTED
[13:35:47.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:24:0) after 8m6s
[13:43:53.164] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:24:0)
[13:43:53.199] Build status: STARTED
[13:43:53.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:25:0) after 4m47s
[13:48:40.215] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:25:0)
[13:48:40.245] Build status: STARTED
[13:48:40.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:26:0) after 6m3s
[13:54:43.370] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:26:0)
[13:54:43.410] Build status: STARTED
[13:54:43.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:27:0) after 6m34s
[14:01:18.388] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:27:0)
[14:01:18.429] Build status: STARTED
[14:01:18.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:28:0) after 5m15s
[14:06:33.458] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:28:0)
[14:06:33.492] Build status: STARTED
[14:06:33.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:29:0) after 5m54s
[14:12:28.224] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:29:0)
[14:12:28.251] Build status: STARTED
[14:12:28.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:30:0) after 4m1s
[14:16:29.695] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:30:0)
[14:16:29.723] Build status: STARTED
[14:16:29.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:31:0) after 5m16s
[14:21:45.753] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:31:0)
[14:21:45.789] Build status: STARTED
[14:21:45.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:32:0) after 2m8s
[14:23:54.041] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:32:0)
[14:23:54.076] Build status: STARTED
[14:23:54.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:33:0) after 5m48s
[14:29:42.226] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:33:0)
[14:29:42.300] Build status: STARTED
[14:29:42.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:34:0) after 5m51s
[14:35:33.429] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:34:0)
[14:35:33.459] Build status: STARTED
[14:35:33.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:35:0) after 8m16s
[14:43:49.492] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:35:0)
[14:43:49.521] Build status: STARTED
[14:43:49.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:36:0) after 5m49s
[14:49:38.770] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:36:0)
[14:49:38.813] Build status: STARTED
[14:49:38.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:37:0) after 5m25s
[14:55:03.840] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:37:0)
[14:55:03.885] Build status: STARTED
[14:55:03.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:38:0) after 4m24s
[14:59:27.908] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:38:0)
[14:59:27.937] Build status: STARTED
[14:59:27.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:39:0) after 4m48s
[15:04:15.958] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:39:0)
[15:04:15.993] Build status: STARTED
[15:04:15.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:40:0) after 6m28s
[15:10:44.017] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:40:0)
[15:10:44.105] Build status: STARTED
[15:10:44.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:41:0) after 4m59s
[15:15:43.351] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:41:0)
[15:15:43.386] Build status: STARTED
[15:15:43.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:42:0) after 4m49s
[15:20:32.407] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:42:0)
[15:20:32.438] Build status: STARTED
[15:20:32.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:43:0) after 2m2s
[15:22:34.456] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:43:0)
[15:22:34.486] Build status: STARTED
[15:22:34.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:44:0) after 8m59s
[15:31:33.517] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:44:0)
[15:31:33.547] Build status: STARTED
[15:31:33.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:45:0) after 3m18s
[15:34:51.567] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:45:0)
[15:34:51.598] Build status: STARTED
[15:34:51.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:46:0) after 1m11s
[15:36:02.982] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:46:0)
[15:36:03.013] Build status: STARTED
[15:36:03.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:47:0) after 2m13s
[15:38:16.533] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:47:0)
[15:38:16.579] Build status: STARTED
[15:38:16.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:48:0) after 7m35s
[15:45:51.809] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:48:0)
[15:45:51.848] Build status: STARTED
[15:45:51.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:49:0) after 4m39s
[15:50:30.943] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:49:0)
[15:50:30.978] Build status: STARTED
[15:50:30.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:50:0) after 9m15s
[15:59:46.317] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:50:0)
[15:59:46.366] Build status: STARTED
[15:59:46.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:51:0) after 9m21s
[16:09:07.388] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:51:0)
[16:09:07.443] Build status: STARTED
[16:09:07.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:52:0) after 3m39s
[16:12:46.459] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:52:0)
[16:12:46.571] Build status: STARTED
[16:12:46.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:53:0) after 4m17s
[16:17:03.592] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:53:0)
[16:17:03.689] Build status: STARTED
[16:17:03.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:54:0) after 2m58s
[16:20:02.165] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:54:0)
[16:20:02.195] Build status: STARTED
[16:20:02.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:55:0) after 4m51s
[16:24:53.486] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:55:0)
[16:24:53.517] Build status: STARTED
[16:24:53.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:56:0) after 5m33s
[16:30:26.654] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:56:0)
[16:30:26.686] Build status: STARTED
[16:30:26.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:57:0) after 8m34s
[16:39:00.713] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:57:0)
[16:39:00.744] Build status: STARTED
[16:39:00.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:58:0) after 2m22s
[16:41:22.860] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:58:0)
[16:41:22.892] Build status: STARTED
[16:41:22.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:59:0) after 6m50s
[16:48:13.017] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:59:0)
[16:48:13.049] Build status: STARTED
[16:48:13.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:60:0) after 5m54s
[16:54:07.511] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:60:0)
[16:54:07.561] Build status: STARTED
[16:54:07.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:61:0) after 7m8s
[17:01:15.890] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:61:0)
[17:01:15.925] Build status: STARTED
[17:01:15.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:62:0) after 4m26s
[17:05:41.944] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:62:0)
[17:05:41.973] Build status: STARTED
[17:05:41.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999281419165132352:63:0) after 8m5s
[17:06:20.563] Received PubSub notification, asking Buildbucket for the build status
[17:06:20.603] Build:
{
"id": "8833851357235245809",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23323,
"createdBy": "project:chromium",
"createTime": "2021-10-09T11:44:27.862807872Z",
"startTime": "2021-10-09T11:46:46.169565Z",
"endTime": "2021-10-09T17:06:19.716989874Z",
"updateTime": "2021-10-09T17:06:19.717278743Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "48d9faf15a0252e872dc16cb1e3b5a53dae9a798",
"ref": "refs/heads/main"
}
}
}
[17:06:20.603] Invocation finished in 5h21m53.965337526s with status FAILED