[09:02:02.682] New invocation is queued and will start shortly
[09:02:04.050] Starting the invocation (attempt 1)
[09:02:04.081] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/ee23a3da4d48a4e99b1a7ebdbaecb8c2cced9204"
[09:02:04.081] Popped gitiles commit info from properties and tags
[09:02:04.081] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:02:04.082] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:02:04.082] Buildbucket request:
{
"requestId": "9000650590955278368",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ee23a3da4d48a4e99b1a7ebdbaecb8c2cced9204",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9000650590955278368"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:02:04.630] Scheduled build:
{
"id": "8835220528755358465",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23236,
"createdBy": "project:chromium",
"createTime": "2021-09-24T09:02:04.148121252Z",
"updateTime": "2021-09-24T09:02:04.424782735Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ee23a3da4d48a4e99b1a7ebdbaecb8c2cced9204",
"ref": "refs/heads/main"
}
}
}
[09:02:04.630] Task URL: https://cr-buildbucket.appspot.com/build/8835220528755358465
[09:02:04.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:2:0) after 7m58s
[09:04:33.503] Received PubSub notification, asking Buildbucket for the build status
[09:04:33.568] Build status: STARTED
[09:10:02.618] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:2:0)
[09:10:02.659] Build status: STARTED
[09:10:02.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:4:0) after 4m39s
[09:14:41.692] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:4:0)
[09:14:41.722] Build status: STARTED
[09:14:41.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:5:0) after 4m52s
[09:19:33.743] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:5:0)
[09:19:33.770] Build status: STARTED
[09:19:33.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:6:0) after 2m13s
[09:21:46.903] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:6:0)
[09:21:46.937] Build status: STARTED
[09:21:46.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:7:0) after 1m26s
[09:23:13.182] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:7:0)
[09:23:13.221] Build status: STARTED
[09:23:13.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:8:0) after 5m18s
[09:28:31.312] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:8:0)
[09:28:31.370] Build status: STARTED
[09:28:31.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:9:0) after 2m9s
[09:30:40.525] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:9:0)
[09:30:40.559] Build status: STARTED
[09:30:40.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:10:0) after 5m11s
[09:35:51.583] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:10:0)
[09:35:51.617] Build status: STARTED
[09:35:51.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:11:0) after 4m46s
[09:40:37.682] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:11:0)
[09:40:37.727] Build status: STARTED
[09:40:37.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:12:0) after 6m9s
[09:46:46.751] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:12:0)
[09:46:46.787] Build status: STARTED
[09:46:46.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:13:0) after 9m36s
[09:56:22.866] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:13:0)
[09:56:22.900] Build status: STARTED
[09:56:22.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:14:0) after 7m0s
[10:03:23.072] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:14:0)
[10:03:23.174] Build status: STARTED
[10:03:23.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:15:0) after 3m51s
[10:07:14.292] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:15:0)
[10:07:14.388] Build status: STARTED
[10:07:14.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:16:0) after 4m52s
[10:12:06.485] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:16:0)
[10:12:06.581] Build status: STARTED
[10:12:06.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:17:0) after 9m6s
[10:21:12.800] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:17:0)
[10:21:12.830] Build status: STARTED
[10:21:12.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:18:0) after 4m38s
[10:25:51.047] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:18:0)
[10:25:51.084] Build status: STARTED
[10:25:51.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:19:0) after 2m43s
[10:28:34.104] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:19:0)
[10:28:34.137] Build status: STARTED
[10:28:34.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:20:0) after 3m23s
[10:31:57.162] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:20:0)
[10:31:57.206] Build status: STARTED
[10:31:57.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:21:0) after 2m42s
[10:34:39.282] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:21:0)
[10:34:39.315] Build status: STARTED
[10:34:39.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:22:0) after 4m23s
[10:39:02.333] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:22:0)
[10:39:02.378] Build status: STARTED
[10:39:02.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:23:0) after 5m38s
[10:44:40.478] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:23:0)
[10:44:40.518] Build status: STARTED
[10:44:40.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:24:0) after 5m54s
[10:50:34.661] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:24:0)
[10:50:34.695] Build status: STARTED
[10:50:34.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:25:0) after 6m45s
[10:57:19.829] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:25:0)
[10:57:19.868] Build status: STARTED
[10:57:19.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:26:0) after 7m38s
[11:04:57.924] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:26:0)
[11:04:58.041] Build status: STARTED
[11:04:58.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:27:0) after 6m42s
[11:11:40.170] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:27:0)
[11:11:40.201] Build status: STARTED
[11:11:40.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:28:0) after 9m55s
[11:21:35.322] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:28:0)
[11:21:35.354] Build status: STARTED
[11:21:35.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:29:0) after 1m53s
[11:23:28.378] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:29:0)
[11:23:28.478] Build status: STARTED
[11:23:28.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:30:0) after 9m33s
[11:33:01.493] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:30:0)
[11:33:01.532] Build status: STARTED
[11:33:01.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:31:0) after 6m40s
[11:39:41.579] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:31:0)
[11:39:41.611] Build status: STARTED
[11:39:41.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:32:0) after 3m43s
[11:43:24.631] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:32:0)
[11:43:24.660] Build status: STARTED
[11:43:24.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:33:0) after 6m29s
[11:49:53.679] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:33:0)
[11:49:53.713] Build status: STARTED
[11:49:53.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:34:0) after 5m1s
[11:54:54.802] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:34:0)
[11:54:54.831] Build status: STARTED
[11:54:54.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:35:0) after 1m9s
[11:56:03.881] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:35:0)
[11:56:03.929] Build status: STARTED
[11:56:03.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:36:0) after 5m52s
[12:01:55.953] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:36:0)
[12:01:56.011] Build status: STARTED
[12:01:56.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:37:0) after 4m17s
[12:06:13.052] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:37:0)
[12:06:13.090] Build status: STARTED
[12:06:13.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:38:0) after 6m48s
[12:13:01.123] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:38:0)
[12:13:01.167] Build status: STARTED
[12:13:01.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:39:0) after 2m20s
[12:15:21.189] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:39:0)
[12:15:21.222] Build status: STARTED
[12:15:21.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:40:0) after 8m31s
[12:23:52.342] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:40:0)
[12:23:52.371] Build status: STARTED
[12:23:52.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:41:0) after 5m57s
[12:29:49.498] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:41:0)
[12:29:49.527] Build status: STARTED
[12:29:49.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:42:0) after 2m31s
[12:32:20.672] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:42:0)
[12:32:20.712] Build status: STARTED
[12:32:20.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:43:0) after 6m35s
[12:38:56.026] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:43:0)
[12:38:56.050] Build status: STARTED
[12:38:56.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:44:0) after 7m26s
[12:46:22.264] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:44:0)
[12:46:22.297] Build status: STARTED
[12:46:22.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:45:0) after 1m27s
[12:47:49.422] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:45:0)
[12:47:49.454] Build status: STARTED
[12:47:49.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:46:0) after 2m54s
[12:50:43.474] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:46:0)
[12:50:43.501] Build status: STARTED
[12:50:43.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:47:0) after 3m35s
[12:54:18.530] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:47:0)
[12:54:18.576] Build status: STARTED
[12:54:18.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:48:0) after 8m24s
[13:02:42.738] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:48:0)
[13:02:42.847] Build status: STARTED
[13:02:42.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:49:0) after 4m45s
[13:07:27.867] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:49:0)
[13:07:27.901] Build status: STARTED
[13:07:27.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:50:0) after 6m32s
[13:13:59.919] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:50:0)
[13:13:59.950] Build status: STARTED
[13:13:59.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:51:0) after 7m26s
[13:21:26.011] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:51:0)
[13:21:26.056] Build status: STARTED
[13:21:26.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:52:0) after 6m23s
[13:27:49.097] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:52:0)
[13:27:49.126] Build status: STARTED
[13:27:49.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:53:0) after 5m32s
[13:33:21.148] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:53:0)
[13:33:21.172] Build status: STARTED
[13:33:21.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:54:0) after 8m51s
[13:42:12.306] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:54:0)
[13:42:12.405] Build status: STARTED
[13:42:12.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:55:0) after 3m37s
[13:45:49.430] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:55:0)
[13:45:49.468] Build status: STARTED
[13:45:49.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:56:0) after 5m10s
[13:50:59.493] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:56:0)
[13:50:59.523] Build status: STARTED
[13:50:59.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:57:0) after 9m57s
[14:00:56.544] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:57:0)
[14:00:56.577] Build status: STARTED
[14:00:56.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:58:0) after 7m19s
[14:08:15.601] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:58:0)
[14:08:15.635] Build status: STARTED
[14:08:15.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:59:0) after 6m19s
[14:14:34.664] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:59:0)
[14:14:34.726] Build status: STARTED
[14:14:34.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:60:0) after 6m58s
[14:21:33.031] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:60:0)
[14:21:33.066] Build status: STARTED
[14:21:33.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:61:0) after 1m5s
[14:22:38.200] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:61:0)
[14:22:38.234] Build status: STARTED
[14:22:38.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:62:0) after 3m40s
[14:26:18.270] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:62:0)
[14:26:18.305] Build status: STARTED
[14:26:18.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:63:0) after 9m17s
[14:35:35.367] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:63:0)
[14:35:35.399] Build status: STARTED
[14:35:35.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000650590955278368:64:0) after 8m45s
[14:36:05.120] Received PubSub notification, asking Buildbucket for the build status
[14:36:05.160] Build:
{
"id": "8835220528755358465",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23236,
"createdBy": "project:chromium",
"createTime": "2021-09-24T09:02:04.148121252Z",
"startTime": "2021-09-24T09:04:32.878077Z",
"endTime": "2021-09-24T14:36:04.446932442Z",
"updateTime": "2021-09-24T14:36:04.447275340Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ee23a3da4d48a4e99b1a7ebdbaecb8c2cced9204",
"ref": "refs/heads/main"
}
}
}
[14:36:05.160] Invocation finished in 5h34m2.493220197s with status FAILED