[15:55:20.618] New invocation is queued and will start shortly
[15:55:22.048] Starting the invocation (attempt 1)
[15:55:22.075] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/ce9a3e8fe055bbc1276f6e21564852d0ec046f28"
[15:55:22.075] Popped gitiles commit info from properties and tags
[15:55:22.075] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:55:22.075] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:55:22.075] Buildbucket request:
{
"requestId": "8912111352254194080",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ce9a3e8fe055bbc1276f6e21564852d0ec046f28",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8912111352254194080"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:55:22.904] Scheduled build:
{
"id": "8746681289939188433",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 32739,
"createdBy": "project:chromium",
"createTime": "2024-05-28T15:55:22.201571733Z",
"updateTime": "2024-05-28T15:55:22.201571733Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ce9a3e8fe055bbc1276f6e21564852d0ec046f28",
"ref": "refs/heads/main"
}
}
}
[15:55:22.904] Task URL: https://cr-buildbucket.appspot.com/build/8746681289939188433
[15:55:22.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:2:0) after 8m37s
[15:55:23.780] Received PubSub notification, asking Buildbucket for the build status
[15:55:23.802] Build status: SCHEDULED
[15:56:30.608] Received PubSub notification, asking Buildbucket for the build status
[15:56:30.646] Build status: STARTED
[16:03:59.925] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:2:0)
[16:03:59.945] Build status: STARTED
[16:03:59.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:5:0) after 1m55s
[16:05:55.083] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:5:0)
[16:05:55.105] Build status: STARTED
[16:05:55.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:6:0) after 5m9s
[16:11:04.178] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:6:0)
[16:11:04.200] Build status: STARTED
[16:11:04.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:7:0) after 9m23s
[16:20:27.222] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:7:0)
[16:20:27.253] Build status: STARTED
[16:20:27.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:8:0) after 8m50s
[16:29:17.269] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:8:0)
[16:29:17.337] Build status: STARTED
[16:29:17.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:9:0) after 9m21s
[16:38:38.423] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:9:0)
[16:38:38.444] Build status: STARTED
[16:38:38.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:10:0) after 9m52s
[16:48:31.013] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:10:0)
[16:48:31.038] Build status: STARTED
[16:48:31.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:11:0) after 1m30s
[16:50:01.637] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:11:0)
[16:50:01.663] Build status: STARTED
[16:50:01.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:12:0) after 6m18s
[16:56:19.758] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:12:0)
[16:56:19.775] Build status: STARTED
[16:56:19.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:13:0) after 6m24s
[17:02:43.796] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:13:0)
[17:02:43.838] Build status: STARTED
[17:02:43.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:14:0) after 6m39s
[17:09:22.875] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:14:0)
[17:09:22.892] Build status: STARTED
[17:09:22.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:15:0) after 7m20s
[17:16:42.991] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:15:0)
[17:16:43.011] Build status: STARTED
[17:16:43.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:16:0) after 4m35s
[17:21:18.142] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:16:0)
[17:21:18.170] Build status: STARTED
[17:21:18.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:17:0) after 9m1s
[17:30:19.244] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:17:0)
[17:30:19.272] Build status: STARTED
[17:30:19.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:18:0) after 1m18s
[17:31:37.290] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:18:0)
[17:31:37.318] Build status: STARTED
[17:31:37.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:19:0) after 6m27s
[17:38:04.397] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:19:0)
[17:38:04.414] Build status: STARTED
[17:38:04.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:20:0) after 6m40s
[17:44:44.436] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:20:0)
[17:44:44.456] Build status: STARTED
[17:44:44.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:21:0) after 7m27s
[17:52:11.480] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:21:0)
[17:52:11.514] Build status: STARTED
[17:52:11.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:22:0) after 1m25s
[17:53:36.530] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:22:0)
[17:53:36.551] Build status: STARTED
[17:53:36.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:23:0) after 1m29s
[17:55:05.568] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:23:0)
[17:55:05.594] Build status: STARTED
[17:55:05.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:24:0) after 2m29s
[17:57:34.965] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:24:0)
[17:57:35.038] Build status: STARTED
[17:57:35.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:25:0) after 5m7s
[18:02:42.466] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:25:0)
[18:02:42.486] Build status: STARTED
[18:02:42.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:26:0) after 8m13s
[18:10:55.722] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:26:0)
[18:10:55.740] Build status: STARTED
[18:10:55.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:27:0) after 3m33s
[18:14:28.817] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:27:0)
[18:14:28.849] Build status: STARTED
[18:14:28.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:28:0) after 6m18s
[18:20:47.060] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:28:0)
[18:20:47.085] Build status: STARTED
[18:20:47.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:29:0) after 1m33s
[18:22:20.258] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:29:0)
[18:22:20.275] Build status: STARTED
[18:22:20.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:30:0) after 2m30s
[18:24:50.376] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:30:0)
[18:24:50.399] Build status: STARTED
[18:24:50.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:31:0) after 8m51s
[18:33:41.418] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:31:0)
[18:33:41.438] Build status: STARTED
[18:33:41.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:32:0) after 5m21s
[18:39:02.484] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:32:0)
[18:39:02.548] Build status: STARTED
[18:39:02.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:33:0) after 8m56s
[18:47:58.567] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:33:0)
[18:47:58.591] Build status: STARTED
[18:47:58.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:34:0) after 4m7s
[18:52:05.791] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:34:0)
[18:52:05.815] Build status: STARTED
[18:52:05.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:35:0) after 2m59s
[18:55:04.903] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:35:0)
[18:55:04.925] Build status: STARTED
[18:55:04.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:36:0) after 4m48s
[18:59:53.434] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:36:0)
[18:59:53.450] Build status: STARTED
[18:59:53.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:37:0) after 8m36s
[19:08:29.748] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:37:0)
[19:08:29.774] Build status: STARTED
[19:08:29.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:38:0) after 2m15s
[19:10:44.795] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:38:0)
[19:10:44.814] Build status: STARTED
[19:10:44.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:39:0) after 4m38s
[19:15:22.830] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:39:0)
[19:15:22.851] Build status: STARTED
[19:15:22.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:40:0) after 9m32s
[19:24:55.244] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:40:0)
[19:24:55.259] Build status: STARTED
[19:24:55.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:41:0) after 4m31s
[19:29:26.542] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:41:0)
[19:29:26.562] Build status: STARTED
[19:29:26.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:42:0) after 8m55s
[19:38:21.658] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:42:0)
[19:38:21.684] Build status: STARTED
[19:38:21.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:43:0) after 3m32s
[19:41:53.812] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:43:0)
[19:41:53.826] Build status: STARTED
[19:41:53.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:44:0) after 3m23s
[19:45:17.200] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:44:0)
[19:45:17.230] Build status: STARTED
[19:45:17.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:45:0) after 7m5s
[19:52:22.248] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:45:0)
[19:52:22.262] Build status: STARTED
[19:52:22.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:46:0) after 7m46s
[20:00:08.349] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:46:0)
[20:00:08.367] Build status: STARTED
[20:00:08.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:47:0) after 4m25s
[20:04:34.054] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:47:0)
[20:04:34.078] Build status: STARTED
[20:04:34.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:48:0) after 1m47s
[20:06:21.080] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:48:0)
[20:06:21.103] Build status: STARTED
[20:06:21.103] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:49:0) after 1m56s
[20:08:17.213] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:49:0)
[20:08:17.262] Build status: STARTED
[20:08:17.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:50:0) after 8m54s
[20:17:11.496] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:50:0)
[20:17:11.521] Build status: STARTED
[20:17:11.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:51:0) after 2m24s
[20:19:35.601] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:51:0)
[20:19:35.622] Build status: STARTED
[20:19:35.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:52:0) after 2m25s
[20:22:00.653] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:52:0)
[20:22:00.674] Build status: STARTED
[20:22:00.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:53:0) after 2m3s
[20:24:03.759] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:53:0)
[20:24:03.779] Build status: STARTED
[20:24:03.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:54:0) after 8m24s
[20:32:28.525] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:54:0)
[20:32:28.544] Build status: STARTED
[20:32:28.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:55:0) after 4m2s
[20:36:30.754] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:55:0)
[20:36:30.781] Build status: STARTED
[20:36:30.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:56:0) after 4m16s
[20:40:46.800] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:56:0)
[20:40:46.816] Build status: STARTED
[20:40:46.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:57:0) after 2m6s
[20:42:52.995] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:57:0)
[20:42:53.016] Build status: STARTED
[20:42:53.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:58:0) after 7m9s
[20:50:02.410] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:58:0)
[20:50:02.430] Build status: STARTED
[20:50:02.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:59:0) after 4m25s
[20:54:27.456] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:59:0)
[20:54:27.474] Build status: STARTED
[20:54:27.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:60:0) after 9m5s
[21:03:32.619] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:60:0)
[21:03:32.636] Build status: STARTED
[21:03:32.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:61:0) after 9m11s
[21:12:43.721] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:61:0)
[21:12:43.794] Build status: STARTED
[21:12:43.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:62:0) after 7m1s
[21:19:44.777] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:62:0)
[21:19:44.793] Build status: STARTED
[21:19:44.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:63:0) after 2m16s
[21:22:01.029] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:63:0)
[21:22:01.110] Build status: STARTED
[21:22:01.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:64:0) after 7m14s
[21:29:15.134] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:64:0)
[21:29:15.153] Build status: STARTED
[21:29:15.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8912111352254194080:65:0) after 3m40s
[21:32:01.681] Received PubSub notification, asking Buildbucket for the build status
[21:32:01.701] Build:
{
"id": "8746681289939188433",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 32739,
"createdBy": "project:chromium",
"createTime": "2024-05-28T15:55:22.201571733Z",
"startTime": "2024-05-28T15:56:30.287094094Z",
"endTime": "2024-05-28T21:32:01.379203691Z",
"updateTime": "2024-05-28T21:32:01.379203691Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ce9a3e8fe055bbc1276f6e21564852d0ec046f28",
"ref": "refs/heads/main"
}
}
}
[21:32:01.701] Invocation finished in 5h36m41.091056737s with status FAILED