[15:22:16.436] New invocation is queued and will start shortly
[15:22:17.557] Starting the invocation (attempt 1)
[15:22:17.585] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/7d24216f1f041500318cf01c6f3d7a930c0c3bb1"
[15:22:17.585] Popped gitiles commit info from properties and tags
[15:22:17.585] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:22:17.585] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:22:17.586] Buildbucket request:
{
"requestId": "8949167592075159376",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7d24216f1f041500318cf01c6f3d7a930c0c3bb1",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8949167592075159376"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:22:17.966] Scheduled build:
{
"id": "8783737530161146049",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29252,
"createdBy": "project:chromium",
"createTime": "2023-04-15T15:22:17.639763343Z",
"updateTime": "2023-04-15T15:22:17.639763343Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7d24216f1f041500318cf01c6f3d7a930c0c3bb1",
"ref": "refs/heads/main"
}
}
}
[15:22:17.966] Task URL: https://cr-buildbucket.appspot.com/build/8783737530161146049
[15:22:17.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:2:0) after 4m50s
[15:24:59.854] Received PubSub notification, asking Buildbucket for the build status
[15:24:59.874] Build status: STARTED
[15:27:08.085] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:2:0)
[15:27:08.128] Build status: STARTED
[15:27:08.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:4:0) after 6m55s
[15:34:03.264] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:4:0)
[15:34:03.291] Build status: STARTED
[15:34:03.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:5:0) after 1m58s
[15:36:01.313] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:5:0)
[15:36:01.334] Build status: STARTED
[15:36:01.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:6:0) after 6m52s
[15:42:53.351] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:6:0)
[15:42:53.405] Build status: STARTED
[15:42:53.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:7:0) after 1m17s
[15:44:10.663] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:7:0)
[15:44:10.694] Build status: STARTED
[15:44:10.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:8:0) after 9m13s
[15:53:23.944] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:8:0)
[15:53:23.973] Build status: STARTED
[15:53:23.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:9:0) after 7m7s
[16:00:31.032] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:9:0)
[16:00:31.054] Build status: STARTED
[16:00:31.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:10:0) after 3m30s
[16:04:01.339] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:10:0)
[16:04:01.367] Build status: STARTED
[16:04:01.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:11:0) after 5m47s
[16:09:48.422] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:11:0)
[16:09:48.446] Build status: STARTED
[16:09:48.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:12:0) after 2m16s
[16:12:04.464] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:12:0)
[16:12:04.484] Build status: STARTED
[16:12:04.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:13:0) after 6m48s
[16:18:52.546] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:13:0)
[16:18:52.569] Build status: STARTED
[16:18:52.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:14:0) after 3m52s
[16:22:44.590] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:14:0)
[16:22:44.619] Build status: STARTED
[16:22:44.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:15:0) after 8m4s
[16:30:49.158] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:15:0)
[16:30:49.175] Build status: STARTED
[16:30:49.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:16:0) after 3m8s
[16:33:57.230] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:16:0)
[16:33:57.249] Build status: STARTED
[16:33:57.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:17:0) after 5m37s
[16:39:34.390] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:17:0)
[16:39:34.407] Build status: STARTED
[16:39:34.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:18:0) after 6m19s
[16:45:53.428] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:18:0)
[16:45:53.446] Build status: STARTED
[16:45:53.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:19:0) after 6m32s
[16:52:25.463] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:19:0)
[16:52:25.485] Build status: STARTED
[16:52:25.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:20:0) after 7m28s
[16:59:53.556] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:20:0)
[16:59:53.576] Build status: STARTED
[16:59:53.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:21:0) after 6m23s
[17:06:16.727] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:21:0)
[17:06:16.746] Build status: STARTED
[17:06:16.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:22:0) after 2m57s
[17:09:13.767] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:22:0)
[17:09:13.792] Build status: STARTED
[17:09:13.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:23:0) after 8m24s
[17:17:37.811] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:23:0)
[17:17:37.837] Build status: STARTED
[17:17:37.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:24:0) after 7m19s
[17:24:56.878] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:24:0)
[17:24:56.901] Build status: STARTED
[17:24:56.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:25:0) after 1m6s
[17:26:02.928] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:25:0)
[17:26:02.949] Build status: STARTED
[17:26:02.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:26:0) after 2m33s
[17:28:35.967] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:26:0)
[17:28:35.986] Build status: STARTED
[17:28:35.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:27:0) after 4m11s
[17:32:47.009] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:27:0)
[17:32:47.037] Build status: STARTED
[17:32:47.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:28:0) after 1m33s
[17:34:20.060] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:28:0)
[17:34:20.081] Build status: STARTED
[17:34:20.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:29:0) after 2m10s
[17:36:30.110] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:29:0)
[17:36:30.129] Build status: STARTED
[17:36:30.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:30:0) after 5m44s
[17:42:14.128] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:30:0)
[17:42:14.148] Build status: STARTED
[17:42:14.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:31:0) after 1m4s
[17:43:18.165] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:31:0)
[17:43:18.191] Build status: STARTED
[17:43:18.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:32:0) after 7m27s
[17:50:45.210] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:32:0)
[17:50:45.226] Build status: STARTED
[17:50:45.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:33:0) after 4m40s
[17:55:25.246] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:33:0)
[17:55:25.269] Build status: STARTED
[17:55:25.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:34:0) after 6m12s
[18:01:37.285] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:34:0)
[18:01:37.305] Build status: STARTED
[18:01:37.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:35:0) after 5m30s
[18:07:07.330] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:35:0)
[18:07:07.348] Build status: STARTED
[18:07:07.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:36:0) after 2m40s
[18:09:47.367] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:36:0)
[18:09:47.386] Build status: STARTED
[18:09:47.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:37:0) after 6m9s
[18:15:56.771] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:37:0)
[18:15:56.792] Build status: STARTED
[18:15:56.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:38:0) after 3m26s
[18:19:22.893] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:38:0)
[18:19:22.914] Build status: STARTED
[18:19:22.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:39:0) after 3m10s
[18:22:33.006] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:39:0)
[18:22:33.033] Build status: STARTED
[18:22:33.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:40:0) after 6m58s
[18:29:31.050] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:40:0)
[18:29:31.071] Build status: STARTED
[18:29:31.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:41:0) after 8m41s
[18:38:12.187] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:41:0)
[18:38:12.206] Build status: STARTED
[18:38:12.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:42:0) after 6m58s
[18:45:10.231] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:42:0)
[18:45:10.249] Build status: STARTED
[18:45:10.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:43:0) after 8m48s
[18:53:58.497] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:43:0)
[18:53:58.515] Build status: STARTED
[18:53:58.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:44:0) after 8m29s
[19:02:27.532] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:44:0)
[19:02:27.555] Build status: STARTED
[19:02:27.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:45:0) after 2m43s
[19:05:10.574] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:45:0)
[19:05:10.597] Build status: STARTED
[19:05:10.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:46:0) after 1m39s
[19:06:49.614] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:46:0)
[19:06:49.657] Build status: STARTED
[19:06:49.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:47:0) after 6m32s
[19:13:21.688] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:47:0)
[19:13:21.711] Build status: STARTED
[19:13:21.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:48:0) after 7m41s
[19:21:02.726] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:48:0)
[19:21:02.749] Build status: STARTED
[19:21:02.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:49:0) after 6m32s
[19:27:34.773] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:49:0)
[19:27:34.796] Build status: STARTED
[19:27:34.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:50:0) after 3m6s
[19:30:40.812] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:50:0)
[19:30:40.834] Build status: STARTED
[19:30:40.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:51:0) after 1m39s
[19:32:19.849] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:51:0)
[19:32:19.867] Build status: STARTED
[19:32:19.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:52:0) after 9m57s
[19:42:17.289] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:52:0)
[19:42:17.309] Build status: STARTED
[19:42:17.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:53:0) after 4m35s
[19:46:52.435] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:53:0)
[19:46:52.456] Build status: STARTED
[19:46:52.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:54:0) after 7m34s
[19:54:26.874] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:54:0)
[19:54:26.893] Build status: STARTED
[19:54:26.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:55:0) after 4m48s
[19:59:14.916] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:55:0)
[19:59:15.079] Build status: STARTED
[19:59:15.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:56:0) after 2m40s
[20:01:55.099] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:56:0)
[20:01:55.130] Build status: STARTED
[20:01:55.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:57:0) after 6m13s
[20:08:08.127] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:57:0)
[20:08:08.148] Build status: STARTED
[20:08:08.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:58:0) after 6m52s
[20:15:00.210] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:58:0)
[20:15:00.229] Build status: STARTED
[20:15:00.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:59:0) after 8m11s
[20:23:11.250] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:59:0)
[20:23:11.310] Build status: STARTED
[20:23:11.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:60:0) after 7m31s
[20:30:42.339] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:60:0)
[20:30:42.357] Build status: STARTED
[20:30:42.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8949167592075159376:61:0) after 6m24s
[20:33:06.930] Received PubSub notification, asking Buildbucket for the build status
[20:33:06.953] Build:
{
"id": "8783737530161146049",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29252,
"createdBy": "project:chromium",
"createTime": "2023-04-15T15:22:17.639763343Z",
"startTime": "2023-04-15T15:24:58.885168Z",
"endTime": "2023-04-15T20:33:06.510399718Z",
"updateTime": "2023-04-15T20:33:06.510399718Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7d24216f1f041500318cf01c6f3d7a930c0c3bb1",
"ref": "refs/heads/main"
}
}
}
[20:33:06.953] Invocation finished in 5h10m50.52289827s with status FAILED