[11:58:28.227] New invocation is queued and will start shortly
[11:58:29.292] Starting the invocation (attempt 1)
[11:58:29.334] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a16f24bf6e0e86e06648b142054b91261860227f"
[11:58:29.334] Popped gitiles commit info from properties and tags
[11:58:29.334] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:58:29.335] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:58:29.335] Buildbucket request:
{
"requestId": "8886668507467120928",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a16f24bf6e0e86e06648b142054b91261860227f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8886668507467120928"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:58:29.849] Scheduled build:
{
"id": "8721238445580614913",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 37019,
"createdBy": "project:chromium",
"createTime": "2025-03-05T11:58:29.403346433Z",
"updateTime": "2025-03-05T11:58:29.403346433Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a16f24bf6e0e86e06648b142054b91261860227f",
"ref": "refs/heads/main"
}
}
}
[11:58:29.849] Task URL: https://cr-buildbucket.appspot.com/build/8721238445580614913
[11:58:29.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:2:0) after 1m38s
[11:58:30.801] Received PubSub notification, asking Buildbucket for the build status
[11:58:30.831] Build status: SCHEDULED
[11:58:35.057] Received PubSub notification, asking Buildbucket for the build status
[11:58:35.107] Build status: STARTED
[12:00:07.869] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:2:0)
[12:00:07.999] Build status: STARTED
[12:00:08.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:5:0) after 2m47s
[12:02:55.046] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:5:0)
[12:02:55.071] Build status: STARTED
[12:02:55.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:6:0) after 6m0s
[12:08:55.321] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:6:0)
[12:08:55.344] Build status: STARTED
[12:08:55.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:7:0) after 1m46s
[12:10:41.403] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:7:0)
[12:10:41.436] Build status: STARTED
[12:10:41.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:8:0) after 5m6s
[12:15:47.460] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:8:0)
[12:15:47.478] Build status: STARTED
[12:15:47.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:9:0) after 2m21s
[12:18:08.522] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:9:0)
[12:18:08.555] Build status: STARTED
[12:18:08.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:10:0) after 9m36s
[12:27:44.631] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:10:0)
[12:27:44.654] Build status: STARTED
[12:27:44.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:11:0) after 1m37s
[12:29:21.674] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:11:0)
[12:29:21.702] Build status: STARTED
[12:29:21.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:12:0) after 3m25s
[12:32:46.782] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:12:0)
[12:32:46.818] Build status: STARTED
[12:32:46.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:13:0) after 8m39s
[12:41:25.859] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:13:0)
[12:41:25.875] Build status: STARTED
[12:41:25.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:14:0) after 2m58s
[12:44:23.902] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:14:0)
[12:44:23.924] Build status: STARTED
[12:44:23.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:15:0) after 1m42s
[12:46:05.977] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:15:0)
[12:46:06.019] Build status: STARTED
[12:46:06.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:16:0) after 2m19s
[12:48:25.009] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:16:0)
[12:48:25.025] Build status: STARTED
[12:48:25.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:17:0) after 3m10s
[12:51:35.101] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:17:0)
[12:51:35.265] Build status: STARTED
[12:51:35.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:18:0) after 6m17s
[12:57:52.348] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:18:0)
[12:57:52.373] Build status: STARTED
[12:57:52.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:19:0) after 3m11s
[13:01:03.444] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:19:0)
[13:01:03.489] Build status: STARTED
[13:01:03.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:20:0) after 5m24s
[13:06:27.509] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:20:0)
[13:06:27.530] Build status: STARTED
[13:06:27.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:21:0) after 8m12s
[13:14:39.555] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:21:0)
[13:14:39.720] Build status: STARTED
[13:14:39.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:22:0) after 6m29s
[13:21:08.816] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:22:0)
[13:21:08.833] Build status: STARTED
[13:21:08.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:23:0) after 2m40s
[13:23:48.901] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:23:0)
[13:23:48.917] Build status: STARTED
[13:23:48.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:24:0) after 4m17s
[13:28:05.969] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:24:0)
[13:28:06.018] Build status: STARTED
[13:28:06.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:25:0) after 8m19s
[13:36:25.088] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:25:0)
[13:36:25.102] Build status: STARTED
[13:36:25.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:26:0) after 4m59s
[13:41:24.126] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:26:0)
[13:41:24.167] Build status: STARTED
[13:41:24.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:27:0) after 4m55s
[13:46:19.193] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:27:0)
[13:46:19.219] Build status: STARTED
[13:46:19.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:28:0) after 7m47s
[13:54:06.242] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:28:0)
[13:54:06.343] Build status: STARTED
[13:54:06.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:29:0) after 3m30s
[13:57:36.327] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:29:0)
[13:57:36.374] Build status: STARTED
[13:57:36.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:30:0) after 3m18s
[14:00:54.468] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:30:0)
[14:00:54.487] Build status: STARTED
[14:00:54.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:31:0) after 8m11s
[14:09:05.506] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:31:0)
[14:09:05.524] Build status: STARTED
[14:09:05.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:32:0) after 2m56s
[14:12:01.558] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:32:0)
[14:12:01.593] Build status: STARTED
[14:12:01.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:33:0) after 9m52s
[14:21:53.626] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:33:0)
[14:21:53.641] Build status: STARTED
[14:21:53.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:34:0) after 1m27s
[14:23:20.666] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:34:0)
[14:23:20.682] Build status: STARTED
[14:23:20.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:35:0) after 5m48s
[14:29:08.748] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:35:0)
[14:29:08.767] Build status: STARTED
[14:29:08.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:36:0) after 9m2s
[14:38:10.790] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:36:0)
[14:38:10.806] Build status: STARTED
[14:38:10.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:37:0) after 5m51s
[14:44:01.809] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:37:0)
[14:44:01.832] Build status: STARTED
[14:44:01.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:38:0) after 2m6s
[14:46:07.866] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:38:0)
[14:46:07.880] Build status: STARTED
[14:46:07.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:39:0) after 6m49s
[14:52:56.870] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:39:0)
[14:52:56.887] Build status: STARTED
[14:52:56.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:40:0) after 5m20s
[14:58:16.912] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:40:0)
[14:58:16.932] Build status: STARTED
[14:58:16.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:41:0) after 8m56s
[15:07:13.070] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:41:0)
[15:07:13.145] Build status: STARTED
[15:07:13.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:42:0) after 2m49s
[15:10:02.165] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:42:0)
[15:10:02.182] Build status: STARTED
[15:10:02.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:43:0) after 8m18s
[15:18:20.211] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:43:0)
[15:18:20.226] Build status: STARTED
[15:18:20.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:44:0) after 6m16s
[15:24:36.251] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:44:0)
[15:24:36.269] Build status: STARTED
[15:24:36.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:45:0) after 1m28s
[15:26:04.295] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:45:0)
[15:26:04.313] Build status: STARTED
[15:26:04.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:46:0) after 4m16s
[15:30:20.337] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:46:0)
[15:30:20.402] Build status: STARTED
[15:30:20.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:47:0) after 1m45s
[15:32:05.411] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:47:0)
[15:32:05.427] Build status: STARTED
[15:32:05.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:48:0) after 2m29s
[15:34:34.516] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:48:0)
[15:34:34.536] Build status: STARTED
[15:34:34.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:49:0) after 9m15s
[15:43:49.566] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:49:0)
[15:43:49.584] Build status: STARTED
[15:43:49.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:50:0) after 1m1s
[15:44:50.657] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:50:0)
[15:44:50.673] Build status: STARTED
[15:44:50.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:51:0) after 6m33s
[15:51:23.791] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:51:0)
[15:51:23.806] Build status: STARTED
[15:51:23.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:52:0) after 3m0s
[15:54:23.826] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:52:0)
[15:54:23.840] Build status: STARTED
[15:54:23.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:53:0) after 5m26s
[15:59:49.873] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:53:0)
[15:59:49.890] Build status: STARTED
[15:59:49.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:54:0) after 5m13s
[16:05:02.929] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:54:0)
[16:05:02.956] Build status: STARTED
[16:05:02.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:55:0) after 3m44s
[16:08:46.997] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:55:0)
[16:08:47.118] Build status: STARTED
[16:08:47.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8886668507467120928:56:0) after 6m48s
[16:10:00.696] Received PubSub notification, asking Buildbucket for the build status
[16:10:00.723] Build:
{
"id": "8721238445580614913",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 37019,
"createdBy": "project:chromium",
"createTime": "2025-03-05T11:58:29.403346433Z",
"startTime": "2025-03-05T11:58:33.416446487Z",
"endTime": "2025-03-05T16:10:00.029942683Z",
"updateTime": "2025-03-05T16:10:00.029942683Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a16f24bf6e0e86e06648b142054b91261860227f",
"ref": "refs/heads/main"
}
}
}
[16:10:00.723] Invocation finished in 4h11m32.502699022s with status FAILED