[00:04:10.485] New invocation is queued and will start shortly
[00:04:11.689] Starting the invocation (attempt 1)
[00:04:11.717] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/ca2257017201b688d79506954cfe24a66b4d2b3f"
[00:04:11.717] Popped gitiles commit info from properties and tags
[00:04:11.717] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:04:11.717] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:04:11.717] Buildbucket request:
{
"requestId": "8946507444895177808",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ca2257017201b688d79506954cfe24a66b4d2b3f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8946507444895177808"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:04:12.524] Scheduled build:
{
"id": "8781077382869230145",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29401,
"createdBy": "project:chromium",
"createTime": "2023-05-15T00:04:11.789782521Z",
"updateTime": "2023-05-15T00:04:11.789782521Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ca2257017201b688d79506954cfe24a66b4d2b3f",
"ref": "refs/heads/main"
}
}
}
[00:04:12.524] Task URL: https://cr-buildbucket.appspot.com/build/8781077382869230145
[00:04:12.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:2:0) after 2m54s
[00:06:59.517] Received PubSub notification, asking Buildbucket for the build status
[00:06:59.532] Build status: STARTED
[00:07:06.561] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:2:0)
[00:07:06.579] Build status: STARTED
[00:07:06.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:4:0) after 7m21s
[00:14:27.601] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:4:0)
[00:14:27.643] Build status: STARTED
[00:14:27.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:5:0) after 7m43s
[00:22:10.657] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:5:0)
[00:22:10.685] Build status: STARTED
[00:22:10.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:6:0) after 7m48s
[00:29:58.749] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:6:0)
[00:29:58.770] Build status: STARTED
[00:29:58.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:7:0) after 5m49s
[00:35:47.880] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:7:0)
[00:35:47.908] Build status: STARTED
[00:35:47.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:8:0) after 7m46s
[00:43:33.894] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:8:0)
[00:43:33.982] Build status: STARTED
[00:43:33.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:9:0) after 9m40s
[00:53:14.201] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:9:0)
[00:53:14.219] Build status: STARTED
[00:53:14.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:10:0) after 2m46s
[00:56:00.282] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:10:0)
[00:56:00.300] Build status: STARTED
[00:56:00.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:11:0) after 6m26s
[01:02:26.323] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:11:0)
[01:02:26.344] Build status: STARTED
[01:02:26.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:12:0) after 1m7s
[01:03:33.409] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:12:0)
[01:03:33.429] Build status: STARTED
[01:03:33.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:13:0) after 2m44s
[01:06:17.454] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:13:0)
[01:06:17.487] Build status: STARTED
[01:06:17.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:14:0) after 1m41s
[01:07:58.583] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:14:0)
[01:07:58.602] Build status: STARTED
[01:07:58.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:15:0) after 4m23s
[01:12:21.696] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:15:0)
[01:12:21.720] Build status: STARTED
[01:12:21.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:16:0) after 4m52s
[01:17:13.737] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:16:0)
[01:17:13.760] Build status: STARTED
[01:17:13.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:17:0) after 9m18s
[01:26:31.871] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:17:0)
[01:26:31.892] Build status: STARTED
[01:26:31.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:18:0) after 6m36s
[01:33:07.912] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:18:0)
[01:33:08.008] Build status: STARTED
[01:33:08.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:19:0) after 2m24s
[01:35:32.234] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:19:0)
[01:35:32.258] Build status: STARTED
[01:35:32.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:20:0) after 5m44s
[01:41:16.283] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:20:0)
[01:41:16.303] Build status: STARTED
[01:41:16.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:21:0) after 2m39s
[01:43:55.331] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:21:0)
[01:43:55.351] Build status: STARTED
[01:43:55.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:22:0) after 6m25s
[01:50:20.487] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:22:0)
[01:50:20.508] Build status: STARTED
[01:50:20.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:23:0) after 2m55s
[01:53:15.556] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:23:0)
[01:53:15.573] Build status: STARTED
[01:53:15.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:24:0) after 9m35s
[02:02:50.593] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:24:0)
[02:02:50.620] Build status: STARTED
[02:02:50.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:25:0) after 8m33s
[02:11:23.628] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:25:0)
[02:11:23.701] Build status: STARTED
[02:11:23.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:26:0) after 1m56s
[02:13:19.768] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:26:0)
[02:13:19.786] Build status: STARTED
[02:13:19.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:27:0) after 7m8s
[02:20:27.826] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:27:0)
[02:20:27.884] Build status: STARTED
[02:20:27.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:28:0) after 6m30s
[02:26:57.971] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:28:0)
[02:26:58.049] Build status: STARTED
[02:26:58.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:29:0) after 3m30s
[02:30:28.067] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:29:0)
[02:30:28.106] Build status: STARTED
[02:30:28.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:30:0) after 4m22s
[02:34:50.145] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:30:0)
[02:34:50.163] Build status: STARTED
[02:34:50.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:31:0) after 9m34s
[02:44:24.215] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:31:0)
[02:44:24.235] Build status: STARTED
[02:44:24.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:32:0) after 3m8s
[02:47:32.333] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:32:0)
[02:47:32.355] Build status: STARTED
[02:47:32.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:33:0) after 8m22s
[02:55:54.341] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:33:0)
[02:55:54.375] Build status: STARTED
[02:55:54.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:34:0) after 8m38s
[03:04:32.396] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:34:0)
[03:04:32.429] Build status: STARTED
[03:04:32.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:35:0) after 7m19s
[03:11:51.448] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:35:0)
[03:11:51.466] Build status: STARTED
[03:11:51.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:36:0) after 6m50s
[03:18:41.589] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:36:0)
[03:18:41.615] Build status: STARTED
[03:18:41.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:37:0) after 1m18s
[03:19:59.633] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:37:0)
[03:19:59.652] Build status: STARTED
[03:19:59.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:38:0) after 6m36s
[03:26:35.676] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:38:0)
[03:26:35.756] Build status: STARTED
[03:26:35.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:39:0) after 1m15s
[03:27:50.786] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:39:0)
[03:27:50.861] Build status: STARTED
[03:27:50.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:40:0) after 4m36s
[03:32:27.002] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:40:0)
[03:32:27.090] Build status: STARTED
[03:32:27.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:41:0) after 9m33s
[03:42:00.553] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:41:0)
[03:42:00.621] Build status: STARTED
[03:42:00.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:42:0) after 6m4s
[03:48:04.647] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:42:0)
[03:48:04.697] Build status: STARTED
[03:48:04.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:43:0) after 7m52s
[03:55:56.852] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:43:0)
[03:55:56.871] Build status: STARTED
[03:55:56.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:44:0) after 2m29s
[03:58:26.076] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:44:0)
[03:58:26.092] Build status: STARTED
[03:58:26.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:45:0) after 4m51s
[04:03:17.111] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:45:0)
[04:03:17.127] Build status: STARTED
[04:03:17.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:46:0) after 2m4s
[04:05:21.148] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:46:0)
[04:05:21.200] Build status: STARTED
[04:05:21.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:47:0) after 9m27s
[04:14:48.249] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:47:0)
[04:14:48.273] Build status: STARTED
[04:14:48.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:48:0) after 2m14s
[04:17:02.491] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:48:0)
[04:17:02.509] Build status: STARTED
[04:17:02.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:49:0) after 1m50s
[04:18:52.638] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:49:0)
[04:18:52.657] Build status: STARTED
[04:18:52.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:50:0) after 6m26s
[04:25:18.826] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:50:0)
[04:25:18.847] Build status: STARTED
[04:25:18.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:51:0) after 2m43s
[04:28:02.070] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:51:0)
[04:28:02.156] Build status: STARTED
[04:28:02.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:52:0) after 8m3s
[04:36:05.183] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:52:0)
[04:36:05.203] Build status: STARTED
[04:36:05.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:53:0) after 8m33s
[04:44:38.338] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:53:0)
[04:44:38.371] Build status: STARTED
[04:44:38.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:54:0) after 9m19s
[04:53:57.490] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:54:0)
[04:53:57.509] Build status: STARTED
[04:53:57.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:55:0) after 7m22s
[05:01:19.870] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:55:0)
[05:01:19.891] Build status: STARTED
[05:01:19.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:56:0) after 8m14s
[05:09:33.939] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:56:0)
[05:09:33.972] Build status: STARTED
[05:09:33.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:57:0) after 2m55s
[05:12:29.239] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:57:0)
[05:12:29.283] Build status: STARTED
[05:12:29.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:58:0) after 2m32s
[05:15:01.601] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:58:0)
[05:15:01.621] Build status: STARTED
[05:15:01.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:59:0) after 1m30s
[05:16:31.651] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:59:0)
[05:16:31.669] Build status: STARTED
[05:16:31.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:60:0) after 3m28s
[05:19:59.689] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:60:0)
[05:19:59.705] Build status: STARTED
[05:19:59.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946507444895177808:61:0) after 9m28s
[05:25:52.137] Received PubSub notification, asking Buildbucket for the build status
[05:25:52.153] Build:
{
"id": "8781077382869230145",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29401,
"createdBy": "project:chromium",
"createTime": "2023-05-15T00:04:11.789782521Z",
"startTime": "2023-05-15T00:06:59.003925Z",
"endTime": "2023-05-15T05:25:51.894463719Z",
"updateTime": "2023-05-15T05:25:51.894463719Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ca2257017201b688d79506954cfe24a66b4d2b3f",
"ref": "refs/heads/main"
}
}
}
[05:25:52.153] Invocation finished in 5h21m41.679123574s with status FAILED