[06:16:08.317] New invocation is queued and will start shortly
[06:16:09.455] Starting the invocation (attempt 1)
[06:16:09.488] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3d052955f2021b1acb10c5a176966ab9c47da197"
[06:16:09.488] Popped gitiles commit info from properties and tags
[06:16:09.488] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[06:16:09.488] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[06:16:09.488] Buildbucket request:
{
"requestId": "8953550606353773328",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3d052955f2021b1acb10c5a176966ab9c47da197",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8953550606353773328"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[06:16:09.977] Scheduled build:
{
"id": "8788120544297471169",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 28998,
"createdBy": "project:chromium",
"createTime": "2023-02-26T06:16:09.629708984Z",
"updateTime": "2023-02-26T06:16:09.629708984Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3d052955f2021b1acb10c5a176966ab9c47da197",
"ref": "refs/heads/main"
}
}
}
[06:16:09.977] Task URL: https://cr-buildbucket.appspot.com/build/8788120544297471169
[06:16:09.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:2:0) after 1m12s
[06:17:21.994] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:2:0)
[06:17:22.035] Build status: SCHEDULED
[06:17:22.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:3:0) after 3m4s
[06:18:37.135] Received PubSub notification, asking Buildbucket for the build status
[06:18:37.160] Build status: STARTED
[06:20:26.037] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:3:0)
[06:20:26.073] Build status: STARTED
[06:20:26.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:5:0) after 4m20s
[06:24:46.162] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:5:0)
[06:24:46.185] Build status: STARTED
[06:24:46.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:6:0) after 2m46s
[06:27:32.201] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:6:0)
[06:27:32.221] Build status: STARTED
[06:27:32.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:7:0) after 5m48s
[06:33:20.505] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:7:0)
[06:33:20.526] Build status: STARTED
[06:33:20.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:8:0) after 8m11s
[06:41:31.542] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:8:0)
[06:41:31.573] Build status: STARTED
[06:41:31.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:9:0) after 1m54s
[06:43:25.598] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:9:0)
[06:43:25.641] Build status: STARTED
[06:43:25.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:10:0) after 4m55s
[06:48:20.655] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:10:0)
[06:48:20.686] Build status: STARTED
[06:48:20.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:11:0) after 4m20s
[06:52:40.766] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:11:0)
[06:52:40.916] Build status: STARTED
[06:52:40.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:12:0) after 5m21s
[06:58:02.034] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:12:0)
[06:58:02.071] Build status: STARTED
[06:58:02.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:13:0) after 7m34s
[07:05:36.090] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:13:0)
[07:05:36.110] Build status: STARTED
[07:05:36.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:14:0) after 1m48s
[07:07:24.188] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:14:0)
[07:07:24.208] Build status: STARTED
[07:07:24.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:15:0) after 5m18s
[07:12:42.417] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:15:0)
[07:12:42.437] Build status: STARTED
[07:12:42.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:16:0) after 5m4s
[07:17:46.551] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:16:0)
[07:17:46.571] Build status: STARTED
[07:17:46.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:17:0) after 9m5s
[07:26:51.760] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:17:0)
[07:26:51.779] Build status: STARTED
[07:26:51.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:18:0) after 6m15s
[07:33:06.793] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:18:0)
[07:33:06.851] Build status: STARTED
[07:33:06.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:19:0) after 2m49s
[07:35:55.875] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:19:0)
[07:35:55.898] Build status: STARTED
[07:35:55.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:20:0) after 5m44s
[07:41:39.866] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:20:0)
[07:41:39.883] Build status: STARTED
[07:41:39.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:21:0) after 5m41s
[07:47:20.985] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:21:0)
[07:47:21.004] Build status: STARTED
[07:47:21.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:22:0) after 8m48s
[07:56:08.988] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:22:0)
[07:56:09.012] Build status: STARTED
[07:56:09.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:23:0) after 1m50s
[07:57:59.052] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:23:0)
[07:57:59.125] Build status: STARTED
[07:57:59.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:24:0) after 2m46s
[08:00:45.127] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:24:0)
[08:00:45.147] Build status: STARTED
[08:00:45.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:25:0) after 3m45s
[08:04:30.215] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:25:0)
[08:04:30.235] Build status: STARTED
[08:04:30.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:26:0) after 1m38s
[08:06:08.394] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:26:0)
[08:06:08.447] Build status: STARTED
[08:06:08.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:27:0) after 6m57s
[08:13:06.534] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:27:0)
[08:13:06.557] Build status: STARTED
[08:13:06.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:28:0) after 6m5s
[08:19:11.582] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:28:0)
[08:19:11.608] Build status: STARTED
[08:19:11.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:29:0) after 6m47s
[08:25:59.243] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:29:0)
[08:25:59.271] Build status: STARTED
[08:25:59.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:30:0) after 4m10s
[08:30:09.294] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:30:0)
[08:30:09.315] Build status: STARTED
[08:30:09.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:31:0) after 9m1s
[08:39:10.579] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:31:0)
[08:39:10.601] Build status: STARTED
[08:39:10.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:32:0) after 4m59s
[08:44:09.619] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:32:0)
[08:44:09.644] Build status: STARTED
[08:44:09.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:33:0) after 1m7s
[08:45:16.877] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:33:0)
[08:45:16.911] Build status: STARTED
[08:45:16.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:34:0) after 5m32s
[08:50:49.030] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:34:0)
[08:50:49.054] Build status: STARTED
[08:50:49.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:35:0) after 3m26s
[08:54:15.096] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:35:0)
[08:54:15.140] Build status: STARTED
[08:54:15.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:36:0) after 4m42s
[08:58:57.258] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:36:0)
[08:58:57.278] Build status: STARTED
[08:58:57.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:37:0) after 2m9s
[09:01:06.378] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:37:0)
[09:01:06.403] Build status: STARTED
[09:01:06.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:38:0) after 3m30s
[09:04:36.575] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:38:0)
[09:04:36.596] Build status: STARTED
[09:04:36.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:39:0) after 5m14s
[09:09:50.625] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:39:0)
[09:09:50.646] Build status: STARTED
[09:09:50.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:40:0) after 3m9s
[09:12:59.664] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:40:0)
[09:12:59.688] Build status: STARTED
[09:12:59.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:41:0) after 4m30s
[09:17:29.787] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:41:0)
[09:17:29.808] Build status: STARTED
[09:17:29.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:42:0) after 4m25s
[09:21:54.828] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:42:0)
[09:21:54.848] Build status: STARTED
[09:21:54.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:43:0) after 6m0s
[09:27:54.979] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:43:0)
[09:27:55.003] Build status: STARTED
[09:27:55.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:44:0) after 7m24s
[09:35:19.068] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:44:0)
[09:35:19.091] Build status: STARTED
[09:35:19.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:45:0) after 1m52s
[09:37:11.157] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:45:0)
[09:37:11.178] Build status: STARTED
[09:37:11.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:46:0) after 7m11s
[09:44:22.231] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:46:0)
[09:44:22.252] Build status: STARTED
[09:44:22.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:47:0) after 6m11s
[09:50:33.335] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:47:0)
[09:50:33.359] Build status: STARTED
[09:50:33.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:48:0) after 9m40s
[10:00:13.360] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:48:0)
[10:00:13.386] Build status: STARTED
[10:00:13.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:49:0) after 8m55s
[10:09:08.412] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:49:0)
[10:09:08.443] Build status: STARTED
[10:09:08.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:50:0) after 7m27s
[10:16:35.647] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:50:0)
[10:16:35.667] Build status: STARTED
[10:16:35.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:51:0) after 3m39s
[10:20:14.693] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:51:0)
[10:20:14.716] Build status: STARTED
[10:20:14.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:52:0) after 5m24s
[10:25:38.736] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:52:0)
[10:25:38.757] Build status: STARTED
[10:25:38.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:53:0) after 7m11s
[10:32:49.779] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:53:0)
[10:32:49.797] Build status: STARTED
[10:32:49.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:54:0) after 2m55s
[10:35:44.963] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:54:0)
[10:35:44.990] Build status: STARTED
[10:35:44.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:55:0) after 2m20s
[10:38:05.026] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:55:0)
[10:38:05.056] Build status: STARTED
[10:38:05.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:56:0) after 3m38s
[10:41:43.044] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:56:0)
[10:41:43.062] Build status: STARTED
[10:41:43.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:57:0) after 8m11s
[10:49:54.159] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:57:0)
[10:49:54.181] Build status: STARTED
[10:49:54.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:58:0) after 4m12s
[10:54:06.200] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:58:0)
[10:54:06.223] Build status: STARTED
[10:54:06.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:59:0) after 8m48s
[11:02:54.243] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:59:0)
[11:02:54.265] Build status: STARTED
[11:02:54.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:60:0) after 4m44s
[11:07:38.293] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:60:0)
[11:07:38.314] Build status: STARTED
[11:07:38.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:61:0) after 2m16s
[11:09:54.355] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:61:0)
[11:09:54.376] Build status: STARTED
[11:09:54.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:62:0) after 6m26s
[11:16:20.400] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:62:0)
[11:16:20.426] Build status: STARTED
[11:16:20.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:63:0) after 9m2s
[11:25:22.447] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:63:0)
[11:25:22.465] Build status: STARTED
[11:25:22.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953550606353773328:64:0) after 4m31s
[11:29:52.753] Received PubSub notification, asking Buildbucket for the build status
[11:29:52.870] Build:
{
"id": "8788120544297471169",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 28998,
"createdBy": "project:chromium",
"createTime": "2023-02-26T06:16:09.629708984Z",
"startTime": "2023-02-26T06:18:36.384331Z",
"endTime": "2023-02-26T11:29:52.561243195Z",
"updateTime": "2023-02-26T11:29:52.561243195Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3d052955f2021b1acb10c5a176966ab9c47da197",
"ref": "refs/heads/main"
}
}
}
[11:29:52.870] Invocation finished in 5h13m44.586620043s with status FAILED