[10:14:14.398] New invocation is queued and will start shortly
[10:14:15.433] Starting the invocation (attempt 1)
[10:14:15.459] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/030212f60c7c59a957d06c1cb5e0c8c750e33b51"
[10:14:15.459] Popped gitiles commit info from properties and tags
[10:14:15.460] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:14:15.460] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:14:15.460] Buildbucket request:
{
"requestId": "8938858917733578880",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "030212f60c7c59a957d06c1cb5e0c8c750e33b51",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8938858917733578880"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:14:16.013] Scheduled build:
{
"id": "8773428855894333361",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30115,
"createdBy": "project:chromium",
"createTime": "2023-08-07T10:14:15.524708284Z",
"updateTime": "2023-08-07T10:14:15.524708284Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "030212f60c7c59a957d06c1cb5e0c8c750e33b51",
"ref": "refs/heads/main"
}
}
}
[10:14:16.013] Task URL: https://cr-buildbucket.appspot.com/build/8773428855894333361
[10:14:16.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:2:0) after 5m59s
[10:14:16.950] Received PubSub notification, asking Buildbucket for the build status
[10:14:16.981] Build status: SCHEDULED
[10:17:28.977] Received PubSub notification, asking Buildbucket for the build status
[10:17:29.016] Build status: STARTED
[10:20:15.269] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:2:0)
[10:20:15.297] Build status: STARTED
[10:20:15.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:5:0) after 8m8s
[10:28:23.385] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:5:0)
[10:28:23.471] Build status: STARTED
[10:28:23.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:6:0) after 1m19s
[10:29:42.717] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:6:0)
[10:29:42.736] Build status: STARTED
[10:29:42.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:7:0) after 6m40s
[10:36:22.768] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:7:0)
[10:36:22.786] Build status: STARTED
[10:36:22.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:8:0) after 1m29s
[10:37:51.903] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:8:0)
[10:37:51.926] Build status: STARTED
[10:37:51.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:9:0) after 1m26s
[10:39:18.181] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:9:0)
[10:39:18.208] Build status: STARTED
[10:39:18.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:10:0) after 7m42s
[10:47:00.324] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:10:0)
[10:47:00.340] Build status: STARTED
[10:47:00.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:11:0) after 1m35s
[10:48:35.436] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:11:0)
[10:48:35.460] Build status: STARTED
[10:48:35.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:12:0) after 2m27s
[10:51:02.651] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:12:0)
[10:51:02.666] Build status: STARTED
[10:51:02.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:13:0) after 2m44s
[10:53:46.793] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:13:0)
[10:53:46.811] Build status: STARTED
[10:53:46.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:14:0) after 7m54s
[11:01:40.962] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:14:0)
[11:01:40.988] Build status: STARTED
[11:01:40.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:15:0) after 3m48s
[11:05:29.010] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:15:0)
[11:05:29.049] Build status: STARTED
[11:05:29.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:16:0) after 4m38s
[11:10:07.104] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:16:0)
[11:10:07.125] Build status: STARTED
[11:10:07.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:17:0) after 5m35s
[11:15:42.151] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:17:0)
[11:15:42.171] Build status: STARTED
[11:15:42.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:18:0) after 4m42s
[11:20:24.175] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:18:0)
[11:20:24.209] Build status: STARTED
[11:20:24.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:19:0) after 3m6s
[11:23:30.461] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:19:0)
[11:23:30.482] Build status: STARTED
[11:23:30.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:20:0) after 3m48s
[11:27:18.577] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:20:0)
[11:27:18.620] Build status: STARTED
[11:27:18.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:21:0) after 4m51s
[11:32:09.759] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:21:0)
[11:32:09.781] Build status: STARTED
[11:32:09.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:22:0) after 6m42s
[11:38:51.800] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:22:0)
[11:38:51.842] Build status: STARTED
[11:38:51.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:23:0) after 1m34s
[11:40:25.961] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:23:0)
[11:40:25.983] Build status: STARTED
[11:40:25.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:24:0) after 4m13s
[11:44:39.019] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:24:0)
[11:44:39.036] Build status: STARTED
[11:44:39.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:25:0) after 7m30s
[11:52:09.069] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:25:0)
[11:52:09.094] Build status: STARTED
[11:52:09.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:26:0) after 1m45s
[11:53:54.164] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:26:0)
[11:53:54.180] Build status: STARTED
[11:53:54.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:27:0) after 1m49s
[11:55:43.426] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:27:0)
[11:55:43.446] Build status: STARTED
[11:55:43.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:28:0) after 7m55s
[12:03:39.014] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:28:0)
[12:03:39.046] Build status: STARTED
[12:03:39.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:29:0) after 8m22s
[12:12:01.074] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:29:0)
[12:12:01.145] Build status: STARTED
[12:12:01.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:30:0) after 9m11s
[12:21:12.336] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:30:0)
[12:21:12.361] Build status: STARTED
[12:21:12.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:31:0) after 9m21s
[12:30:33.562] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:31:0)
[12:30:33.605] Build status: STARTED
[12:30:33.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:32:0) after 4m41s
[12:35:14.728] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:32:0)
[12:35:14.756] Build status: STARTED
[12:35:14.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:33:0) after 7m24s
[12:42:39.410] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:33:0)
[12:42:39.460] Build status: STARTED
[12:42:39.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:34:0) after 2m15s
[12:44:54.543] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:34:0)
[12:44:54.570] Build status: STARTED
[12:44:54.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:35:0) after 9m25s
[12:54:20.272] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:35:0)
[12:54:20.295] Build status: STARTED
[12:54:20.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:36:0) after 9m52s
[13:04:12.677] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:36:0)
[13:04:12.727] Build status: STARTED
[13:04:12.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:37:0) after 6m57s
[13:11:09.997] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:37:0)
[13:11:10.013] Build status: STARTED
[13:11:10.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:38:0) after 9m3s
[13:20:13.316] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:38:0)
[13:20:13.343] Build status: STARTED
[13:20:13.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:39:0) after 4m1s
[13:24:14.703] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:39:0)
[13:24:14.732] Build status: STARTED
[13:24:14.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:40:0) after 6m37s
[13:30:51.885] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:40:0)
[13:30:51.904] Build status: STARTED
[13:30:51.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:41:0) after 5m9s
[13:36:01.152] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:41:0)
[13:36:01.178] Build status: STARTED
[13:36:01.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:42:0) after 8m4s
[13:44:05.380] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:42:0)
[13:44:05.399] Build status: STARTED
[13:44:05.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:43:0) after 8m6s
[13:52:11.424] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:43:0)
[13:52:11.441] Build status: STARTED
[13:52:11.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:44:0) after 4m4s
[13:56:15.626] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:44:0)
[13:56:15.673] Build status: STARTED
[13:56:15.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:45:0) after 1m6s
[13:57:21.873] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:45:0)
[13:57:21.893] Build status: STARTED
[13:57:21.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:46:0) after 9m19s
[14:06:40.925] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:46:0)
[14:06:40.947] Build status: STARTED
[14:06:40.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:47:0) after 6m32s
[14:13:12.998] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:47:0)
[14:13:13.025] Build status: STARTED
[14:13:13.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:48:0) after 3m34s
[14:16:47.049] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:48:0)
[14:16:47.099] Build status: STARTED
[14:16:47.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:49:0) after 5m41s
[14:22:28.159] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:49:0)
[14:22:28.231] Build status: STARTED
[14:22:28.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:50:0) after 9m6s
[14:31:34.322] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:50:0)
[14:31:34.343] Build status: STARTED
[14:31:34.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:51:0) after 8m50s
[14:40:24.368] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:51:0)
[14:40:24.415] Build status: STARTED
[14:40:24.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:52:0) after 5m52s
[14:46:16.431] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:52:0)
[14:46:16.453] Build status: STARTED
[14:46:16.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:53:0) after 9m46s
[14:56:02.474] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:53:0)
[14:56:02.534] Build status: STARTED
[14:56:02.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:54:0) after 8m29s
[15:04:31.570] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:54:0)
[15:04:31.591] Build status: STARTED
[15:04:31.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:55:0) after 9m23s
[15:13:54.670] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:55:0)
[15:13:54.735] Build status: STARTED
[15:13:54.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:56:0) after 4m24s
[15:18:18.798] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:56:0)
[15:18:18.899] Build status: STARTED
[15:18:18.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:57:0) after 3m41s
[15:21:59.967] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:57:0)
[15:21:59.986] Build status: STARTED
[15:21:59.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:58:0) after 7m57s
[15:29:57.065] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:58:0)
[15:29:57.087] Build status: STARTED
[15:29:57.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:59:0) after 4m37s
[15:34:34.248] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:59:0)
[15:34:34.269] Build status: STARTED
[15:34:34.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:60:0) after 7m25s
[15:41:59.329] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:60:0)
[15:41:59.353] Build status: STARTED
[15:41:59.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:61:0) after 7m51s
[15:49:50.479] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:61:0)
[15:49:50.499] Build status: STARTED
[15:49:50.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:62:0) after 3m10s
[15:53:00.598] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:62:0)
[15:53:00.631] Build status: STARTED
[15:53:00.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:63:0) after 1m2s
[15:54:02.664] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:63:0)
[15:54:02.683] Build status: STARTED
[15:54:02.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8938858917733578880:64:0) after 9m2s
[16:00:44.490] Received PubSub notification, asking Buildbucket for the build status
[16:00:44.540] Build:
{
"id": "8773428855894333361",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30115,
"createdBy": "project:chromium",
"createTime": "2023-08-07T10:14:15.524708284Z",
"startTime": "2023-08-07T10:17:28.418253Z",
"endTime": "2023-08-07T16:00:44.022439407Z",
"updateTime": "2023-08-07T16:00:44.022439407Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "030212f60c7c59a957d06c1cb5e0c8c750e33b51",
"ref": "refs/heads/main"
}
}
}
[16:00:44.540] Invocation finished in 5h46m30.15445549s with status FAILED