[18:33:18.613] New invocation is queued and will start shortly
[18:33:19.726] Starting the invocation (attempt 1)
[18:33:19.766] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/b7c57fbb0ad36dbb7cc5a5c4fc2f1b56ade3bef7"
[18:33:19.766] Popped gitiles commit info from properties and tags
[18:33:19.766] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:33:19.767] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:33:19.767] Buildbucket request:
{
"requestId": "8955225569867974736",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b7c57fbb0ad36dbb7cc5a5c4fc2f1b56ade3bef7",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8955225569867974736"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:33:20.491] Scheduled build:
{
"id": "8789795507872041601",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 28916,
"createdBy": "project:chromium",
"createTime": "2023-02-07T18:33:19.887565234Z",
"updateTime": "2023-02-07T18:33:19.887565234Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b7c57fbb0ad36dbb7cc5a5c4fc2f1b56ade3bef7",
"ref": "refs/heads/main"
}
}
}
[18:33:20.491] Task URL: https://cr-buildbucket.appspot.com/build/8789795507872041601
[18:33:20.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:2:0) after 4m26s
[18:35:49.061] Received PubSub notification, asking Buildbucket for the build status
[18:35:49.083] Build status: STARTED
[18:37:46.552] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:2:0)
[18:37:46.576] Build status: STARTED
[18:37:46.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:4:0) after 6m59s
[18:44:45.598] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:4:0)
[18:44:45.624] Build status: STARTED
[18:44:45.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:5:0) after 7m45s
[18:52:30.652] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:5:0)
[18:52:30.674] Build status: STARTED
[18:52:30.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:6:0) after 6m37s
[18:59:07.712] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:6:0)
[18:59:07.801] Build status: STARTED
[18:59:07.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:7:0) after 2m18s
[19:01:26.446] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:7:0)
[19:01:26.487] Build status: STARTED
[19:01:26.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:8:0) after 9m33s
[19:10:59.640] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:8:0)
[19:10:59.661] Build status: STARTED
[19:10:59.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:9:0) after 9m6s
[19:20:05.681] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:9:0)
[19:20:05.721] Build status: STARTED
[19:20:05.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:10:0) after 8m1s
[19:28:06.917] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:10:0)
[19:28:07.000] Build status: STARTED
[19:28:07.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:11:0) after 3m27s
[19:31:34.113] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:11:0)
[19:31:34.143] Build status: STARTED
[19:31:34.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:12:0) after 6m48s
[19:38:22.167] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:12:0)
[19:38:22.199] Build status: STARTED
[19:38:22.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:13:0) after 8m46s
[19:47:08.198] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:13:0)
[19:47:08.225] Build status: STARTED
[19:47:08.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:14:0) after 3m35s
[19:50:43.248] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:14:0)
[19:50:43.273] Build status: STARTED
[19:50:43.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:15:0) after 2m41s
[19:53:24.300] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:15:0)
[19:53:24.337] Build status: STARTED
[19:53:24.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:16:0) after 1m24s
[19:54:48.416] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:16:0)
[19:54:48.506] Build status: STARTED
[19:54:48.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:17:0) after 3m13s
[19:58:01.523] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:17:0)
[19:58:01.672] Build status: STARTED
[19:58:01.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:18:0) after 2m45s
[20:00:46.719] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:18:0)
[20:00:46.753] Build status: STARTED
[20:00:46.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:19:0) after 7m59s
[20:08:45.802] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:19:0)
[20:08:45.832] Build status: STARTED
[20:08:45.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:20:0) after 3m14s
[20:11:59.863] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:20:0)
[20:11:59.884] Build status: STARTED
[20:11:59.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:21:0) after 7m46s
[20:19:45.957] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:21:0)
[20:19:45.976] Build status: STARTED
[20:19:45.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:22:0) after 6m36s
[20:26:22.048] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:22:0)
[20:26:22.073] Build status: STARTED
[20:26:22.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:23:0) after 8m12s
[20:34:34.262] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:23:0)
[20:34:34.281] Build status: STARTED
[20:34:34.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:24:0) after 1m3s
[20:35:37.293] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:24:0)
[20:35:37.313] Build status: STARTED
[20:35:37.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:25:0) after 7m10s
[20:42:47.388] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:25:0)
[20:42:47.420] Build status: STARTED
[20:42:47.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:26:0) after 1m4s
[20:43:51.441] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:26:0)
[20:43:51.466] Build status: STARTED
[20:43:51.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:27:0) after 1m36s
[20:45:27.542] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:27:0)
[20:45:27.563] Build status: STARTED
[20:45:27.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:28:0) after 1m14s
[20:46:41.591] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:28:0)
[20:46:41.614] Build status: STARTED
[20:46:41.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:29:0) after 7m32s
[20:54:13.589] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:29:0)
[20:54:13.672] Build status: STARTED
[20:54:13.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:30:0) after 1m19s
[20:55:32.673] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:30:0)
[20:55:32.705] Build status: STARTED
[20:55:32.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:31:0) after 1m54s
[20:57:26.727] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:31:0)
[20:57:26.750] Build status: STARTED
[20:57:26.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:32:0) after 9m17s
[21:06:44.179] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:32:0)
[21:06:44.198] Build status: STARTED
[21:06:44.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:33:0) after 1m15s
[21:08:00.166] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:33:0)
[21:08:00.192] Build status: STARTED
[21:08:00.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:34:0) after 8m50s
[21:16:50.250] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:34:0)
[21:16:50.271] Build status: STARTED
[21:16:50.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:35:0) after 7m17s
[21:24:07.308] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:35:0)
[21:24:07.333] Build status: STARTED
[21:24:07.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:36:0) after 9m17s
[21:33:24.461] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:36:0)
[21:33:24.483] Build status: STARTED
[21:33:24.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:37:0) after 1m37s
[21:35:01.545] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:37:0)
[21:35:01.605] Build status: STARTED
[21:35:01.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:38:0) after 6m14s
[21:41:15.816] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:38:0)
[21:41:15.839] Build status: STARTED
[21:41:15.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:39:0) after 3m5s
[21:44:21.160] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:39:0)
[21:44:21.185] Build status: STARTED
[21:44:21.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:40:0) after 8m7s
[21:52:28.305] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:40:0)
[21:52:28.342] Build status: STARTED
[21:52:28.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:41:0) after 1m49s
[21:54:17.483] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:41:0)
[21:54:17.514] Build status: STARTED
[21:54:17.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:42:0) after 8m38s
[22:02:55.627] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:42:0)
[22:02:55.651] Build status: STARTED
[22:02:55.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:43:0) after 3m47s
[22:06:42.776] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:43:0)
[22:06:42.795] Build status: STARTED
[22:06:42.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:44:0) after 4m0s
[22:10:42.859] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:44:0)
[22:10:42.880] Build status: STARTED
[22:10:42.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:45:0) after 9m10s
[22:19:53.325] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:45:0)
[22:19:53.348] Build status: STARTED
[22:19:53.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:46:0) after 2m49s
[22:22:42.504] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:46:0)
[22:22:42.551] Build status: STARTED
[22:22:42.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:47:0) after 6m45s
[22:29:27.681] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:47:0)
[22:29:27.723] Build status: STARTED
[22:29:27.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:48:0) after 5m23s
[22:34:50.852] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:48:0)
[22:34:50.873] Build status: STARTED
[22:34:50.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:49:0) after 5m4s
[22:39:55.049] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:49:0)
[22:39:55.075] Build status: STARTED
[22:39:55.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:50:0) after 5m41s
[22:45:36.196] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:50:0)
[22:45:36.217] Build status: STARTED
[22:45:36.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:51:0) after 7m14s
[22:52:50.278] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:51:0)
[22:52:50.300] Build status: STARTED
[22:52:50.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:52:0) after 3m4s
[22:55:54.365] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:52:0)
[22:55:54.391] Build status: STARTED
[22:55:54.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:53:0) after 7m20s
[23:03:14.853] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:53:0)
[23:03:15.028] Build status: STARTED
[23:03:15.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:54:0) after 8m31s
[23:11:46.096] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:54:0)
[23:11:46.125] Build status: STARTED
[23:11:46.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:55:0) after 2m44s
[23:14:30.415] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:55:0)
[23:14:30.437] Build status: STARTED
[23:14:30.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:56:0) after 6m31s
[23:21:01.444] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:56:0)
[23:21:01.498] Build status: STARTED
[23:21:01.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:57:0) after 8m30s
[23:29:31.730] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:57:0)
[23:29:31.750] Build status: STARTED
[23:29:31.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:58:0) after 8m54s
[23:38:25.772] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:58:0)
[23:38:25.793] Build status: STARTED
[23:38:25.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8955225569867974736:59:0) after 8m38s
[23:44:07.970] Received PubSub notification, asking Buildbucket for the build status
[23:44:08.041] Build:
{
"id": "8789795507872041601",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 28916,
"createdBy": "project:chromium",
"createTime": "2023-02-07T18:33:19.887565234Z",
"startTime": "2023-02-07T18:35:48.285665Z",
"endTime": "2023-02-07T23:44:07.536187388Z",
"updateTime": "2023-02-07T23:44:07.536187388Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b7c57fbb0ad36dbb7cc5a5c4fc2f1b56ade3bef7",
"ref": "refs/heads/main"
}
}
}
[23:44:08.042] Invocation finished in 5h10m49.441823965s with status FAILED