[18:47:08.471] New invocation is queued and will start shortly
[18:47:09.538] Starting the invocation (attempt 1)
[18:47:09.567] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e8453fea0e2153bd7cfa64012ffdae632ed2fd23"
[18:47:09.567] Popped gitiles commit info from properties and tags
[18:47:09.567] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:47:09.567] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:47:09.567] Buildbucket request:
{
"requestId": "8941906945637240096",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e8453fea0e2153bd7cfa64012ffdae632ed2fd23",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8941906945637240096"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:47:10.015] Scheduled build:
{
"id": "8776476883759835793",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29862,
"createdBy": "project:chromium",
"createTime": "2023-07-04T18:47:09.633726434Z",
"updateTime": "2023-07-04T18:47:09.633726434Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e8453fea0e2153bd7cfa64012ffdae632ed2fd23",
"ref": "refs/heads/main"
}
}
}
[18:47:10.015] Task URL: https://cr-buildbucket.appspot.com/build/8776476883759835793
[18:47:10.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:2:0) after 7m35s
[18:50:35.932] Received PubSub notification, asking Buildbucket for the build status
[18:50:35.952] Build status: STARTED
[18:54:45.269] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:2:0)
[18:54:45.296] Build status: STARTED
[18:54:45.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:4:0) after 5m40s
[19:00:25.299] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:4:0)
[19:00:25.345] Build status: STARTED
[19:00:25.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:5:0) after 3m18s
[19:03:43.322] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:5:0)
[19:03:43.343] Build status: STARTED
[19:03:43.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:6:0) after 9m29s
[19:13:12.360] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:6:0)
[19:13:12.379] Build status: STARTED
[19:13:12.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:7:0) after 6m46s
[19:19:58.396] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:7:0)
[19:19:58.416] Build status: STARTED
[19:19:58.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:8:0) after 3m49s
[19:23:47.435] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:8:0)
[19:23:47.481] Build status: STARTED
[19:23:47.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:9:0) after 3m45s
[19:27:32.615] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:9:0)
[19:27:32.630] Build status: STARTED
[19:27:32.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:10:0) after 6m39s
[19:34:11.648] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:10:0)
[19:34:11.666] Build status: STARTED
[19:34:11.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:11:0) after 6m33s
[19:40:44.687] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:11:0)
[19:40:44.715] Build status: STARTED
[19:40:44.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:12:0) after 3m49s
[19:44:34.063] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:12:0)
[19:44:34.077] Build status: STARTED
[19:44:34.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:13:0) after 2m1s
[19:46:35.201] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:13:0)
[19:46:35.219] Build status: STARTED
[19:46:35.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:14:0) after 4m32s
[19:51:07.244] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:14:0)
[19:51:07.270] Build status: STARTED
[19:51:07.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:15:0) after 7m30s
[19:58:37.290] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:15:0)
[19:58:37.308] Build status: STARTED
[19:58:37.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:16:0) after 6m50s
[20:05:27.439] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:16:0)
[20:05:27.462] Build status: STARTED
[20:05:27.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:17:0) after 9m50s
[20:15:17.496] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:17:0)
[20:15:17.570] Build status: STARTED
[20:15:17.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:18:0) after 7m29s
[20:22:46.590] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:18:0)
[20:22:46.607] Build status: STARTED
[20:22:46.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:19:0) after 2m59s
[20:25:45.798] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:19:0)
[20:25:45.818] Build status: STARTED
[20:25:45.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:20:0) after 2m22s
[20:28:07.842] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:20:0)
[20:28:07.860] Build status: STARTED
[20:28:07.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:21:0) after 3m1s
[20:31:08.881] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:21:0)
[20:31:08.903] Build status: STARTED
[20:31:08.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:22:0) after 9m3s
[20:40:12.072] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:22:0)
[20:40:12.096] Build status: STARTED
[20:40:12.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:23:0) after 1m49s
[20:42:01.125] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:23:0)
[20:42:01.144] Build status: STARTED
[20:42:01.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:24:0) after 1m51s
[20:43:52.520] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:24:0)
[20:43:52.542] Build status: STARTED
[20:43:52.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:25:0) after 3m35s
[20:47:27.641] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:25:0)
[20:47:27.660] Build status: STARTED
[20:47:27.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:26:0) after 2m12s
[20:49:39.688] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:26:0)
[20:49:39.707] Build status: STARTED
[20:49:39.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:27:0) after 5m48s
[20:55:27.755] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:27:0)
[20:55:27.788] Build status: STARTED
[20:55:27.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:28:0) after 2m17s
[20:57:44.961] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:28:0)
[20:57:44.981] Build status: STARTED
[20:57:44.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:29:0) after 1m40s
[20:59:25.004] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:29:0)
[20:59:25.024] Build status: STARTED
[20:59:25.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:30:0) after 6m22s
[21:05:47.426] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:30:0)
[21:05:47.444] Build status: STARTED
[21:05:47.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:31:0) after 5m47s
[21:11:34.486] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:31:0)
[21:11:34.508] Build status: STARTED
[21:11:34.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:32:0) after 2m58s
[21:14:32.526] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:32:0)
[21:14:32.547] Build status: STARTED
[21:14:32.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:33:0) after 5m14s
[21:19:46.570] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:33:0)
[21:19:46.591] Build status: STARTED
[21:19:46.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:34:0) after 9m52s
[21:29:38.796] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:34:0)
[21:29:38.955] Build status: STARTED
[21:29:38.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:35:0) after 8m50s
[21:38:29.101] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:35:0)
[21:38:29.159] Build status: STARTED
[21:38:29.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:36:0) after 6m51s
[21:45:20.368] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:36:0)
[21:45:20.394] Build status: STARTED
[21:45:20.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:37:0) after 2m32s
[21:47:52.403] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:37:0)
[21:47:52.421] Build status: STARTED
[21:47:52.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:38:0) after 9m19s
[21:57:11.562] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:38:0)
[21:57:11.588] Build status: STARTED
[21:57:11.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:39:0) after 5m52s
[22:03:03.735] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:39:0)
[22:03:03.757] Build status: STARTED
[22:03:03.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:40:0) after 9m41s
[22:12:45.037] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:40:0)
[22:12:45.066] Build status: STARTED
[22:12:45.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:41:0) after 7m17s
[22:20:02.428] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:41:0)
[22:20:02.449] Build status: STARTED
[22:20:02.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:42:0) after 8m47s
[22:28:49.472] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:42:0)
[22:28:49.494] Build status: STARTED
[22:28:49.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:43:0) after 3m59s
[22:32:48.532] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:43:0)
[22:32:48.585] Build status: STARTED
[22:32:48.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:44:0) after 3m50s
[22:36:38.604] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:44:0)
[22:36:38.626] Build status: STARTED
[22:36:38.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:45:0) after 9m26s
[22:46:04.658] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:45:0)
[22:46:04.675] Build status: STARTED
[22:46:04.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:46:0) after 3m50s
[22:49:54.794] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:46:0)
[22:49:54.809] Build status: STARTED
[22:49:54.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:47:0) after 4m9s
[22:54:03.838] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:47:0)
[22:54:03.856] Build status: STARTED
[22:54:03.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:48:0) after 4m51s
[22:58:54.874] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:48:0)
[22:58:54.956] Build status: STARTED
[22:58:54.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:49:0) after 2m6s
[23:01:00.985] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:49:0)
[23:01:01.008] Build status: STARTED
[23:01:01.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:50:0) after 6m47s
[23:07:48.029] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:50:0)
[23:07:48.056] Build status: STARTED
[23:07:48.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:51:0) after 5m46s
[23:13:34.077] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:51:0)
[23:13:34.095] Build status: STARTED
[23:13:34.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:52:0) after 8m3s
[23:21:37.097] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:52:0)
[23:21:37.113] Build status: STARTED
[23:21:37.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:53:0) after 8m8s
[23:29:45.202] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:53:0)
[23:29:45.222] Build status: STARTED
[23:29:45.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:54:0) after 9m6s
[23:38:51.448] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:54:0)
[23:38:51.467] Build status: STARTED
[23:38:51.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:55:0) after 9m4s
[23:47:55.491] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:55:0)
[23:47:55.516] Build status: STARTED
[23:47:55.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:56:0) after 3m33s
[23:51:28.635] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:56:0)
[23:51:28.653] Build status: STARTED
[23:51:28.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:57:0) after 2m7s
[23:53:35.807] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:57:0)
[23:53:35.828] Build status: STARTED
[23:53:35.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:58:0) after 9m45s
[00:03:20.848] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:58:0)
[00:03:20.868] Build status: STARTED
[00:03:20.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:59:0) after 9m48s
[00:13:09.100] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:59:0)
[00:13:09.129] Build status: STARTED
[00:13:09.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:60:0) after 4m40s
[00:17:49.450] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:60:0)
[00:17:49.477] Build status: STARTED
[00:17:49.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:61:0) after 4m6s
[00:21:55.496] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:61:0)
[00:21:55.514] Build status: STARTED
[00:21:55.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8941906945637240096:62:0) after 5m11s
[00:25:49.390] Received PubSub notification, asking Buildbucket for the build status
[00:25:49.410] Build:
{
"id": "8776476883759835793",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29862,
"createdBy": "project:chromium",
"createTime": "2023-07-04T18:47:09.633726434Z",
"startTime": "2023-07-04T18:50:35.148665Z",
"endTime": "2023-07-05T00:25:49.192728702Z",
"updateTime": "2023-07-05T00:25:49.192728702Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e8453fea0e2153bd7cfa64012ffdae632ed2fd23",
"ref": "refs/heads/main"
}
}
}
[00:25:49.410] Invocation finished in 5h38m40.951313978s with status FAILED