[18:28:20.143] New invocation is queued and will start shortly
[18:28:21.251] Starting the invocation (attempt 1)
[18:28:21.294] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f7c61cd6544e8871e7c876bb3c7b780d345c50a3"
[18:28:21.294] Popped gitiles commit info from properties and tags
[18:28:21.294] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:28:21.294] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:28:21.294] Buildbucket request:
{
"requestId": "8946981558886549696",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f7c61cd6544e8871e7c876bb3c7b780d345c50a3",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8946981558886549696"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:28:21.954] Scheduled build:
{
"id": "8781551496948543537",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29377,
"createdBy": "project:chromium",
"createTime": "2023-05-09T18:28:21.369787257Z",
"updateTime": "2023-05-09T18:28:21.369787257Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f7c61cd6544e8871e7c876bb3c7b780d345c50a3",
"ref": "refs/heads/main"
}
}
}
[18:28:21.954] Task URL: https://cr-buildbucket.appspot.com/build/8781551496948543537
[18:28:21.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:2:0) after 9m36s
[18:31:18.449] Received PubSub notification, asking Buildbucket for the build status
[18:31:18.486] Build status: STARTED
[18:37:58.025] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:2:0)
[18:37:58.063] Build status: STARTED
[18:37:58.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:4:0) after 9m48s
[18:47:46.144] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:4:0)
[18:47:46.173] Build status: STARTED
[18:47:46.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:5:0) after 2m27s
[18:50:13.316] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:5:0)
[18:50:13.382] Build status: STARTED
[18:50:13.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:6:0) after 5m32s
[18:55:45.466] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:6:0)
[18:55:45.484] Build status: STARTED
[18:55:45.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:7:0) after 6m36s
[19:02:21.540] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:7:0)
[19:02:21.562] Build status: STARTED
[19:02:21.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:8:0) after 5m17s
[19:07:38.592] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:8:0)
[19:07:38.627] Build status: STARTED
[19:07:38.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:9:0) after 9m7s
[19:16:46.276] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:9:0)
[19:16:46.314] Build status: STARTED
[19:16:46.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:10:0) after 4m46s
[19:21:32.599] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:10:0)
[19:21:32.619] Build status: STARTED
[19:21:32.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:11:0) after 2m30s
[19:24:02.944] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:11:0)
[19:24:03.019] Build status: STARTED
[19:24:03.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:12:0) after 1m31s
[19:25:34.091] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:12:0)
[19:25:34.113] Build status: STARTED
[19:25:34.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:13:0) after 3m16s
[19:28:50.143] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:13:0)
[19:28:50.215] Build status: STARTED
[19:28:50.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:14:0) after 4m35s
[19:33:25.236] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:14:0)
[19:33:25.294] Build status: STARTED
[19:33:25.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:15:0) after 5m26s
[19:38:51.322] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:15:0)
[19:38:51.342] Build status: STARTED
[19:38:51.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:16:0) after 9m31s
[19:48:22.383] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:16:0)
[19:48:22.403] Build status: STARTED
[19:48:22.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:17:0) after 3m16s
[19:51:38.420] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:17:0)
[19:51:38.444] Build status: STARTED
[19:51:38.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:18:0) after 1m31s
[19:53:09.467] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:18:0)
[19:53:09.545] Build status: STARTED
[19:53:09.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:19:0) after 3m28s
[19:56:37.621] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:19:0)
[19:56:37.687] Build status: STARTED
[19:56:37.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:20:0) after 4m17s
[20:00:54.767] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:20:0)
[20:00:54.852] Build status: STARTED
[20:00:54.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:21:0) after 2m26s
[20:03:21.060] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:21:0)
[20:03:21.079] Build status: STARTED
[20:03:21.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:22:0) after 7m24s
[20:10:45.116] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:22:0)
[20:10:45.142] Build status: STARTED
[20:10:45.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:23:0) after 7m26s
[20:18:11.359] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:23:0)
[20:18:11.376] Build status: STARTED
[20:18:11.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:24:0) after 9m59s
[20:28:10.966] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:24:0)
[20:28:10.987] Build status: STARTED
[20:28:10.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:25:0) after 7m41s
[20:35:52.124] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:25:0)
[20:35:52.151] Build status: STARTED
[20:35:52.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:26:0) after 7m27s
[20:43:19.165] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:26:0)
[20:43:19.184] Build status: STARTED
[20:43:19.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:27:0) after 5m35s
[20:48:54.236] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:27:0)
[20:48:54.261] Build status: STARTED
[20:48:54.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:28:0) after 9m54s
[20:58:48.440] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:28:0)
[20:58:48.464] Build status: STARTED
[20:58:48.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:29:0) after 1m32s
[21:00:20.498] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:29:0)
[21:00:20.520] Build status: STARTED
[21:00:20.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:30:0) after 6m36s
[21:06:56.541] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:30:0)
[21:06:56.637] Build status: STARTED
[21:06:56.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:31:0) after 2m50s
[21:09:46.661] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:31:0)
[21:09:46.683] Build status: STARTED
[21:09:46.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:32:0) after 8m5s
[21:17:51.805] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:32:0)
[21:17:51.824] Build status: STARTED
[21:17:51.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:33:0) after 4m52s
[21:22:43.846] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:33:0)
[21:22:43.867] Build status: STARTED
[21:22:43.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:34:0) after 6m39s
[21:29:22.909] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:34:0)
[21:29:22.931] Build status: STARTED
[21:29:22.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:35:0) after 5m56s
[21:35:19.046] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:35:0)
[21:35:19.065] Build status: STARTED
[21:35:19.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:36:0) after 8m55s
[21:44:14.266] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:36:0)
[21:44:14.284] Build status: STARTED
[21:44:14.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:37:0) after 2m55s
[21:47:09.517] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:37:0)
[21:47:09.536] Build status: STARTED
[21:47:09.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:38:0) after 5m6s
[21:52:15.562] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:38:0)
[21:52:15.637] Build status: STARTED
[21:52:15.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:39:0) after 7m36s
[21:59:51.667] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:39:0)
[21:59:51.702] Build status: STARTED
[21:59:51.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:40:0) after 9m6s
[22:08:57.983] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:40:0)
[22:08:58.002] Build status: STARTED
[22:08:58.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:41:0) after 2m6s
[22:11:04.189] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:41:0)
[22:11:04.251] Build status: STARTED
[22:11:04.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:42:0) after 1m32s
[22:12:36.273] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:42:0)
[22:12:36.308] Build status: STARTED
[22:12:36.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:43:0) after 3m16s
[22:15:52.340] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:43:0)
[22:15:52.361] Build status: STARTED
[22:15:52.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:44:0) after 1m39s
[22:17:31.481] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:44:0)
[22:17:31.503] Build status: STARTED
[22:17:31.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:45:0) after 2m1s
[22:19:32.742] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:45:0)
[22:19:32.765] Build status: STARTED
[22:19:32.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:46:0) after 9m17s
[22:28:49.804] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:46:0)
[22:28:49.827] Build status: STARTED
[22:28:49.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:47:0) after 6m4s
[22:34:53.870] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:47:0)
[22:34:53.888] Build status: STARTED
[22:34:53.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:48:0) after 1m30s
[22:36:23.918] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:48:0)
[22:36:24.010] Build status: STARTED
[22:36:24.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:49:0) after 9m0s
[22:45:24.245] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:49:0)
[22:45:24.264] Build status: STARTED
[22:45:24.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:50:0) after 6m36s
[22:52:00.288] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:50:0)
[22:52:00.311] Build status: STARTED
[22:52:00.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:51:0) after 6m57s
[22:58:57.631] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:51:0)
[22:58:57.665] Build status: STARTED
[22:58:57.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:52:0) after 5m29s
[23:04:26.730] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:52:0)
[23:04:26.750] Build status: STARTED
[23:04:26.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:53:0) after 5m12s
[23:09:38.983] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:53:0)
[23:09:38.999] Build status: STARTED
[23:09:38.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:54:0) after 8m16s
[23:17:55.031] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:54:0)
[23:17:55.048] Build status: STARTED
[23:17:55.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:55:0) after 9m4s
[23:26:59.131] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:55:0)
[23:26:59.193] Build status: STARTED
[23:26:59.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:56:0) after 9m55s
[23:36:54.229] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:56:0)
[23:36:54.248] Build status: STARTED
[23:36:54.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:57:0) after 1m10s
[23:38:04.268] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:57:0)
[23:38:04.286] Build status: STARTED
[23:38:04.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:58:0) after 2m1s
[23:40:05.412] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:58:0)
[23:40:05.439] Build status: STARTED
[23:40:05.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:59:0) after 1m15s
[23:41:20.472] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:59:0)
[23:41:20.494] Build status: STARTED
[23:41:20.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946981558886549696:60:0) after 6m37s
[23:43:14.343] Received PubSub notification, asking Buildbucket for the build status
[23:43:14.363] Build:
{
"id": "8781551496948543537",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29377,
"createdBy": "project:chromium",
"createTime": "2023-05-09T18:28:21.369787257Z",
"startTime": "2023-05-09T18:31:17.173356Z",
"endTime": "2023-05-09T23:43:12.287389477Z",
"updateTime": "2023-05-09T23:43:12.287389477Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f7c61cd6544e8871e7c876bb3c7b780d345c50a3",
"ref": "refs/heads/main"
}
}
}
[23:43:14.363] Invocation finished in 5h14m54.226837579s with status FAILED