[22:22:50.994] New invocation is queued and will start shortly
[22:22:52.195] Starting the invocation (attempt 1)
[22:22:52.227] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/937e86ac01037ba367f0b52437bf0224e002f366"
[22:22:52.227] Popped gitiles commit info from properties and tags
[22:22:52.228] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:22:52.228] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:22:52.228] Buildbucket request:
{
"requestId": "8998516478421977680",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "937e86ac01037ba367f0b52437bf0224e002f366",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8998516478421977680"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:22:52.706] Scheduled build:
{
"id": "8833086416402134305",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23367,
"createdBy": "project:chromium",
"createTime": "2021-10-17T22:22:52.288985498Z",
"updateTime": "2021-10-17T22:22:52.552310031Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "937e86ac01037ba367f0b52437bf0224e002f366",
"ref": "refs/heads/main"
}
}
}
[22:22:52.706] Task URL: https://cr-buildbucket.appspot.com/build/8833086416402134305
[22:22:52.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:2:0) after 1m51s
[22:24:43.947] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:2:0)
[22:24:43.977] Build status: SCHEDULED
[22:24:43.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:3:0) after 3m33s
[22:25:10.724] Received PubSub notification, asking Buildbucket for the build status
[22:25:10.755] Build status: STARTED
[22:28:17.666] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:3:0)
[22:28:17.696] Build status: STARTED
[22:28:17.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:5:0) after 8m11s
[22:36:29.028] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:5:0)
[22:36:29.061] Build status: STARTED
[22:36:29.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:6:0) after 4m46s
[22:41:15.095] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:6:0)
[22:41:15.123] Build status: STARTED
[22:41:15.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:7:0) after 1m30s
[22:42:45.142] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:7:0)
[22:42:45.175] Build status: STARTED
[22:42:45.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:8:0) after 7m32s
[22:50:17.359] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:8:0)
[22:50:17.415] Build status: STARTED
[22:50:17.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:9:0) after 4m46s
[22:55:03.737] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:9:0)
[22:55:03.763] Build status: STARTED
[22:55:03.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:10:0) after 1m57s
[22:57:00.844] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:10:0)
[22:57:00.877] Build status: STARTED
[22:57:00.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:11:0) after 7m26s
[23:04:26.915] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:11:0)
[23:04:26.960] Build status: STARTED
[23:04:26.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:12:0) after 5m48s
[23:10:14.981] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:12:0)
[23:10:15.011] Build status: STARTED
[23:10:15.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:13:0) after 5m52s
[23:16:07.110] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:13:0)
[23:16:07.143] Build status: STARTED
[23:16:07.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:14:0) after 6m43s
[23:22:50.221] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:14:0)
[23:22:50.252] Build status: STARTED
[23:22:50.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:15:0) after 7m24s
[23:30:14.814] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:15:0)
[23:30:14.842] Build status: STARTED
[23:30:14.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:16:0) after 6m56s
[23:37:10.862] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:16:0)
[23:37:10.891] Build status: STARTED
[23:37:10.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:17:0) after 8m4s
[23:45:15.028] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:17:0)
[23:45:15.058] Build status: STARTED
[23:45:15.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:18:0) after 8m58s
[23:54:13.100] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:18:0)
[23:54:13.134] Build status: STARTED
[23:54:13.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:19:0) after 7m12s
[00:01:25.365] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:19:0)
[00:01:25.394] Build status: STARTED
[00:01:25.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:20:0) after 6m15s
[00:07:40.414] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:20:0)
[00:07:40.444] Build status: STARTED
[00:07:40.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:21:0) after 4m43s
[00:12:24.088] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:21:0)
[00:12:24.138] Build status: STARTED
[00:12:24.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:22:0) after 1m56s
[00:14:21.424] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:22:0)
[00:14:21.455] Build status: STARTED
[00:14:21.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:23:0) after 6m15s
[00:20:36.846] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:23:0)
[00:20:36.947] Build status: STARTED
[00:20:36.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:24:0) after 8m12s
[00:28:49.067] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:24:0)
[00:28:49.097] Build status: STARTED
[00:28:49.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:25:0) after 3m57s
[00:32:46.207] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:25:0)
[00:32:46.238] Build status: STARTED
[00:32:46.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:26:0) after 4m11s
[00:36:57.456] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:26:0)
[00:36:57.493] Build status: STARTED
[00:36:57.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:27:0) after 6m36s
[00:43:33.514] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:27:0)
[00:43:33.542] Build status: STARTED
[00:43:33.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:28:0) after 9m44s
[00:53:17.591] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:28:0)
[00:53:17.621] Build status: STARTED
[00:53:17.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:29:0) after 8m2s
[01:01:19.641] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:29:0)
[01:01:19.670] Build status: STARTED
[01:01:19.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:30:0) after 6m38s
[01:07:57.689] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:30:0)
[01:07:57.716] Build status: STARTED
[01:07:57.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:31:0) after 4m10s
[01:12:07.737] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:31:0)
[01:12:07.769] Build status: STARTED
[01:12:07.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:32:0) after 8m14s
[01:20:21.879] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:32:0)
[01:20:21.907] Build status: STARTED
[01:20:21.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:33:0) after 9m57s
[01:30:18.936] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:33:0)
[01:30:19.001] Build status: STARTED
[01:30:19.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:34:0) after 9m45s
[01:40:04.133] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:34:0)
[01:40:04.162] Build status: STARTED
[01:40:04.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:35:0) after 8m19s
[01:48:23.180] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:35:0)
[01:48:23.208] Build status: STARTED
[01:48:23.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:36:0) after 4m49s
[01:53:12.205] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:36:0)
[01:53:12.247] Build status: STARTED
[01:53:12.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:37:0) after 4m13s
[01:57:25.242] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:37:0)
[01:57:25.271] Build status: STARTED
[01:57:25.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:38:0) after 2m6s
[01:59:31.265] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:38:0)
[01:59:31.300] Build status: STARTED
[01:59:31.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:39:0) after 4m15s
[02:03:46.354] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:39:0)
[02:03:46.395] Build status: STARTED
[02:03:46.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:40:0) after 6m56s
[02:10:42.423] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:40:0)
[02:10:42.458] Build status: STARTED
[02:10:42.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:41:0) after 1m29s
[02:12:11.478] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:41:0)
[02:12:11.506] Build status: STARTED
[02:12:11.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:42:0) after 8m14s
[02:20:25.526] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:42:0)
[02:20:25.571] Build status: STARTED
[02:20:25.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:43:0) after 8m20s
[02:28:45.695] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:43:0)
[02:28:45.820] Build status: STARTED
[02:28:45.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:44:0) after 2m56s
[02:31:42.062] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:44:0)
[02:31:42.095] Build status: STARTED
[02:31:42.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:45:0) after 1m42s
[02:33:24.175] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:45:0)
[02:33:24.205] Build status: STARTED
[02:33:24.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:46:0) after 2m53s
[02:36:17.257] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:46:0)
[02:36:17.294] Build status: STARTED
[02:36:17.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:47:0) after 8m6s
[02:44:23.298] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:47:0)
[02:44:23.327] Build status: STARTED
[02:44:23.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:48:0) after 7m20s
[02:51:43.352] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:48:0)
[02:51:43.386] Build status: STARTED
[02:51:43.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:49:0) after 1m40s
[02:53:23.407] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:49:0)
[02:53:23.439] Build status: STARTED
[02:53:23.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:50:0) after 3m50s
[02:57:13.489] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:50:0)
[02:57:13.551] Build status: STARTED
[02:57:13.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:51:0) after 4m46s
[03:01:59.890] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:51:0)
[03:01:59.925] Build status: STARTED
[03:01:59.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:52:0) after 9m30s
[03:11:29.955] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:52:0)
[03:11:29.992] Build status: STARTED
[03:11:29.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:53:0) after 7m43s
[03:19:13.012] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:53:0)
[03:19:13.085] Build status: STARTED
[03:19:13.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:54:0) after 9m25s
[03:28:38.234] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:54:0)
[03:28:38.287] Build status: STARTED
[03:28:38.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:55:0) after 8m52s
[03:37:30.389] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:55:0)
[03:37:30.420] Build status: STARTED
[03:37:30.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8998516478421977680:56:0) after 7m25s
[03:38:50.318] Received PubSub notification, asking Buildbucket for the build status
[03:38:50.392] Build:
{
"id": "8833086416402134305",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23367,
"createdBy": "project:chromium",
"createTime": "2021-10-17T22:22:52.288985498Z",
"startTime": "2021-10-17T22:25:06.706998Z",
"endTime": "2021-10-18T03:38:49.905010647Z",
"updateTime": "2021-10-18T03:38:49.905462792Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "937e86ac01037ba367f0b52437bf0224e002f366",
"ref": "refs/heads/main"
}
}
}
[03:38:50.392] Invocation finished in 5h15m59.414484811s with status FAILED