[23:00:10.504] New invocation is queued and will start shortly
[23:00:11.604] Starting the invocation (attempt 1)
[23:00:11.671] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/7e650a5a28936cfe05fe9231614f056fd011bc12"
[23:00:11.671] Popped gitiles commit info from properties and tags
[23:00:11.671] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:00:11.671] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:00:11.671] Buildbucket request:
{
"requestId": "9001322636084083392",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7e650a5a28936cfe05fe9231614f056fd011bc12",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9001322636084083392"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:00:12.239] Scheduled build:
{
"id": "8835892574096512209",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23101,
"createdBy": "project:chromium",
"createTime": "2021-09-16T23:00:11.767209276Z",
"updateTime": "2021-09-16T23:00:12.059331753Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7e650a5a28936cfe05fe9231614f056fd011bc12",
"ref": "refs/heads/main"
}
}
}
[23:00:12.239] Task URL: https://cr-buildbucket.appspot.com/build/8835892574096512209
[23:00:12.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:2:0) after 3m24s
[23:02:41.898] Received PubSub notification, asking Buildbucket for the build status
[23:02:41.936] Build status: STARTED
[23:03:36.361] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:2:0)
[23:03:36.406] Build status: STARTED
[23:03:36.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:4:0) after 9m49s
[23:13:25.584] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:4:0)
[23:13:25.623] Build status: STARTED
[23:13:25.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:5:0) after 1m53s
[23:15:18.645] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:5:0)
[23:15:18.676] Build status: STARTED
[23:15:18.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:6:0) after 6m36s
[23:21:54.850] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:6:0)
[23:21:54.882] Build status: STARTED
[23:21:54.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:7:0) after 7m44s
[23:29:38.886] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:7:0)
[23:29:38.923] Build status: STARTED
[23:29:38.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:8:0) after 2m28s
[23:32:06.951] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:8:0)
[23:32:06.984] Build status: STARTED
[23:32:06.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:9:0) after 6m12s
[23:38:19.140] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:9:0)
[23:38:19.165] Build status: STARTED
[23:38:19.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:10:0) after 8m30s
[23:46:49.334] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:10:0)
[23:46:49.361] Build status: STARTED
[23:46:49.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:11:0) after 5m39s
[23:52:28.389] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:11:0)
[23:52:28.420] Build status: STARTED
[23:52:28.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:12:0) after 7m42s
[00:00:10.720] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:12:0)
[00:00:10.754] Build status: STARTED
[00:00:10.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:13:0) after 5m50s
[00:06:01.038] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:13:0)
[00:06:01.312] Build status: STARTED
[00:06:01.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:14:0) after 3m6s
[00:09:07.637] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:14:0)
[00:09:07.670] Build status: STARTED
[00:09:07.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:15:0) after 8m21s
[00:17:28.701] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:15:0)
[00:17:28.796] Build status: STARTED
[00:17:28.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:16:0) after 2m1s
[00:19:29.977] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:16:0)
[00:19:30.028] Build status: STARTED
[00:19:30.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:17:0) after 1m51s
[00:21:21.116] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:17:0)
[00:21:21.150] Build status: STARTED
[00:21:21.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:18:0) after 8m41s
[00:30:02.638] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:18:0)
[00:30:02.677] Build status: STARTED
[00:30:02.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:19:0) after 4m23s
[00:34:25.803] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:19:0)
[00:34:25.881] Build status: STARTED
[00:34:25.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:20:0) after 2m41s
[00:37:07.181] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:20:0)
[00:37:07.212] Build status: STARTED
[00:37:07.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:21:0) after 2m16s
[00:39:23.699] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:21:0)
[00:39:23.736] Build status: STARTED
[00:39:23.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:22:0) after 6m35s
[00:45:58.773] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:22:0)
[00:45:58.805] Build status: STARTED
[00:45:58.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:23:0) after 9m20s
[00:55:19.175] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:23:0)
[00:55:19.213] Build status: STARTED
[00:55:19.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:24:0) after 6m15s
[01:01:34.289] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:24:0)
[01:01:34.318] Build status: STARTED
[01:01:34.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:25:0) after 1m51s
[01:03:25.307] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:25:0)
[01:03:25.362] Build status: STARTED
[01:03:25.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:26:0) after 2m19s
[01:05:44.563] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:26:0)
[01:05:44.610] Build status: STARTED
[01:05:44.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:27:0) after 2m58s
[01:08:43.397] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:27:0)
[01:08:43.431] Build status: STARTED
[01:08:43.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:28:0) after 5m22s
[01:14:05.463] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:28:0)
[01:14:05.498] Build status: STARTED
[01:14:05.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:29:0) after 8m32s
[01:22:37.530] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:29:0)
[01:22:37.562] Build status: STARTED
[01:22:37.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:30:0) after 6m11s
[01:28:48.587] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:30:0)
[01:28:48.621] Build status: STARTED
[01:28:48.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:31:0) after 5m9s
[01:33:57.677] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:31:0)
[01:33:57.710] Build status: STARTED
[01:33:57.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:32:0) after 8m31s
[01:42:28.742] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:32:0)
[01:42:28.775] Build status: STARTED
[01:42:28.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:33:0) after 2m34s
[01:45:02.818] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:33:0)
[01:45:02.879] Build status: STARTED
[01:45:02.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:34:0) after 1m19s
[01:46:22.236] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:34:0)
[01:46:22.272] Build status: STARTED
[01:46:22.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:35:0) after 7m21s
[01:53:43.405] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:35:0)
[01:53:43.438] Build status: STARTED
[01:53:43.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:36:0) after 1m0s
[01:54:43.500] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:36:0)
[01:54:43.542] Build status: STARTED
[01:54:43.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:37:0) after 6m40s
[02:01:23.613] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:37:0)
[02:01:23.656] Build status: STARTED
[02:01:23.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:38:0) after 7m25s
[02:08:48.790] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:38:0)
[02:08:48.830] Build status: STARTED
[02:08:48.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:39:0) after 5m24s
[02:14:12.867] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:39:0)
[02:14:12.905] Build status: STARTED
[02:14:12.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:40:0) after 6m12s
[02:20:25.032] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:40:0)
[02:20:25.075] Build status: STARTED
[02:20:25.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:41:0) after 3m17s
[02:23:42.493] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:41:0)
[02:23:42.523] Build status: STARTED
[02:23:42.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:42:0) after 3m51s
[02:27:33.587] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:42:0)
[02:27:33.623] Build status: STARTED
[02:27:33.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:43:0) after 5m39s
[02:33:12.780] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:43:0)
[02:33:12.807] Build status: STARTED
[02:33:12.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:44:0) after 4m31s
[02:37:43.859] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:44:0)
[02:37:43.892] Build status: STARTED
[02:37:43.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:45:0) after 6m4s
[02:43:47.935] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:45:0)
[02:43:47.970] Build status: STARTED
[02:43:47.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:46:0) after 4m44s
[02:48:32.016] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:46:0)
[02:48:32.049] Build status: STARTED
[02:48:32.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:47:0) after 7m59s
[02:56:31.324] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:47:0)
[02:56:31.360] Build status: STARTED
[02:56:31.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:48:0) after 8m2s
[03:04:33.385] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:48:0)
[03:04:33.418] Build status: STARTED
[03:04:33.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:49:0) after 5m5s
[03:09:38.461] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:49:0)
[03:09:38.505] Build status: STARTED
[03:09:38.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:50:0) after 2m44s
[03:12:22.547] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:50:0)
[03:12:22.624] Build status: STARTED
[03:12:22.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:51:0) after 7m44s
[03:20:07.327] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:51:0)
[03:20:07.365] Build status: STARTED
[03:20:07.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:52:0) after 7m22s
[03:27:29.397] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:52:0)
[03:27:29.427] Build status: STARTED
[03:27:29.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:53:0) after 5m39s
[03:33:08.494] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:53:0)
[03:33:08.527] Build status: STARTED
[03:33:08.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:54:0) after 7m24s
[03:40:32.554] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:54:0)
[03:40:32.589] Build status: STARTED
[03:40:32.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:55:0) after 7m57s
[03:48:29.718] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:55:0)
[03:48:29.746] Build status: STARTED
[03:48:29.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:56:0) after 5m10s
[03:53:40.109] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:56:0)
[03:53:40.137] Build status: STARTED
[03:53:40.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:57:0) after 5m30s
[03:59:10.169] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:57:0)
[03:59:10.204] Build status: STARTED
[03:59:10.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:58:0) after 4m45s
[04:03:55.399] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:58:0)
[04:03:55.432] Build status: STARTED
[04:03:55.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:59:0) after 5m34s
[04:09:29.466] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:59:0)
[04:09:29.503] Build status: STARTED
[04:09:29.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:60:0) after 2m2s
[04:11:31.771] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:60:0)
[04:11:31.814] Build status: STARTED
[04:11:31.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:61:0) after 3m49s
[04:15:20.839] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:61:0)
[04:15:20.891] Build status: STARTED
[04:15:20.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:62:0) after 7m7s
[04:22:27.917] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:62:0)
[04:22:27.954] Build status: STARTED
[04:22:27.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:63:0) after 3m27s
[04:25:55.057] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:63:0)
[04:25:55.092] Build status: STARTED
[04:25:55.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:64:0) after 8m32s
[04:34:27.124] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:64:0)
[04:34:27.181] Build status: STARTED
[04:34:27.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001322636084083392:65:0) after 8m5s
[04:37:34.049] Received PubSub notification, asking Buildbucket for the build status
[04:37:34.087] Build:
{
"id": "8835892574096512209",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23101,
"createdBy": "project:chromium",
"createTime": "2021-09-16T23:00:11.767209276Z",
"startTime": "2021-09-16T23:02:40.874284Z",
"endTime": "2021-09-17T04:37:33.687090872Z",
"updateTime": "2021-09-17T04:37:33.688578013Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7e650a5a28936cfe05fe9231614f056fd011bc12",
"ref": "refs/heads/main"
}
}
}
[04:37:34.088] Invocation finished in 5h37m23.599868166s with status FAILED