[20:37:56.278] New invocation is queued and will start shortly
[20:37:57.416] Starting the invocation (attempt 1)
[20:37:57.442] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f83007f582c5e362befa9c6abb7c8aa53463762a"
[20:37:57.442] Popped gitiles commit info from properties and tags
[20:37:57.442] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:37:57.442] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:37:57.442] Buildbucket request:
{
"requestId": "8942081168835186048",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f83007f582c5e362befa9c6abb7c8aa53463762a",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8942081168835186048"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:37:57.822] Scheduled build:
{
"id": "8776651106905194865",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29854,
"createdBy": "project:chromium",
"createTime": "2023-07-02T20:37:57.494001067Z",
"updateTime": "2023-07-02T20:37:57.494001067Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f83007f582c5e362befa9c6abb7c8aa53463762a",
"ref": "refs/heads/main"
}
}
}
[20:37:57.822] Task URL: https://cr-buildbucket.appspot.com/build/8776651106905194865
[20:37:57.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:2:0) after 1m45s
[20:39:42.862] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:2:0)
[20:39:42.879] Build status: SCHEDULED
[20:39:42.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:3:0) after 4m45s
[20:41:25.855] Received PubSub notification, asking Buildbucket for the build status
[20:41:25.874] Build status: STARTED
[20:44:27.897] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:3:0)
[20:44:27.916] Build status: STARTED
[20:44:27.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:5:0) after 4m25s
[20:48:52.936] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:5:0)
[20:48:52.957] Build status: STARTED
[20:48:52.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:6:0) after 6m46s
[20:55:39.043] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:6:0)
[20:55:39.067] Build status: STARTED
[20:55:39.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:7:0) after 3m13s
[20:58:52.083] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:7:0)
[20:58:52.113] Build status: STARTED
[20:58:52.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:8:0) after 9m34s
[21:08:26.136] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:8:0)
[21:08:26.161] Build status: STARTED
[21:08:26.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:9:0) after 3m22s
[21:11:48.184] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:9:0)
[21:11:48.209] Build status: STARTED
[21:11:48.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:10:0) after 6m55s
[21:18:43.229] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:10:0)
[21:18:43.250] Build status: STARTED
[21:18:43.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:11:0) after 7m32s
[21:26:15.269] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:11:0)
[21:26:15.287] Build status: STARTED
[21:26:15.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:12:0) after 5m54s
[21:32:09.301] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:12:0)
[21:32:09.403] Build status: STARTED
[21:32:09.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:13:0) after 3m31s
[21:35:40.420] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:13:0)
[21:35:40.435] Build status: STARTED
[21:35:40.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:14:0) after 8m12s
[21:43:52.557] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:14:0)
[21:43:52.571] Build status: STARTED
[21:43:52.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:15:0) after 3m1s
[21:46:53.585] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:15:0)
[21:46:53.768] Build status: STARTED
[21:46:53.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:16:0) after 7m50s
[21:54:43.783] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:16:0)
[21:54:43.798] Build status: STARTED
[21:54:43.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:17:0) after 6m59s
[22:01:42.829] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:17:0)
[22:01:42.855] Build status: STARTED
[22:01:42.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:18:0) after 9m22s
[22:11:04.988] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:18:0)
[22:11:05.051] Build status: STARTED
[22:11:05.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:19:0) after 2m37s
[22:13:42.268] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:19:0)
[22:13:42.290] Build status: STARTED
[22:13:42.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:20:0) after 4m59s
[22:18:41.305] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:20:0)
[22:18:41.322] Build status: STARTED
[22:18:41.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:21:0) after 8m24s
[22:27:05.506] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:21:0)
[22:27:05.524] Build status: STARTED
[22:27:05.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:22:0) after 4m26s
[22:31:31.763] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:22:0)
[22:31:31.783] Build status: STARTED
[22:31:31.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:23:0) after 1m38s
[22:33:09.798] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:23:0)
[22:33:09.818] Build status: STARTED
[22:33:09.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:24:0) after 9m22s
[22:42:31.894] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:24:0)
[22:42:31.945] Build status: STARTED
[22:42:31.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:25:0) after 2m32s
[22:45:04.145] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:25:0)
[22:45:04.169] Build status: STARTED
[22:45:04.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:26:0) after 7m23s
[22:52:27.196] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:26:0)
[22:52:27.215] Build status: STARTED
[22:52:27.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:27:0) after 6m32s
[22:58:59.234] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:27:0)
[22:58:59.253] Build status: STARTED
[22:58:59.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:28:0) after 3m4s
[23:02:03.238] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:28:0)
[23:02:03.261] Build status: STARTED
[23:02:03.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:29:0) after 3m34s
[23:05:37.459] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:29:0)
[23:05:37.499] Build status: STARTED
[23:05:37.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:30:0) after 9m56s
[23:15:33.738] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:30:0)
[23:15:33.753] Build status: STARTED
[23:15:33.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:31:0) after 8m35s
[23:24:09.304] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:31:0)
[23:24:09.322] Build status: STARTED
[23:24:09.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:32:0) after 9m24s
[23:33:33.337] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:32:0)
[23:33:33.386] Build status: STARTED
[23:33:33.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:33:0) after 4m29s
[23:38:02.946] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:33:0)
[23:38:02.963] Build status: STARTED
[23:38:02.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:34:0) after 1m15s
[23:39:18.440] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:34:0)
[23:39:18.458] Build status: STARTED
[23:39:18.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:35:0) after 4m45s
[23:44:03.474] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:35:0)
[23:44:03.498] Build status: STARTED
[23:44:03.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:36:0) after 8m53s
[23:52:56.547] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:36:0)
[23:52:56.571] Build status: STARTED
[23:52:56.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:37:0) after 8m4s
[00:01:00.660] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:37:0)
[00:01:00.682] Build status: STARTED
[00:01:00.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:38:0) after 1m40s
[00:02:40.704] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:38:0)
[00:02:40.806] Build status: STARTED
[00:02:40.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:39:0) after 8m59s
[00:11:39.840] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:39:0)
[00:11:39.860] Build status: STARTED
[00:11:39.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:40:0) after 6m53s
[00:18:32.827] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:40:0)
[00:18:32.852] Build status: STARTED
[00:18:32.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:41:0) after 3m2s
[00:21:34.867] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:41:0)
[00:21:34.907] Build status: STARTED
[00:21:34.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:42:0) after 7m35s
[00:29:09.981] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:42:0)
[00:29:10.004] Build status: STARTED
[00:29:10.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:43:0) after 3m44s
[00:32:54.066] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:43:0)
[00:32:54.139] Build status: STARTED
[00:32:54.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:44:0) after 9m3s
[00:41:57.377] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:44:0)
[00:41:57.394] Build status: STARTED
[00:41:57.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:45:0) after 1m39s
[00:43:36.834] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:45:0)
[00:43:36.855] Build status: STARTED
[00:43:36.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:46:0) after 5m41s
[00:49:17.871] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:46:0)
[00:49:17.891] Build status: STARTED
[00:49:17.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:47:0) after 3m22s
[00:52:39.919] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:47:0)
[00:52:39.937] Build status: STARTED
[00:52:39.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:48:0) after 2m35s
[00:55:14.953] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:48:0)
[00:55:14.970] Build status: STARTED
[00:55:14.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:49:0) after 6m46s
[01:02:01.044] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:49:0)
[01:02:01.123] Build status: STARTED
[01:02:01.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:50:0) after 6m17s
[01:08:18.250] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:50:0)
[01:08:18.274] Build status: STARTED
[01:08:18.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:51:0) after 3m19s
[01:11:37.289] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:51:0)
[01:11:37.307] Build status: STARTED
[01:11:37.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:52:0) after 7m50s
[01:19:27.443] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:52:0)
[01:19:27.462] Build status: STARTED
[01:19:27.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:53:0) after 1m43s
[01:21:10.473] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:53:0)
[01:21:10.490] Build status: STARTED
[01:21:10.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:54:0) after 5m9s
[01:26:19.521] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:54:0)
[01:26:19.543] Build status: STARTED
[01:26:19.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:55:0) after 5m28s
[01:31:47.657] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:55:0)
[01:31:47.674] Build status: STARTED
[01:31:47.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:56:0) after 2m25s
[01:34:12.685] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:56:0)
[01:34:12.707] Build status: STARTED
[01:34:12.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:57:0) after 1m2s
[01:35:14.778] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:57:0)
[01:35:14.804] Build status: STARTED
[01:35:14.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:58:0) after 5m28s
[01:40:42.872] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:58:0)
[01:40:42.892] Build status: STARTED
[01:40:42.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:59:0) after 5m50s
[01:46:33.005] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:59:0)
[01:46:33.027] Build status: STARTED
[01:46:33.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:60:0) after 7m44s
[01:54:17.118] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:60:0)
[01:54:17.203] Build status: STARTED
[01:54:17.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:61:0) after 3m31s
[01:57:48.224] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:61:0)
[01:57:48.242] Build status: STARTED
[01:57:48.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:62:0) after 3m56s
[02:01:44.434] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:62:0)
[02:01:44.449] Build status: STARTED
[02:01:44.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:63:0) after 9m41s
[02:11:25.524] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:63:0)
[02:11:25.541] Build status: STARTED
[02:11:25.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:64:0) after 3m21s
[02:14:46.559] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:64:0)
[02:14:46.573] Build status: STARTED
[02:14:46.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942081168835186048:65:0) after 2m46s
[02:17:10.981] Received PubSub notification, asking Buildbucket for the build status
[02:17:11.009] Build:
{
"id": "8776651106905194865",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29854,
"createdBy": "project:chromium",
"createTime": "2023-07-02T20:37:57.494001067Z",
"startTime": "2023-07-02T20:41:24.510449Z",
"endTime": "2023-07-03T02:16:59.549234756Z",
"updateTime": "2023-07-03T02:16:59.549234756Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f83007f582c5e362befa9c6abb7c8aa53463762a",
"ref": "refs/heads/main"
}
}
}
[02:17:11.009] Invocation finished in 5h39m14.740495343s with status FAILED