[22:25:49.561] New invocation is queued and will start shortly
[22:25:50.665] Starting the invocation (attempt 1)
[22:25:50.692] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/bd140e2da6d54f1b3204c22565483155d43b23a6"
[22:25:50.692] Popped gitiles commit info from properties and tags
[22:25:50.692] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:25:50.692] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:25:50.692] Buildbucket request:
{
"requestId": "8937091547950527920",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bd140e2da6d54f1b3204c22565483155d43b23a6",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8937091547950527920"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:25:51.471] Scheduled build:
{
"id": "8771661486047234929",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30195,
"createdBy": "project:chromium",
"createTime": "2023-08-26T22:25:50.754743058Z",
"updateTime": "2023-08-26T22:25:50.754743058Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bd140e2da6d54f1b3204c22565483155d43b23a6",
"ref": "refs/heads/main"
}
}
}
[22:25:51.471] Task URL: https://cr-buildbucket.appspot.com/build/8771661486047234929
[22:25:51.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:2:0) after 6m15s
[22:25:52.208] Received PubSub notification, asking Buildbucket for the build status
[22:25:52.256] Build status: SCHEDULED
[22:29:12.381] Received PubSub notification, asking Buildbucket for the build status
[22:29:12.410] Build status: STARTED
[22:32:06.522] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:2:0)
[22:32:06.544] Build status: STARTED
[22:32:06.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:5:0) after 1m25s
[22:33:31.899] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:5:0)
[22:33:31.919] Build status: STARTED
[22:33:31.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:6:0) after 8m34s
[22:42:06.017] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:6:0)
[22:42:06.051] Build status: STARTED
[22:42:06.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:7:0) after 9m8s
[22:51:14.910] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:7:0)
[22:51:14.931] Build status: STARTED
[22:51:14.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:8:0) after 9m35s
[23:00:49.975] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:8:0)
[23:00:50.105] Build status: STARTED
[23:00:50.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:9:0) after 8m24s
[23:09:14.199] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:9:0)
[23:09:14.225] Build status: STARTED
[23:09:14.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:10:0) after 7m2s
[23:16:16.297] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:10:0)
[23:16:16.319] Build status: STARTED
[23:16:16.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:11:0) after 9m46s
[23:26:02.333] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:11:0)
[23:26:02.356] Build status: STARTED
[23:26:02.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:12:0) after 5m17s
[23:31:19.588] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:12:0)
[23:31:19.609] Build status: STARTED
[23:31:19.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:13:0) after 8m4s
[23:39:23.950] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:13:0)
[23:39:23.976] Build status: STARTED
[23:39:23.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:14:0) after 4m27s
[23:43:51.291] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:14:0)
[23:43:51.307] Build status: STARTED
[23:43:51.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:15:0) after 2m14s
[23:46:05.521] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:15:0)
[23:46:05.538] Build status: STARTED
[23:46:05.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:16:0) after 7m26s
[23:53:31.754] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:16:0)
[23:53:31.771] Build status: STARTED
[23:53:31.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:17:0) after 2m13s
[23:55:45.671] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:17:0)
[23:55:45.691] Build status: STARTED
[23:55:45.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:18:0) after 2m5s
[23:57:51.057] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:18:0)
[23:57:51.076] Build status: STARTED
[23:57:51.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:19:0) after 7m32s
[00:05:23.104] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:19:0)
[00:05:23.124] Build status: STARTED
[00:05:23.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:20:0) after 9m24s
[00:14:47.141] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:20:0)
[00:14:47.165] Build status: STARTED
[00:14:47.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:21:0) after 9m29s
[00:24:16.202] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:21:0)
[00:24:16.255] Build status: STARTED
[00:24:16.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:22:0) after 4m28s
[00:28:44.272] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:22:0)
[00:28:44.297] Build status: STARTED
[00:28:44.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:23:0) after 9m23s
[00:38:07.546] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:23:0)
[00:38:07.566] Build status: STARTED
[00:38:07.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:24:0) after 2m47s
[00:40:54.629] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:24:0)
[00:40:54.647] Build status: STARTED
[00:40:54.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:25:0) after 2m45s
[00:43:39.676] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:25:0)
[00:43:39.693] Build status: STARTED
[00:43:39.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:26:0) after 2m2s
[00:45:41.711] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:26:0)
[00:45:41.744] Build status: STARTED
[00:45:41.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:27:0) after 1m1s
[00:46:42.769] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:27:0)
[00:46:42.847] Build status: STARTED
[00:46:42.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:28:0) after 2m36s
[00:49:18.874] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:28:0)
[00:49:18.893] Build status: STARTED
[00:49:18.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:29:0) after 2m36s
[00:51:54.966] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:29:0)
[00:51:54.988] Build status: STARTED
[00:51:54.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:30:0) after 3m44s
[00:55:39.004] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:30:0)
[00:55:39.022] Build status: STARTED
[00:55:39.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:31:0) after 4m16s
[00:59:55.138] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:31:0)
[00:59:55.170] Build status: STARTED
[00:59:55.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:32:0) after 4m10s
[01:04:05.234] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:32:0)
[01:04:05.260] Build status: STARTED
[01:04:05.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:33:0) after 8m15s
[01:12:20.227] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:33:0)
[01:12:20.262] Build status: STARTED
[01:12:20.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:34:0) after 1m4s
[01:13:24.699] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:34:0)
[01:13:24.719] Build status: STARTED
[01:13:24.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:35:0) after 3m39s
[01:17:05.173] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:35:0)
[01:17:05.233] Build status: STARTED
[01:17:05.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:36:0) after 9m24s
[01:26:29.262] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:36:0)
[01:26:29.285] Build status: STARTED
[01:26:29.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:37:0) after 5m19s
[01:31:48.400] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:37:0)
[01:31:48.418] Build status: STARTED
[01:31:48.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:38:0) after 9m50s
[01:41:38.546] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:38:0)
[01:41:38.567] Build status: STARTED
[01:41:38.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:39:0) after 4m32s
[01:46:10.592] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:39:0)
[01:46:10.611] Build status: STARTED
[01:46:10.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:40:0) after 7m4s
[01:53:14.638] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:40:0)
[01:53:14.659] Build status: STARTED
[01:53:14.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:41:0) after 8m24s
[02:01:38.780] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:41:0)
[02:01:38.800] Build status: STARTED
[02:01:38.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:42:0) after 3m5s
[02:04:43.814] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:42:0)
[02:04:43.835] Build status: STARTED
[02:04:43.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:43:0) after 1m28s
[02:06:11.861] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:43:0)
[02:06:11.878] Build status: STARTED
[02:06:11.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:44:0) after 9m41s
[02:15:52.894] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:44:0)
[02:15:52.912] Build status: STARTED
[02:15:52.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:45:0) after 5m39s
[02:21:31.928] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:45:0)
[02:21:31.950] Build status: STARTED
[02:21:31.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:46:0) after 6m57s
[02:28:28.972] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:46:0)
[02:28:28.995] Build status: STARTED
[02:28:28.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:47:0) after 4m37s
[02:33:06.018] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:47:0)
[02:33:06.059] Build status: STARTED
[02:33:06.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:48:0) after 3m53s
[02:36:59.280] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:48:0)
[02:36:59.307] Build status: STARTED
[02:36:59.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:49:0) after 8m52s
[02:45:51.346] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:49:0)
[02:45:51.368] Build status: STARTED
[02:45:51.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:50:0) after 6m21s
[02:52:12.384] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:50:0)
[02:52:12.406] Build status: STARTED
[02:52:12.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:51:0) after 6m3s
[02:58:15.569] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:51:0)
[02:58:15.590] Build status: STARTED
[02:58:15.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:52:0) after 8m43s
[03:06:58.606] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:52:0)
[03:06:58.655] Build status: STARTED
[03:06:58.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:53:0) after 9m48s
[03:16:46.686] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:53:0)
[03:16:46.704] Build status: STARTED
[03:16:46.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:54:0) after 2m41s
[03:19:27.721] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:54:0)
[03:19:27.739] Build status: STARTED
[03:19:27.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:55:0) after 2m12s
[03:21:39.754] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:55:0)
[03:21:39.777] Build status: STARTED
[03:21:39.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:56:0) after 8m48s
[03:30:27.788] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:56:0)
[03:30:27.832] Build status: STARTED
[03:30:27.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:57:0) after 9m1s
[03:39:29.061] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:57:0)
[03:39:29.095] Build status: STARTED
[03:39:29.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:58:0) after 5m7s
[03:44:36.112] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:58:0)
[03:44:36.133] Build status: STARTED
[03:44:36.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:59:0) after 1m29s
[03:46:05.155] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:59:0)
[03:46:05.216] Build status: STARTED
[03:46:05.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:60:0) after 1m54s
[03:47:59.245] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:60:0)
[03:47:59.265] Build status: STARTED
[03:47:59.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:61:0) after 8m16s
[03:56:15.420] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:61:0)
[03:56:15.514] Build status: STARTED
[03:56:15.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:62:0) after 3m47s
[04:00:02.677] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:62:0)
[04:00:02.707] Build status: STARTED
[04:00:02.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:63:0) after 1m32s
[04:01:34.878] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:63:0)
[04:01:34.911] Build status: STARTED
[04:01:34.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:64:0) after 2m2s
[04:03:37.118] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:64:0)
[04:03:37.142] Build status: STARTED
[04:03:37.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:65:0) after 9m45s
[04:13:22.160] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:65:0)
[04:13:22.182] Build status: STARTED
[04:13:22.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8937091547950527920:66:0) after 5m11s
[04:13:49.524] Received PubSub notification, asking Buildbucket for the build status
[04:13:49.560] Build:
{
"id": "8771661486047234929",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30195,
"createdBy": "project:chromium",
"createTime": "2023-08-26T22:25:50.754743058Z",
"startTime": "2023-08-26T22:29:11.688568Z",
"endTime": "2023-08-27T04:13:49.298535095Z",
"updateTime": "2023-08-27T04:13:49.298535095Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bd140e2da6d54f1b3204c22565483155d43b23a6",
"ref": "refs/heads/main"
}
}
}
[04:13:49.560] Invocation finished in 5h48m0.004852741s with status FAILED