[08:25:44.115] New invocation is queued and will start shortly
[08:25:45.294] Starting the invocation (attempt 1)
[08:25:45.330] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d4953f975562804bc496bf49ab80def5b37464d3"
[08:25:45.330] Popped gitiles commit info from properties and tags
[08:25:45.330] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:25:45.330] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:25:45.330] Buildbucket request:
{
"requestId": "9001468248056313824",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d4953f975562804bc496bf49ab80def5b37464d3",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9001468248056313824"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:25:45.848] Scheduled build:
{
"id": "8836038186044615969",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23094,
"createdBy": "project:chromium",
"createTime": "2021-09-15T08:25:45.392879556Z",
"updateTime": "2021-09-15T08:25:45.646292076Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d4953f975562804bc496bf49ab80def5b37464d3",
"ref": "refs/heads/main"
}
}
}
[08:25:45.848] Task URL: https://cr-buildbucket.appspot.com/build/8836038186044615969
[08:25:45.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:2:0) after 3m33s
[08:28:13.331] Received PubSub notification, asking Buildbucket for the build status
[08:28:13.366] Build status: STARTED
[08:29:18.888] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:2:0)
[08:29:18.915] Build status: STARTED
[08:29:18.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:4:0) after 3m4s
[08:32:23.075] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:4:0)
[08:32:23.112] Build status: STARTED
[08:32:23.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:5:0) after 7m30s
[08:39:53.234] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:5:0)
[08:39:53.266] Build status: STARTED
[08:39:53.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:6:0) after 3m4s
[08:42:57.322] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:6:0)
[08:42:57.356] Build status: STARTED
[08:42:57.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:7:0) after 3m50s
[08:46:47.380] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:7:0)
[08:46:47.411] Build status: STARTED
[08:46:47.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:8:0) after 2m0s
[08:48:47.431] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:8:0)
[08:48:47.463] Build status: STARTED
[08:48:47.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:9:0) after 7m30s
[08:56:17.483] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:9:0)
[08:56:17.513] Build status: STARTED
[08:56:17.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:10:0) after 7m12s
[09:03:29.777] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:10:0)
[09:03:29.806] Build status: STARTED
[09:03:29.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:11:0) after 6m3s
[09:09:32.812] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:11:0)
[09:09:32.842] Build status: STARTED
[09:09:32.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:12:0) after 2m53s
[09:12:25.871] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:12:0)
[09:12:25.988] Build status: STARTED
[09:12:25.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:13:0) after 8m9s
[09:20:35.010] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:13:0)
[09:20:35.038] Build status: STARTED
[09:20:35.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:14:0) after 5m32s
[09:26:07.019] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:14:0)
[09:26:07.502] Build status: STARTED
[09:26:07.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:15:0) after 9m48s
[09:35:55.611] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:15:0)
[09:35:55.639] Build status: STARTED
[09:35:55.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:16:0) after 2m18s
[09:38:13.829] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:16:0)
[09:38:13.862] Build status: STARTED
[09:38:13.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:17:0) after 8m14s
[09:46:28.101] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:17:0)
[09:46:28.130] Build status: STARTED
[09:46:28.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:18:0) after 9m37s
[09:56:05.151] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:18:0)
[09:56:05.185] Build status: STARTED
[09:56:05.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:19:0) after 8m10s
[10:04:15.356] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:19:0)
[10:04:15.419] Build status: STARTED
[10:04:15.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:20:0) after 2m54s
[10:07:09.451] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:20:0)
[10:07:09.519] Build status: STARTED
[10:07:09.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:21:0) after 1m1s
[10:08:10.539] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:21:0)
[10:08:10.598] Build status: STARTED
[10:08:10.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:22:0) after 5m17s
[10:13:27.628] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:22:0)
[10:13:27.669] Build status: STARTED
[10:13:27.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:23:0) after 6m7s
[10:19:34.692] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:23:0)
[10:19:34.870] Build status: STARTED
[10:19:34.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:24:0) after 6m47s
[10:26:22.026] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:24:0)
[10:26:22.096] Build status: STARTED
[10:26:22.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:25:0) after 8m55s
[10:35:17.181] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:25:0)
[10:35:17.217] Build status: STARTED
[10:35:17.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:26:0) after 1m19s
[10:36:36.238] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:26:0)
[10:36:36.269] Build status: STARTED
[10:36:36.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:27:0) after 3m21s
[10:39:57.297] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:27:0)
[10:39:57.328] Build status: STARTED
[10:39:57.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:28:0) after 7m11s
[10:47:08.366] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:28:0)
[10:47:08.402] Build status: STARTED
[10:47:08.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:29:0) after 8m29s
[10:55:37.694] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:29:0)
[10:55:37.722] Build status: STARTED
[10:55:37.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:30:0) after 4m12s
[10:59:49.838] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:30:0)
[10:59:49.946] Build status: STARTED
[10:59:49.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:31:0) after 5m9s
[11:04:59.019] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:31:0)
[11:04:59.053] Build status: STARTED
[11:04:59.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:32:0) after 9m17s
[11:14:16.077] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:32:0)
[11:14:16.117] Build status: STARTED
[11:14:16.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:33:0) after 2m3s
[11:16:19.138] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:33:0)
[11:16:19.222] Build status: STARTED
[11:16:19.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:34:0) after 6m53s
[11:23:12.328] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:34:0)
[11:23:12.406] Build status: STARTED
[11:23:12.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:35:0) after 9m9s
[11:32:21.457] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:35:0)
[11:32:21.495] Build status: STARTED
[11:32:21.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:36:0) after 8m45s
[11:41:06.591] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:36:0)
[11:41:06.658] Build status: STARTED
[11:41:06.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:37:0) after 9m1s
[11:50:07.754] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:37:0)
[11:50:07.802] Build status: STARTED
[11:50:07.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:38:0) after 7m16s
[11:57:23.902] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:38:0)
[11:57:23.941] Build status: STARTED
[11:57:23.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:39:0) after 5m47s
[12:03:11.078] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:39:0)
[12:03:11.115] Build status: STARTED
[12:03:11.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:40:0) after 3m22s
[12:06:33.321] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:40:0)
[12:06:33.362] Build status: STARTED
[12:06:33.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:41:0) after 8m5s
[12:14:38.383] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:41:0)
[12:14:38.418] Build status: STARTED
[12:14:38.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:42:0) after 3m28s
[12:18:06.761] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:42:0)
[12:18:06.801] Build status: STARTED
[12:18:06.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:43:0) after 9m11s
[12:27:17.822] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:43:0)
[12:27:17.853] Build status: STARTED
[12:27:17.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:44:0) after 2m17s
[12:29:34.877] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:44:0)
[12:29:34.937] Build status: STARTED
[12:29:34.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:45:0) after 9m21s
[12:38:55.968] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:45:0)
[12:38:56.046] Build status: STARTED
[12:38:56.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:46:0) after 1m41s
[12:40:37.284] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:46:0)
[12:40:37.396] Build status: STARTED
[12:40:37.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:47:0) after 7m18s
[12:47:55.607] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:47:0)
[12:47:55.644] Build status: STARTED
[12:47:55.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:48:0) after 1m4s
[12:48:59.668] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:48:0)
[12:48:59.700] Build status: STARTED
[12:48:59.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:49:0) after 3m41s
[12:52:40.763] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:49:0)
[12:52:40.805] Build status: STARTED
[12:52:40.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:50:0) after 7m36s
[13:00:16.832] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:50:0)
[13:00:16.885] Build status: STARTED
[13:00:16.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:51:0) after 9m5s
[13:09:22.187] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:51:0)
[13:09:22.239] Build status: STARTED
[13:09:22.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:52:0) after 4m28s
[13:13:50.356] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:52:0)
[13:13:50.466] Build status: STARTED
[13:13:50.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:53:0) after 4m39s
[13:18:29.488] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:53:0)
[13:18:29.518] Build status: STARTED
[13:18:29.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:54:0) after 7m22s
[13:25:51.536] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:54:0)
[13:25:51.601] Build status: STARTED
[13:25:51.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:55:0) after 2m58s
[13:28:49.871] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:55:0)
[13:28:49.919] Build status: STARTED
[13:28:49.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:56:0) after 2m42s
[13:31:31.939] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:56:0)
[13:31:31.973] Build status: STARTED
[13:31:31.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:57:0) after 3m45s
[13:35:17.098] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:57:0)
[13:35:17.145] Build status: STARTED
[13:35:17.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:58:0) after 3m18s
[13:38:35.491] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:58:0)
[13:38:35.521] Build status: STARTED
[13:38:35.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:59:0) after 3m55s
[13:42:30.542] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:59:0)
[13:42:30.584] Build status: STARTED
[13:42:30.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:60:0) after 8m55s
[13:51:25.608] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:60:0)
[13:51:25.638] Build status: STARTED
[13:51:25.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:61:0) after 1m15s
[13:52:40.784] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:61:0)
[13:52:40.816] Build status: STARTED
[13:52:40.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9001468248056313824:62:0) after 4m21s
[13:56:44.787] Received PubSub notification, asking Buildbucket for the build status
[13:56:44.815] Build:
{
"id": "8836038186044615969",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23094,
"createdBy": "project:chromium",
"createTime": "2021-09-15T08:25:45.392879556Z",
"startTime": "2021-09-15T08:28:11.904620Z",
"endTime": "2021-09-15T13:56:44.458612763Z",
"updateTime": "2021-09-15T13:56:44.459001897Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d4953f975562804bc496bf49ab80def5b37464d3",
"ref": "refs/heads/main"
}
}
}
[13:56:44.815] Invocation finished in 5h31m0.724307656s with status FAILED