[03:55:52.370] New invocation is queued and will start shortly
[03:55:53.514] Starting the invocation (attempt 1)
[03:55:53.545] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2fed9ec9c09b4d7a4db87de698a7f518e95fffe3"
[03:55:53.545] Popped gitiles commit info from properties and tags
[03:55:53.545] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:55:53.546] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:55:53.546] Buildbucket request:
{
"requestId": "8947761225245471568",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2fed9ec9c09b4d7a4db87de698a7f518e95fffe3",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8947761225245471568"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:55:53.939] Scheduled build:
{
"id": "8782331163274037937",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29338,
"createdBy": "project:chromium",
"createTime": "2023-05-01T03:55:53.619356041Z",
"updateTime": "2023-05-01T03:55:53.619356041Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2fed9ec9c09b4d7a4db87de698a7f518e95fffe3",
"ref": "refs/heads/main"
}
}
}
[03:55:53.939] Task URL: https://cr-buildbucket.appspot.com/build/8782331163274037937
[03:55:53.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:2:0) after 3m56s
[03:58:43.253] Received PubSub notification, asking Buildbucket for the build status
[03:58:43.291] Build status: STARTED
[03:59:49.957] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:2:0)
[03:59:49.973] Build status: STARTED
[03:59:49.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:4:0) after 2m59s
[04:02:48.990] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:4:0)
[04:02:49.010] Build status: STARTED
[04:02:49.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:5:0) after 6m28s
[04:09:17.061] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:5:0)
[04:09:17.081] Build status: STARTED
[04:09:17.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:6:0) after 2m34s
[04:11:51.291] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:6:0)
[04:11:51.409] Build status: STARTED
[04:11:51.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:7:0) after 6m9s
[04:18:00.436] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:7:0)
[04:18:00.458] Build status: STARTED
[04:18:00.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:8:0) after 3m41s
[04:21:41.435] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:8:0)
[04:21:41.456] Build status: STARTED
[04:21:41.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:9:0) after 4m32s
[04:26:13.481] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:9:0)
[04:26:13.501] Build status: STARTED
[04:26:13.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:10:0) after 1m35s
[04:27:48.534] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:10:0)
[04:27:48.561] Build status: STARTED
[04:27:48.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:11:0) after 4m6s
[04:31:54.590] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:11:0)
[04:31:54.619] Build status: STARTED
[04:31:54.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:12:0) after 7m25s
[04:39:19.736] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:12:0)
[04:39:19.753] Build status: STARTED
[04:39:19.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:13:0) after 7m25s
[04:46:44.770] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:13:0)
[04:46:44.785] Build status: STARTED
[04:46:44.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:14:0) after 5m32s
[04:52:16.839] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:14:0)
[04:52:16.862] Build status: STARTED
[04:52:16.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:15:0) after 6m26s
[04:58:42.960] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:15:0)
[04:58:42.979] Build status: STARTED
[04:58:42.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:16:0) after 5m46s
[05:04:29.138] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:16:0)
[05:04:29.156] Build status: STARTED
[05:04:29.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:17:0) after 2m53s
[05:07:22.386] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:17:0)
[05:07:22.406] Build status: STARTED
[05:07:22.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:18:0) after 6m25s
[05:13:47.401] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:18:0)
[05:13:47.424] Build status: STARTED
[05:13:47.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:19:0) after 9m44s
[05:23:31.441] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:19:0)
[05:23:31.460] Build status: STARTED
[05:23:31.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:20:0) after 2m39s
[05:26:10.612] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:20:0)
[05:26:10.627] Build status: STARTED
[05:26:10.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:21:0) after 2m52s
[05:29:02.751] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:21:0)
[05:29:02.769] Build status: STARTED
[05:29:02.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:22:0) after 2m48s
[05:31:51.083] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:22:0)
[05:31:51.104] Build status: STARTED
[05:31:51.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:23:0) after 3m2s
[05:34:53.123] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:23:0)
[05:34:53.139] Build status: STARTED
[05:34:53.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:24:0) after 9m30s
[05:44:23.164] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:24:0)
[05:44:23.215] Build status: STARTED
[05:44:23.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:25:0) after 9m16s
[05:53:39.235] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:25:0)
[05:53:39.256] Build status: STARTED
[05:53:39.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:26:0) after 8m55s
[06:02:34.417] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:26:0)
[06:02:34.437] Build status: STARTED
[06:02:34.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:27:0) after 3m55s
[06:06:29.463] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:27:0)
[06:06:29.480] Build status: STARTED
[06:06:29.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:28:0) after 9m30s
[06:15:59.500] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:28:0)
[06:15:59.526] Build status: STARTED
[06:15:59.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:29:0) after 8m37s
[06:24:36.643] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:29:0)
[06:24:36.662] Build status: STARTED
[06:24:36.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:30:0) after 9m32s
[06:34:08.705] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:30:0)
[06:34:08.726] Build status: STARTED
[06:34:08.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:31:0) after 6m16s
[06:40:24.755] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:31:0)
[06:40:24.775] Build status: STARTED
[06:40:24.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:32:0) after 4m2s
[06:44:26.803] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:32:0)
[06:44:26.824] Build status: STARTED
[06:44:26.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:33:0) after 5m54s
[06:50:21.009] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:33:0)
[06:50:21.051] Build status: STARTED
[06:50:21.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:34:0) after 7m2s
[06:57:23.025] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:34:0)
[06:57:23.082] Build status: STARTED
[06:57:23.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:35:0) after 6m52s
[07:04:15.132] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:35:0)
[07:04:15.204] Build status: STARTED
[07:04:15.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:36:0) after 7m23s
[07:11:38.237] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:36:0)
[07:11:38.254] Build status: STARTED
[07:11:38.254] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:37:0) after 2m21s
[07:13:59.309] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:37:0)
[07:13:59.327] Build status: STARTED
[07:13:59.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:38:0) after 3m17s
[07:17:16.379] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:38:0)
[07:17:16.432] Build status: STARTED
[07:17:16.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:39:0) after 5m19s
[07:22:35.535] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:39:0)
[07:22:35.559] Build status: STARTED
[07:22:35.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:40:0) after 6m52s
[07:29:27.578] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:40:0)
[07:29:27.604] Build status: STARTED
[07:29:27.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:41:0) after 4m52s
[07:34:19.626] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:41:0)
[07:34:19.650] Build status: STARTED
[07:34:19.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:42:0) after 4m26s
[07:38:45.828] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:42:0)
[07:38:45.848] Build status: STARTED
[07:38:45.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:43:0) after 1m24s
[07:40:09.856] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:43:0)
[07:40:09.875] Build status: STARTED
[07:40:09.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:44:0) after 8m5s
[07:48:14.893] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:44:0)
[07:48:14.916] Build status: STARTED
[07:48:14.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:45:0) after 7m24s
[07:55:39.037] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:45:0)
[07:55:39.055] Build status: STARTED
[07:55:39.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:46:0) after 2m1s
[07:57:40.128] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:46:0)
[07:57:40.147] Build status: STARTED
[07:57:40.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:47:0) after 2m34s
[08:00:14.175] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:47:0)
[08:00:14.232] Build status: STARTED
[08:00:14.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:48:0) after 5m58s
[08:06:12.266] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:48:0)
[08:06:12.291] Build status: STARTED
[08:06:12.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:49:0) after 7m39s
[08:13:51.488] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:49:0)
[08:13:51.512] Build status: STARTED
[08:13:51.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:50:0) after 1m3s
[08:14:54.647] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:50:0)
[08:14:54.675] Build status: STARTED
[08:14:54.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:51:0) after 9m2s
[08:23:56.693] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:51:0)
[08:23:56.714] Build status: STARTED
[08:23:56.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:52:0) after 3m35s
[08:27:31.735] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:52:0)
[08:27:31.753] Build status: STARTED
[08:27:31.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:53:0) after 1m12s
[08:28:43.998] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:53:0)
[08:28:44.025] Build status: STARTED
[08:28:44.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:54:0) after 1m42s
[08:30:26.134] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:54:0)
[08:30:26.177] Build status: STARTED
[08:30:26.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:55:0) after 8m54s
[08:39:20.195] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:55:0)
[08:39:20.219] Build status: STARTED
[08:39:20.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:56:0) after 2m2s
[08:41:22.360] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:56:0)
[08:41:22.410] Build status: STARTED
[08:41:22.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:57:0) after 2m31s
[08:43:53.503] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:57:0)
[08:43:53.537] Build status: STARTED
[08:43:53.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:58:0) after 5m45s
[08:49:38.558] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:58:0)
[08:49:38.585] Build status: STARTED
[08:49:38.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:59:0) after 7m44s
[08:57:22.607] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:59:0)
[08:57:22.627] Build status: STARTED
[08:57:22.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:60:0) after 3m51s
[09:01:13.735] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:60:0)
[09:01:13.779] Build status: STARTED
[09:01:13.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:61:0) after 3m41s
[09:04:54.985] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:61:0)
[09:04:55.005] Build status: STARTED
[09:04:55.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:62:0) after 3m54s
[09:08:49.122] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:62:0)
[09:08:49.146] Build status: STARTED
[09:08:49.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8947761225245471568:63:0) after 8m8s
[09:10:56.408] Received PubSub notification, asking Buildbucket for the build status
[09:10:56.428] Build:
{
"id": "8782331163274037937",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29338,
"createdBy": "project:chromium",
"createTime": "2023-05-01T03:55:53.619356041Z",
"startTime": "2023-05-01T03:58:42.265265Z",
"endTime": "2023-05-01T09:10:56.032027072Z",
"updateTime": "2023-05-01T09:10:56.032027072Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2fed9ec9c09b4d7a4db87de698a7f518e95fffe3",
"ref": "refs/heads/main"
}
}
}
[09:10:56.428] Invocation finished in 5h15m4.073424139s with status FAILED