[23:39:46.397] New invocation is queued and will start shortly
[23:39:47.504] Starting the invocation (attempt 1)
[23:39:47.531] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f0a27d720f71cf5312d672ae034560a17319f204"
[23:39:47.531] Popped gitiles commit info from properties and tags
[23:39:47.531] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:39:47.531] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:39:47.531] Buildbucket request:
{
"requestId": "8942250922688302560",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f0a27d720f71cf5312d672ae034560a17319f204",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8942250922688302560"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:39:47.943] Scheduled build:
{
"id": "8776820860773769969",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29846,
"createdBy": "project:chromium",
"createTime": "2023-06-30T23:39:47.589760746Z",
"updateTime": "2023-06-30T23:39:47.589760746Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f0a27d720f71cf5312d672ae034560a17319f204",
"ref": "refs/heads/main"
}
}
}
[23:39:47.943] Task URL: https://cr-buildbucket.appspot.com/build/8776820860773769969
[23:39:47.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:2:0) after 2m56s
[23:42:43.959] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:2:0)
[23:42:43.988] Build status: SCHEDULED
[23:42:43.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:3:0) after 6m39s
[23:43:10.430] Received PubSub notification, asking Buildbucket for the build status
[23:43:10.446] Build status: STARTED
[23:49:22.991] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:3:0)
[23:49:23.014] Build status: STARTED
[23:49:23.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:5:0) after 8m46s
[23:58:09.114] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:5:0)
[23:58:09.140] Build status: STARTED
[23:58:09.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:6:0) after 4m33s
[00:02:42.493] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:6:0)
[00:02:42.520] Build status: STARTED
[00:02:42.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:7:0) after 1m41s
[00:04:23.588] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:7:0)
[00:04:23.605] Build status: STARTED
[00:04:23.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:8:0) after 1m39s
[00:06:02.803] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:8:0)
[00:06:02.822] Build status: STARTED
[00:06:02.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:9:0) after 9m39s
[00:15:42.102] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:9:0)
[00:15:42.121] Build status: STARTED
[00:15:42.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:10:0) after 9m25s
[00:25:07.166] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:10:0)
[00:25:07.198] Build status: STARTED
[00:25:07.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:11:0) after 4m3s
[00:29:10.211] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:11:0)
[00:29:10.234] Build status: STARTED
[00:29:10.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:12:0) after 1m19s
[00:30:29.317] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:12:0)
[00:30:29.337] Build status: STARTED
[00:30:29.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:13:0) after 1m5s
[00:31:34.410] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:13:0)
[00:31:34.450] Build status: STARTED
[00:31:34.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:14:0) after 9m55s
[00:41:29.747] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:14:0)
[00:41:29.765] Build status: STARTED
[00:41:29.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:15:0) after 4m6s
[00:45:35.778] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:15:0)
[00:45:35.800] Build status: STARTED
[00:45:35.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:16:0) after 9m14s
[00:54:49.959] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:16:0)
[00:54:49.982] Build status: STARTED
[00:54:49.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:17:0) after 5m1s
[00:59:50.999] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:17:0)
[00:59:51.019] Build status: STARTED
[00:59:51.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:18:0) after 5m1s
[01:04:52.219] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:18:0)
[01:04:52.236] Build status: STARTED
[01:04:52.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:19:0) after 4m42s
[01:09:34.296] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:19:0)
[01:09:34.315] Build status: STARTED
[01:09:34.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:20:0) after 1m53s
[01:11:27.329] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:20:0)
[01:11:27.371] Build status: STARTED
[01:11:27.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:21:0) after 4m19s
[01:15:46.395] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:21:0)
[01:15:46.418] Build status: STARTED
[01:15:46.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:22:0) after 2m8s
[01:17:54.911] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:22:0)
[01:17:54.932] Build status: STARTED
[01:17:54.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:23:0) after 3m57s
[01:21:51.949] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:23:0)
[01:21:51.969] Build status: STARTED
[01:21:51.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:24:0) after 6m11s
[01:28:03.033] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:24:0)
[01:28:03.061] Build status: STARTED
[01:28:03.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:25:0) after 7m34s
[01:35:37.095] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:25:0)
[01:35:37.117] Build status: STARTED
[01:35:37.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:26:0) after 9m49s
[01:45:26.187] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:26:0)
[01:45:26.207] Build status: STARTED
[01:45:26.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:27:0) after 9m6s
[01:54:32.423] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:27:0)
[01:54:32.441] Build status: STARTED
[01:54:32.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:28:0) after 9m55s
[02:04:27.466] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:28:0)
[02:04:27.486] Build status: STARTED
[02:04:27.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:29:0) after 9m44s
[02:14:11.589] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:29:0)
[02:14:11.609] Build status: STARTED
[02:14:11.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:30:0) after 7m10s
[02:21:21.641] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:30:0)
[02:21:21.824] Build status: STARTED
[02:21:21.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:31:0) after 1m45s
[02:23:06.852] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:31:0)
[02:23:06.895] Build status: STARTED
[02:23:06.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:32:0) after 4m33s
[02:27:40.127] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:32:0)
[02:27:40.183] Build status: STARTED
[02:27:40.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:33:0) after 5m4s
[02:32:44.214] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:33:0)
[02:32:44.237] Build status: STARTED
[02:32:44.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:34:0) after 3m43s
[02:36:27.366] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:34:0)
[02:36:27.569] Build status: STARTED
[02:36:27.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:35:0) after 2m30s
[02:38:57.596] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:35:0)
[02:38:57.628] Build status: STARTED
[02:38:57.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:36:0) after 8m43s
[02:47:40.642] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:36:0)
[02:47:40.662] Build status: STARTED
[02:47:40.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:37:0) after 9m35s
[02:57:15.707] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:37:0)
[02:57:15.729] Build status: STARTED
[02:57:15.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:38:0) after 4m34s
[03:01:49.745] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:38:0)
[03:01:49.765] Build status: STARTED
[03:01:49.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:39:0) after 3m5s
[03:04:54.791] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:39:0)
[03:04:54.821] Build status: STARTED
[03:04:54.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:40:0) after 4m21s
[03:09:15.871] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:40:0)
[03:09:15.889] Build status: STARTED
[03:09:15.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:41:0) after 2m24s
[03:11:39.896] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:41:0)
[03:11:39.914] Build status: STARTED
[03:11:39.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:42:0) after 5m48s
[03:17:28.005] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:42:0)
[03:17:28.024] Build status: STARTED
[03:17:28.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:43:0) after 7m50s
[03:25:18.056] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:43:0)
[03:25:18.079] Build status: STARTED
[03:25:18.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:44:0) after 4m26s
[03:29:44.096] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:44:0)
[03:29:44.116] Build status: STARTED
[03:29:44.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:45:0) after 5m9s
[03:34:53.141] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:45:0)
[03:34:53.164] Build status: STARTED
[03:34:53.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:46:0) after 6m13s
[03:41:06.282] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:46:0)
[03:41:06.347] Build status: STARTED
[03:41:06.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:47:0) after 6m3s
[03:47:09.379] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:47:0)
[03:47:09.399] Build status: STARTED
[03:47:09.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:48:0) after 1m4s
[03:48:13.583] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:48:0)
[03:48:13.612] Build status: STARTED
[03:48:13.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:49:0) after 6m0s
[03:54:13.736] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:49:0)
[03:54:13.753] Build status: STARTED
[03:54:13.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:50:0) after 8m53s
[04:03:06.797] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:50:0)
[04:03:06.883] Build status: STARTED
[04:03:06.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:51:0) after 3m2s
[04:06:09.004] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:51:0)
[04:06:09.023] Build status: STARTED
[04:06:09.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:52:0) after 4m46s
[04:10:55.096] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:52:0)
[04:10:55.114] Build status: STARTED
[04:10:55.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:53:0) after 1m4s
[04:11:59.256] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:53:0)
[04:11:59.278] Build status: STARTED
[04:11:59.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:54:0) after 9m29s
[04:21:28.301] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:54:0)
[04:21:28.321] Build status: STARTED
[04:21:28.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:55:0) after 3m16s
[04:24:44.341] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:55:0)
[04:24:44.357] Build status: STARTED
[04:24:44.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:56:0) after 3m9s
[04:27:53.380] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:56:0)
[04:27:53.400] Build status: STARTED
[04:27:53.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:57:0) after 9m0s
[04:36:53.622] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:57:0)
[04:36:53.638] Build status: STARTED
[04:36:53.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:58:0) after 2m25s
[04:39:18.657] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:58:0)
[04:39:18.774] Build status: STARTED
[04:39:18.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:59:0) after 6m23s
[04:45:41.779] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:59:0)
[04:45:41.797] Build status: STARTED
[04:45:41.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:60:0) after 8m13s
[04:53:54.847] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:60:0)
[04:53:54.897] Build status: STARTED
[04:53:54.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:61:0) after 3m24s
[04:57:18.978] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:61:0)
[04:57:18.997] Build status: STARTED
[04:57:18.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:62:0) after 3m18s
[05:00:37.022] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:62:0)
[05:00:37.042] Build status: STARTED
[05:00:37.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:63:0) after 6m4s
[05:06:41.064] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:63:0)
[05:06:41.079] Build status: STARTED
[05:06:41.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:64:0) after 4m12s
[05:10:53.095] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:64:0)
[05:10:53.207] Build status: STARTED
[05:10:53.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8942250922688302560:65:0) after 7m55s
[05:17:50.432] Received PubSub notification, asking Buildbucket for the build status
[05:17:50.451] Build:
{
"id": "8776820860773769969",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29846,
"createdBy": "project:chromium",
"createTime": "2023-06-30T23:39:47.589760746Z",
"startTime": "2023-06-30T23:43:09.878012Z",
"endTime": "2023-07-01T05:17:27.678031452Z",
"updateTime": "2023-07-01T05:17:27.678031452Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f0a27d720f71cf5312d672ae034560a17319f204",
"ref": "refs/heads/main"
}
}
}
[05:17:50.451] Invocation finished in 5h38m4.070785668s with status FAILED