[20:19:11.217] New invocation is queued and will start shortly
[20:19:14.295] Starting the invocation (attempt 1)
[20:19:14.329] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c92304f2d4543ea21468e977f29939a1b921b4e4"
[20:19:14.329] Popped gitiles commit info from properties and tags
[20:19:14.329] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:19:14.329] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:19:14.329] Buildbucket request:
{
"requestId": "8934834591238767152",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c92304f2d4543ea21468e977f29939a1b921b4e4",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8934834591238767152"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:19:15.131] Scheduled build:
{
"id": "8769404527258614833",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30342,
"createdBy": "project:chromium",
"createTime": "2023-09-20T20:19:14.384671428Z",
"updateTime": "2023-09-20T20:19:14.384671428Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c92304f2d4543ea21468e977f29939a1b921b4e4",
"ref": "refs/heads/main"
}
}
}
[20:19:15.131] Task URL: https://cr-buildbucket.appspot.com/build/8769404527258614833
[20:19:15.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:2:0) after 7m44s
[20:19:15.931] Received PubSub notification, asking Buildbucket for the build status
[20:19:15.955] Build status: SCHEDULED
[20:22:25.589] Received PubSub notification, asking Buildbucket for the build status
[20:22:25.605] Build status: STARTED
[20:26:59.300] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:2:0)
[20:26:59.322] Build status: STARTED
[20:26:59.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:5:0) after 5m19s
[20:32:18.457] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:5:0)
[20:32:18.481] Build status: STARTED
[20:32:18.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:6:0) after 4m6s
[20:36:24.499] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:6:0)
[20:36:24.516] Build status: STARTED
[20:36:24.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:7:0) after 5m49s
[20:42:13.535] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:7:0)
[20:42:13.552] Build status: STARTED
[20:42:13.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:8:0) after 3m24s
[20:45:37.615] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:8:0)
[20:45:37.637] Build status: STARTED
[20:45:37.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:9:0) after 3m18s
[20:48:55.707] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:9:0)
[20:48:55.730] Build status: STARTED
[20:48:55.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:10:0) after 4m1s
[20:52:56.756] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:10:0)
[20:52:56.775] Build status: STARTED
[20:52:56.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:11:0) after 3m46s
[20:56:42.802] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:11:0)
[20:56:42.817] Build status: STARTED
[20:56:42.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:12:0) after 7m34s
[21:04:16.842] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:12:0)
[21:04:16.864] Build status: STARTED
[21:04:16.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:13:0) after 5m29s
[21:09:46.000] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:13:0)
[21:09:46.241] Build status: STARTED
[21:09:46.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:14:0) after 9m59s
[21:19:45.755] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:14:0)
[21:19:45.774] Build status: STARTED
[21:19:45.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:15:0) after 7m44s
[21:27:29.803] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:15:0)
[21:27:29.830] Build status: STARTED
[21:27:29.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:16:0) after 8m6s
[21:35:36.518] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:16:0)
[21:35:36.557] Build status: STARTED
[21:35:36.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:17:0) after 6m46s
[21:42:22.739] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:17:0)
[21:42:22.763] Build status: STARTED
[21:42:22.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:18:0) after 7m31s
[21:49:53.975] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:18:0)
[21:49:53.996] Build status: STARTED
[21:49:53.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:19:0) after 2m37s
[21:52:31.078] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:19:0)
[21:52:31.186] Build status: STARTED
[21:52:31.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:20:0) after 6m32s
[21:59:03.224] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:20:0)
[21:59:03.247] Build status: STARTED
[21:59:03.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:21:0) after 8m7s
[22:07:10.419] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:21:0)
[22:07:10.439] Build status: STARTED
[22:07:10.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:22:0) after 3m58s
[22:11:08.529] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:22:0)
[22:11:08.561] Build status: STARTED
[22:11:08.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:23:0) after 2m30s
[22:13:38.599] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:23:0)
[22:13:38.623] Build status: STARTED
[22:13:38.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:24:0) after 5m18s
[22:18:56.792] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:24:0)
[22:18:56.813] Build status: STARTED
[22:18:56.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:25:0) after 7m28s
[22:26:24.896] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:25:0)
[22:26:24.928] Build status: STARTED
[22:26:24.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:26:0) after 4m39s
[22:31:03.960] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:26:0)
[22:31:04.056] Build status: STARTED
[22:31:04.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:27:0) after 9m21s
[22:40:25.102] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:27:0)
[22:40:25.122] Build status: STARTED
[22:40:25.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:28:0) after 8m8s
[22:48:33.139] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:28:0)
[22:48:33.180] Build status: STARTED
[22:48:33.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:29:0) after 8m49s
[22:57:22.335] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:29:0)
[22:57:22.456] Build status: STARTED
[22:57:22.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:30:0) after 5m18s
[23:02:40.467] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:30:0)
[23:02:40.491] Build status: STARTED
[23:02:40.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:31:0) after 6m56s
[23:09:36.518] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:31:0)
[23:09:36.585] Build status: STARTED
[23:09:36.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:32:0) after 1m47s
[23:11:23.594] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:32:0)
[23:11:23.614] Build status: STARTED
[23:11:23.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:33:0) after 8m50s
[23:20:14.346] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:33:0)
[23:20:14.392] Build status: STARTED
[23:20:14.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:34:0) after 1m15s
[23:21:29.480] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:34:0)
[23:21:29.499] Build status: STARTED
[23:21:29.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:35:0) after 5m5s
[23:26:34.533] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:35:0)
[23:26:34.604] Build status: STARTED
[23:26:34.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:36:0) after 4m48s
[23:31:22.830] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:36:0)
[23:31:22.865] Build status: STARTED
[23:31:22.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:37:0) after 3m45s
[23:35:08.258] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:37:0)
[23:35:08.286] Build status: STARTED
[23:35:08.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:38:0) after 7m8s
[23:42:16.406] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:38:0)
[23:42:16.433] Build status: STARTED
[23:42:16.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:39:0) after 3m5s
[23:45:21.556] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:39:0)
[23:45:21.572] Build status: STARTED
[23:45:21.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:40:0) after 5m59s
[23:51:20.706] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:40:0)
[23:51:20.731] Build status: STARTED
[23:51:20.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:41:0) after 4m41s
[23:56:01.728] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:41:0)
[23:56:01.744] Build status: STARTED
[23:56:01.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:42:0) after 1m57s
[23:57:58.854] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:42:0)
[23:57:58.874] Build status: STARTED
[23:57:58.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:43:0) after 5m20s
[00:03:18.946] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:43:0)
[00:03:18.964] Build status: STARTED
[00:03:18.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:44:0) after 1m10s
[00:04:29.247] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:44:0)
[00:04:29.266] Build status: STARTED
[00:04:29.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:45:0) after 5m27s
[00:09:56.239] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:45:0)
[00:09:56.257] Build status: STARTED
[00:09:56.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:46:0) after 7m56s
[00:17:52.281] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:46:0)
[00:17:52.300] Build status: STARTED
[00:17:52.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:47:0) after 6m34s
[00:24:26.433] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:47:0)
[00:24:26.461] Build status: STARTED
[00:24:26.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:48:0) after 5m43s
[00:30:09.967] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:48:0)
[00:30:10.095] Build status: STARTED
[00:30:10.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:49:0) after 2m49s
[00:32:59.237] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:49:0)
[00:32:59.261] Build status: STARTED
[00:32:59.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:50:0) after 7m36s
[00:40:35.283] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:50:0)
[00:40:35.314] Build status: STARTED
[00:40:35.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:51:0) after 7m12s
[00:47:47.565] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:51:0)
[00:47:47.604] Build status: STARTED
[00:47:47.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:52:0) after 4m37s
[00:52:24.624] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:52:0)
[00:52:24.641] Build status: STARTED
[00:52:24.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:53:0) after 8m0s
[01:00:24.662] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:53:0)
[01:00:24.808] Build status: STARTED
[01:00:24.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:54:0) after 5m29s
[01:05:53.928] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:54:0)
[01:05:53.945] Build status: STARTED
[01:05:53.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:55:0) after 5m44s
[01:11:38.053] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:55:0)
[01:11:38.068] Build status: STARTED
[01:11:38.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:56:0) after 7m24s
[01:19:02.154] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:56:0)
[01:19:02.192] Build status: STARTED
[01:19:02.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:57:0) after 9m58s
[01:29:00.385] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:57:0)
[01:29:00.406] Build status: STARTED
[01:29:00.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:58:0) after 2m3s
[01:31:03.631] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:58:0)
[01:31:03.653] Build status: STARTED
[01:31:03.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:59:0) after 7m28s
[01:38:31.776] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:59:0)
[01:38:31.798] Build status: STARTED
[01:38:31.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:60:0) after 7m43s
[01:46:14.887] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:60:0)
[01:46:14.913] Build status: STARTED
[01:46:14.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:61:0) after 8m38s
[01:54:53.009] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:61:0)
[01:54:53.029] Build status: STARTED
[01:54:53.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:62:0) after 4m47s
[01:59:40.452] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:62:0)
[01:59:40.470] Build status: STARTED
[01:59:40.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:63:0) after 7m47s
[02:07:27.490] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:63:0)
[02:07:27.505] Build status: STARTED
[02:07:27.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:64:0) after 8m49s
[02:16:16.721] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:64:0)
[02:16:16.770] Build status: STARTED
[02:16:16.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:65:0) after 3m29s
[02:19:45.821] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:65:0)
[02:19:45.867] Build status: STARTED
[02:19:45.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8934834591238767152:66:0) after 7m46s
[02:21:53.317] Received PubSub notification, asking Buildbucket for the build status
[02:21:53.336] Build:
{
"id": "8769404527258614833",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30342,
"createdBy": "project:chromium",
"createTime": "2023-09-20T20:19:14.384671428Z",
"startTime": "2023-09-20T20:22:24.939818Z",
"endTime": "2023-09-21T02:21:52.884836117Z",
"updateTime": "2023-09-21T02:21:52.884836117Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c92304f2d4543ea21468e977f29939a1b921b4e4",
"ref": "refs/heads/main"
}
}
}
[02:21:53.336] Invocation finished in 6h2m42.130970736s with status FAILED