[19:47:39.100] New invocation is queued and will start shortly
[19:47:40.192] Starting the invocation (attempt 1)
[19:47:40.223] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/839addd3e80db379ff8d52766ca8dd05e235bbce"
[19:47:40.223] Popped gitiles commit info from properties and tags
[19:47:40.223] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:47:40.223] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:47:40.223] Buildbucket request:
{
"requestId": "8953590147307652176",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "839addd3e80db379ff8d52766ca8dd05e235bbce",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8953590147307652176"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:47:40.760] Scheduled build:
{
"id": "8788160085328284961",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 28996,
"createdBy": "project:chromium",
"createTime": "2023-02-25T19:47:40.363178231Z",
"updateTime": "2023-02-25T19:47:40.363178231Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "839addd3e80db379ff8d52766ca8dd05e235bbce",
"ref": "refs/heads/main"
}
}
}
[19:47:40.760] Task URL: https://cr-buildbucket.appspot.com/build/8788160085328284961
[19:47:40.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:2:0) after 9m43s
[19:50:05.603] Received PubSub notification, asking Buildbucket for the build status
[19:50:05.625] Build status: STARTED
[19:57:23.920] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:2:0)
[19:57:23.972] Build status: STARTED
[19:57:23.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:4:0) after 4m28s
[20:01:52.040] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:4:0)
[20:01:52.075] Build status: STARTED
[20:01:52.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:5:0) after 9m7s
[20:10:59.195] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:5:0)
[20:10:59.217] Build status: STARTED
[20:10:59.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:6:0) after 6m49s
[20:17:48.236] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:6:0)
[20:17:48.261] Build status: STARTED
[20:17:48.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:7:0) after 2m58s
[20:20:46.278] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:7:0)
[20:20:46.298] Build status: STARTED
[20:20:46.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:8:0) after 4m30s
[20:25:16.430] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:8:0)
[20:25:16.452] Build status: STARTED
[20:25:16.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:9:0) after 7m36s
[20:32:52.496] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:9:0)
[20:32:52.513] Build status: STARTED
[20:32:52.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:10:0) after 6m50s
[20:39:42.583] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:10:0)
[20:39:42.605] Build status: STARTED
[20:39:42.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:11:0) after 4m33s
[20:44:15.642] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:11:0)
[20:44:15.665] Build status: STARTED
[20:44:15.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:12:0) after 9m40s
[20:53:55.690] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:12:0)
[20:53:55.710] Build status: STARTED
[20:53:55.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:13:0) after 6m16s
[21:00:11.803] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:13:0)
[21:00:11.834] Build status: STARTED
[21:00:11.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:14:0) after 2m25s
[21:02:36.853] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:14:0)
[21:02:36.878] Build status: STARTED
[21:02:36.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:15:0) after 8m44s
[21:11:20.995] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:15:0)
[21:11:21.022] Build status: STARTED
[21:11:21.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:16:0) after 6m23s
[21:17:44.155] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:16:0)
[21:17:44.180] Build status: STARTED
[21:17:44.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:17:0) after 4m57s
[21:22:41.198] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:17:0)
[21:22:41.216] Build status: STARTED
[21:22:41.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:18:0) after 5m49s
[21:28:30.261] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:18:0)
[21:28:30.279] Build status: STARTED
[21:28:30.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:19:0) after 9m55s
[21:38:25.304] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:19:0)
[21:38:25.340] Build status: STARTED
[21:38:25.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:20:0) after 9m8s
[21:47:33.532] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:20:0)
[21:47:33.559] Build status: STARTED
[21:47:33.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:21:0) after 1m45s
[21:49:18.583] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:21:0)
[21:49:18.603] Build status: STARTED
[21:49:18.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:22:0) after 1m40s
[21:50:58.591] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:22:0)
[21:50:58.615] Build status: STARTED
[21:50:58.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:23:0) after 8m28s
[21:59:26.661] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:23:0)
[21:59:26.694] Build status: STARTED
[21:59:26.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:24:0) after 5m52s
[22:05:18.716] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:24:0)
[22:05:18.740] Build status: STARTED
[22:05:18.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:25:0) after 4m18s
[22:09:36.760] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:25:0)
[22:09:36.780] Build status: STARTED
[22:09:36.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:26:0) after 3m36s
[22:13:12.814] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:26:0)
[22:13:12.836] Build status: STARTED
[22:13:12.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:27:0) after 6m9s
[22:19:21.990] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:27:0)
[22:19:22.024] Build status: STARTED
[22:19:22.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:28:0) after 1m48s
[22:21:10.068] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:28:0)
[22:21:10.091] Build status: STARTED
[22:21:10.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:29:0) after 1m4s
[22:22:14.118] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:29:0)
[22:22:14.141] Build status: STARTED
[22:22:14.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:30:0) after 3m7s
[22:25:21.276] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:30:0)
[22:25:21.300] Build status: STARTED
[22:25:21.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:31:0) after 2m54s
[22:28:15.519] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:31:0)
[22:28:15.540] Build status: STARTED
[22:28:15.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:32:0) after 6m49s
[22:35:04.727] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:32:0)
[22:35:04.754] Build status: STARTED
[22:35:04.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:33:0) after 5m0s
[22:40:04.776] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:33:0)
[22:40:04.801] Build status: STARTED
[22:40:04.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:34:0) after 5m56s
[22:46:01.097] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:34:0)
[22:46:01.118] Build status: STARTED
[22:46:01.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:35:0) after 5m55s
[22:51:56.944] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:35:0)
[22:51:56.975] Build status: STARTED
[22:51:56.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:36:0) after 9m57s
[23:01:54.123] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:36:0)
[23:01:54.147] Build status: STARTED
[23:01:54.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:37:0) after 8m56s
[23:10:50.173] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:37:0)
[23:10:50.196] Build status: STARTED
[23:10:50.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:38:0) after 4m48s
[23:15:38.217] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:38:0)
[23:15:38.238] Build status: STARTED
[23:15:38.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:39:0) after 1m12s
[23:16:50.258] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:39:0)
[23:16:50.317] Build status: STARTED
[23:16:50.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:40:0) after 1m33s
[23:18:23.535] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:40:0)
[23:18:23.556] Build status: STARTED
[23:18:23.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:41:0) after 1m57s
[23:20:20.720] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:41:0)
[23:20:20.757] Build status: STARTED
[23:20:20.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:42:0) after 8m32s
[23:28:53.155] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:42:0)
[23:28:53.176] Build status: STARTED
[23:28:53.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:43:0) after 2m26s
[23:31:19.686] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:43:0)
[23:31:19.732] Build status: STARTED
[23:31:19.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:44:0) after 4m32s
[23:35:51.966] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:44:0)
[23:35:51.996] Build status: STARTED
[23:35:51.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:45:0) after 1m59s
[23:37:51.069] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:45:0)
[23:37:51.089] Build status: STARTED
[23:37:51.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:46:0) after 5m9s
[23:43:00.574] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:46:0)
[23:43:00.597] Build status: STARTED
[23:43:00.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:47:0) after 1m11s
[23:44:12.200] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:47:0)
[23:44:12.271] Build status: STARTED
[23:44:12.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:48:0) after 2m27s
[23:46:39.721] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:48:0)
[23:46:39.742] Build status: STARTED
[23:46:39.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:49:0) after 7m46s
[23:54:25.960] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:49:0)
[23:54:25.981] Build status: STARTED
[23:54:25.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:50:0) after 9m3s
[00:03:29.085] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:50:0)
[00:03:29.109] Build status: STARTED
[00:03:29.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:51:0) after 9m3s
[00:12:32.128] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:51:0)
[00:12:32.149] Build status: STARTED
[00:12:32.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:52:0) after 1m55s
[00:14:27.273] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:52:0)
[00:14:27.306] Build status: STARTED
[00:14:27.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:53:0) after 3m0s
[00:17:27.329] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:53:0)
[00:17:27.354] Build status: STARTED
[00:17:27.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:54:0) after 4m1s
[00:21:28.378] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:54:0)
[00:21:28.399] Build status: STARTED
[00:21:28.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:55:0) after 2m51s
[00:24:19.430] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:55:0)
[00:24:19.454] Build status: STARTED
[00:24:19.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:56:0) after 1m51s
[00:26:10.468] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:56:0)
[00:26:10.518] Build status: STARTED
[00:26:10.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:57:0) after 2m38s
[00:28:48.540] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:57:0)
[00:28:48.560] Build status: STARTED
[00:28:48.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:58:0) after 5m18s
[00:34:06.728] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:58:0)
[00:34:06.750] Build status: STARTED
[00:34:06.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:59:0) after 6m26s
[00:40:33.061] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:59:0)
[00:40:33.091] Build status: STARTED
[00:40:33.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:60:0) after 3m56s
[00:44:29.112] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:60:0)
[00:44:29.135] Build status: STARTED
[00:44:29.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:61:0) after 5m25s
[00:49:54.160] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:61:0)
[00:49:54.192] Build status: STARTED
[00:49:54.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:62:0) after 6m2s
[00:55:56.227] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:62:0)
[00:55:56.251] Build status: STARTED
[00:55:56.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953590147307652176:63:0) after 6m23s
[01:01:38.377] Received PubSub notification, asking Buildbucket for the build status
[01:01:38.404] Build:
{
"id": "8788160085328284961",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 28996,
"createdBy": "project:chromium",
"createTime": "2023-02-25T19:47:40.363178231Z",
"startTime": "2023-02-25T19:50:05.007918Z",
"endTime": "2023-02-26T01:01:37.901984136Z",
"updateTime": "2023-02-26T01:01:37.901984136Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "839addd3e80db379ff8d52766ca8dd05e235bbce",
"ref": "refs/heads/main"
}
}
}
[01:01:38.404] Invocation finished in 5h13m59.31210523s with status FAILED