[01:25:09.585] New invocation is queued and will start shortly
[01:25:10.645] Starting the invocation (attempt 1)
[01:25:10.688] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0416e10b273a22620b18e50b19c00c29f21577b0"
[01:25:10.688] Popped gitiles commit info from properties and tags
[01:25:10.688] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:25:10.688] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:25:10.688] Buildbucket request:
{
"requestId": "9013815895797027552",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0416e10b273a22620b18e50b19c00c29f21577b0",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9013815895797027552"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:25:11.876] Scheduled build:
{
"id": "8848385833809705024",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22058,
"createdBy": "project:chromium",
"createTime": "2021-05-02T01:25:10.850522Z",
"updateTime": "2021-05-02T01:25:11.748300Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0416e10b273a22620b18e50b19c00c29f21577b0",
"ref": "refs/heads/master"
}
}
}
[01:25:11.876] Task URL: https://cr-buildbucket.appspot.com/build/8848385833809705024
[01:25:11.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:2:0) after 4m8s
[01:28:17.621] Received PubSub notification, asking Buildbucket for the build status
[01:28:17.647] Build status: STARTED
[01:29:19.889] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:2:0)
[01:29:19.918] Build status: STARTED
[01:29:19.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:4:0) after 8m52s
[01:38:11.952] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:4:0)
[01:38:11.978] Build status: STARTED
[01:38:11.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:5:0) after 6m56s
[01:45:07.997] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:5:0)
[01:45:08.024] Build status: STARTED
[01:45:08.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:6:0) after 9m15s
[01:54:23.040] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:6:0)
[01:54:23.201] Build status: STARTED
[01:54:23.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:7:0) after 3m53s
[01:58:16.223] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:7:0)
[01:58:16.257] Build status: STARTED
[01:58:16.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:8:0) after 1m39s
[01:59:55.384] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:8:0)
[01:59:55.424] Build status: STARTED
[01:59:55.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:9:0) after 5m20s
[02:05:15.679] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:9:0)
[02:05:15.708] Build status: STARTED
[02:05:15.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:10:0) after 1m41s
[02:06:56.727] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:10:0)
[02:06:56.765] Build status: STARTED
[02:06:56.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:11:0) after 5m57s
[02:12:54.244] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:11:0)
[02:12:54.297] Build status: STARTED
[02:12:54.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:12:0) after 1m59s
[02:14:53.313] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:12:0)
[02:14:53.336] Build status: STARTED
[02:14:53.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:13:0) after 2m38s
[02:17:31.739] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:13:0)
[02:17:31.765] Build status: STARTED
[02:17:31.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:14:0) after 1m12s
[02:18:44.062] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:14:0)
[02:18:44.094] Build status: STARTED
[02:18:44.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:15:0) after 6m46s
[02:25:30.111] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:15:0)
[02:25:30.138] Build status: STARTED
[02:25:30.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:16:0) after 7m42s
[02:33:12.514] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:16:0)
[02:33:12.546] Build status: STARTED
[02:33:12.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:17:0) after 2m43s
[02:35:56.040] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:17:0)
[02:35:56.120] Build status: STARTED
[02:35:56.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:18:0) after 2m13s
[02:38:09.258] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:18:0)
[02:38:09.283] Build status: STARTED
[02:38:09.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:19:0) after 3m15s
[02:41:24.301] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:19:0)
[02:41:24.326] Build status: STARTED
[02:41:24.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:20:0) after 8m45s
[02:50:09.399] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:20:0)
[02:50:09.435] Build status: STARTED
[02:50:09.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:21:0) after 3m20s
[02:53:29.550] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:21:0)
[02:53:29.580] Build status: STARTED
[02:53:29.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:22:0) after 5m35s
[02:59:04.654] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:22:0)
[02:59:04.685] Build status: STARTED
[02:59:04.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:23:0) after 5m11s
[03:04:15.683] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:23:0)
[03:04:15.709] Build status: STARTED
[03:04:15.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:24:0) after 1m36s
[03:05:51.725] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:24:0)
[03:05:51.809] Build status: STARTED
[03:05:51.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:25:0) after 4m47s
[03:10:38.824] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:25:0)
[03:10:38.858] Build status: STARTED
[03:10:38.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:26:0) after 2m14s
[03:12:52.873] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:26:0)
[03:12:52.904] Build status: STARTED
[03:12:52.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:27:0) after 2m34s
[03:15:26.928] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:27:0)
[03:15:26.966] Build status: STARTED
[03:15:26.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:28:0) after 9m59s
[03:25:26.170] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:28:0)
[03:25:26.199] Build status: STARTED
[03:25:26.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:29:0) after 1m10s
[03:26:36.217] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:29:0)
[03:26:36.243] Build status: STARTED
[03:26:36.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:30:0) after 4m16s
[03:30:52.315] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:30:0)
[03:30:52.420] Build status: STARTED
[03:30:52.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:31:0) after 8m22s
[03:39:14.455] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:31:0)
[03:39:14.486] Build status: STARTED
[03:39:14.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:32:0) after 7m3s
[03:46:17.493] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:32:0)
[03:46:17.524] Build status: STARTED
[03:46:17.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:33:0) after 3m40s
[03:49:57.619] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:33:0)
[03:49:57.663] Build status: STARTED
[03:49:57.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:34:0) after 9m2s
[03:58:59.680] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:34:0)
[03:58:59.705] Build status: STARTED
[03:58:59.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:35:0) after 1m23s
[04:00:22.817] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:35:0)
[04:00:22.847] Build status: STARTED
[04:00:22.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:36:0) after 9m5s
[04:09:27.865] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:36:0)
[04:09:27.894] Build status: STARTED
[04:09:27.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:37:0) after 6m53s
[04:16:22.534] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:37:0)
[04:16:22.562] Build status: STARTED
[04:16:22.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:38:0) after 9m28s
[04:25:50.778] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:38:0)
[04:25:50.803] Build status: STARTED
[04:25:50.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:39:0) after 3m53s
[04:29:43.821] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:39:0)
[04:29:43.853] Build status: STARTED
[04:29:43.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:40:0) after 8m51s
[04:38:35.118] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:40:0)
[04:38:35.143] Build status: STARTED
[04:38:35.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:41:0) after 1m51s
[04:40:26.311] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:41:0)
[04:40:26.348] Build status: STARTED
[04:40:26.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:42:0) after 1m53s
[04:42:19.503] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:42:0)
[04:42:19.529] Build status: STARTED
[04:42:19.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:43:0) after 7m43s
[04:50:02.555] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:43:0)
[04:50:02.582] Build status: STARTED
[04:50:02.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:44:0) after 4m51s
[04:54:53.727] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:44:0)
[04:54:53.749] Build status: STARTED
[04:54:53.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:45:0) after 2m20s
[04:57:13.768] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:45:0)
[04:57:13.790] Build status: STARTED
[04:57:13.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:46:0) after 2m6s
[04:59:19.959] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:46:0)
[04:59:20.023] Build status: STARTED
[04:59:20.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:47:0) after 5m45s
[05:05:05.131] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:47:0)
[05:05:05.151] Build status: STARTED
[05:05:05.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:48:0) after 5m23s
[05:10:28.362] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:48:0)
[05:10:28.387] Build status: STARTED
[05:10:28.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:49:0) after 4m17s
[05:14:45.731] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:49:0)
[05:14:45.756] Build status: STARTED
[05:14:45.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:50:0) after 4m17s
[05:19:02.783] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:50:0)
[05:19:02.813] Build status: STARTED
[05:19:02.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:51:0) after 8m24s
[05:27:26.831] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:51:0)
[05:27:26.856] Build status: STARTED
[05:27:26.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:52:0) after 8m2s
[05:35:28.968] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:52:0)
[05:35:28.991] Build status: STARTED
[05:35:28.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:53:0) after 9m54s
[05:45:23.008] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:53:0)
[05:45:23.031] Build status: STARTED
[05:45:23.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:54:0) after 1m33s
[05:46:56.171] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:54:0)
[05:46:56.206] Build status: STARTED
[05:46:56.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:55:0) after 5m43s
[05:52:39.618] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:55:0)
[05:52:39.646] Build status: STARTED
[05:52:39.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:56:0) after 1m37s
[05:54:16.874] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:56:0)
[05:54:16.907] Build status: STARTED
[05:54:16.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:57:0) after 5m51s
[06:00:07.950] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:57:0)
[06:00:08.009] Build status: STARTED
[06:00:08.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:58:0) after 6m43s
[06:06:51.176] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:58:0)
[06:06:51.204] Build status: STARTED
[06:06:51.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013815895797027552:59:0) after 8m14s
[06:07:59.360] Received PubSub notification, asking Buildbucket for the build status
[06:07:59.394] Build:
{
"id": "8848385833809705024",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22058,
"createdBy": "project:chromium",
"createTime": "2021-05-02T01:25:10.850522Z",
"startTime": "2021-05-02T01:28:17.076266Z",
"endTime": "2021-05-02T06:07:59.012213931Z",
"updateTime": "2021-05-02T06:07:59.012521114Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0416e10b273a22620b18e50b19c00c29f21577b0",
"ref": "refs/heads/master"
}
}
}
[06:07:59.394] Invocation finished in 4h42m49.823304509s with status FAILED