[08:37:31.297] New invocation is queued and will start shortly
[08:37:32.526] Starting the invocation (attempt 1)
[08:37:32.583] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/275ab70a7d13c9728eea60dadc18b23c2916a3f0"
[08:37:32.583] Popped gitiles commit info from properties and tags
[08:37:32.583] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:37:32.583] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:37:32.583] Buildbucket request:
{
"requestId": "9015147648440981536",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "275ab70a7d13c9728eea60dadc18b23c2916a3f0",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9015147648440981536"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:37:33.211] Scheduled build:
{
"id": "8849717586325322064",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 21942,
"createdBy": "project:chromium",
"createTime": "2021-04-17T08:37:32.680973Z",
"updateTime": "2021-04-17T08:37:33.059539Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "275ab70a7d13c9728eea60dadc18b23c2916a3f0",
"ref": "refs/heads/master"
}
}
}
[08:37:33.211] Task URL: https://cr-buildbucket.appspot.com/build/8849717586325322064
[08:37:33.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:2:0) after 3m20s
[08:40:28.151] Received PubSub notification, asking Buildbucket for the build status
[08:40:28.177] Build status: STARTED
[08:40:53.226] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:2:0)
[08:40:53.255] Build status: STARTED
[08:40:53.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:4:0) after 9m31s
[08:50:24.474] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:4:0)
[08:50:24.504] Build status: STARTED
[08:50:24.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:5:0) after 5m48s
[08:56:12.589] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:5:0)
[08:56:12.647] Build status: STARTED
[08:56:12.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:6:0) after 8m54s
[09:05:07.210] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:6:0)
[09:05:07.234] Build status: STARTED
[09:05:07.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:7:0) after 3m0s
[09:08:07.608] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:7:0)
[09:08:07.631] Build status: STARTED
[09:08:07.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:8:0) after 6m58s
[09:15:05.656] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:8:0)
[09:15:05.682] Build status: STARTED
[09:15:05.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:9:0) after 1m3s
[09:16:08.797] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:9:0)
[09:16:08.821] Build status: STARTED
[09:16:08.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:10:0) after 2m13s
[09:18:21.838] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:10:0)
[09:18:21.866] Build status: STARTED
[09:18:21.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:11:0) after 4m9s
[09:22:30.886] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:11:0)
[09:22:30.919] Build status: STARTED
[09:22:30.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:12:0) after 1m42s
[09:24:13.082] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:12:0)
[09:24:13.110] Build status: STARTED
[09:24:13.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:13:0) after 4m30s
[09:28:43.633] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:13:0)
[09:28:43.657] Build status: STARTED
[09:28:43.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:14:0) after 8m47s
[09:37:30.756] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:14:0)
[09:37:30.782] Build status: STARTED
[09:37:30.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:15:0) after 1m15s
[09:38:45.802] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:15:0)
[09:38:45.829] Build status: STARTED
[09:38:45.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:16:0) after 8m12s
[09:46:57.969] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:16:0)
[09:46:57.997] Build status: STARTED
[09:46:57.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:17:0) after 1m2s
[09:48:00.487] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:17:0)
[09:48:00.513] Build status: STARTED
[09:48:00.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:18:0) after 6m34s
[09:54:35.041] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:18:0)
[09:54:35.069] Build status: STARTED
[09:54:35.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:19:0) after 6m37s
[10:01:12.088] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:19:0)
[10:01:12.116] Build status: STARTED
[10:01:12.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:20:0) after 1m29s
[10:02:41.152] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:20:0)
[10:02:41.182] Build status: STARTED
[10:02:41.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:21:0) after 9m24s
[10:12:05.201] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:21:0)
[10:12:05.230] Build status: STARTED
[10:12:05.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:22:0) after 1m46s
[10:13:51.374] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:22:0)
[10:13:51.402] Build status: STARTED
[10:13:51.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:23:0) after 3m7s
[10:16:58.447] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:23:0)
[10:16:58.482] Build status: STARTED
[10:16:58.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:24:0) after 7m55s
[10:24:53.503] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:24:0)
[10:24:53.533] Build status: STARTED
[10:24:53.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:25:0) after 2m36s
[10:27:30.347] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:25:0)
[10:27:30.371] Build status: STARTED
[10:27:30.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:26:0) after 5m56s
[10:33:27.027] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:26:0)
[10:33:27.056] Build status: STARTED
[10:33:27.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:27:0) after 5m13s
[10:38:40.085] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:27:0)
[10:38:40.113] Build status: STARTED
[10:38:40.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:28:0) after 1m38s
[10:40:18.255] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:28:0)
[10:40:18.284] Build status: STARTED
[10:40:18.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:29:0) after 1m47s
[10:42:05.913] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:29:0)
[10:42:05.950] Build status: STARTED
[10:42:05.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:30:0) after 1m21s
[10:43:26.986] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:30:0)
[10:43:27.022] Build status: STARTED
[10:43:27.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:31:0) after 7m2s
[10:50:29.042] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:31:0)
[10:50:29.069] Build status: STARTED
[10:50:29.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:32:0) after 1m27s
[10:51:56.087] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:32:0)
[10:51:56.121] Build status: STARTED
[10:51:56.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:33:0) after 1m20s
[10:53:16.149] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:33:0)
[10:53:16.182] Build status: STARTED
[10:53:16.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:34:0) after 3m47s
[10:57:03.342] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:34:0)
[10:57:03.375] Build status: STARTED
[10:57:03.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:35:0) after 9m41s
[11:06:44.488] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:35:0)
[11:06:44.520] Build status: STARTED
[11:06:44.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:36:0) after 4m46s
[11:11:31.352] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:36:0)
[11:11:31.385] Build status: STARTED
[11:11:31.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:37:0) after 9m8s
[11:20:39.753] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:37:0)
[11:20:39.786] Build status: STARTED
[11:20:39.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:38:0) after 8m56s
[11:29:36.334] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:38:0)
[11:29:36.388] Build status: STARTED
[11:29:36.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:39:0) after 6m1s
[11:35:37.427] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:39:0)
[11:35:37.453] Build status: STARTED
[11:35:37.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:40:0) after 1m45s
[11:37:22.593] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:40:0)
[11:37:22.618] Build status: STARTED
[11:37:22.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:41:0) after 3m33s
[11:40:55.778] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:41:0)
[11:40:55.805] Build status: STARTED
[11:40:55.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:42:0) after 6m29s
[11:47:24.831] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:42:0)
[11:47:24.859] Build status: STARTED
[11:47:24.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:43:0) after 6m21s
[11:53:45.979] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:43:0)
[11:53:46.008] Build status: STARTED
[11:53:46.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:44:0) after 5m14s
[11:59:00.027] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:44:0)
[11:59:00.112] Build status: STARTED
[11:59:00.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:45:0) after 4m2s
[12:03:02.241] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:45:0)
[12:03:02.266] Build status: STARTED
[12:03:02.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:46:0) after 2m8s
[12:05:10.294] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:46:0)
[12:05:10.343] Build status: STARTED
[12:05:10.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:47:0) after 2m40s
[12:07:50.600] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:47:0)
[12:07:50.625] Build status: STARTED
[12:07:50.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:48:0) after 2m16s
[12:10:06.713] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:48:0)
[12:10:06.763] Build status: STARTED
[12:10:06.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:49:0) after 1m40s
[12:11:46.789] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:49:0)
[12:11:46.816] Build status: STARTED
[12:11:46.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:50:0) after 1m15s
[12:13:01.836] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:50:0)
[12:13:01.861] Build status: STARTED
[12:13:01.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:51:0) after 9m33s
[12:22:34.884] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:51:0)
[12:22:34.913] Build status: STARTED
[12:22:34.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:52:0) after 3m41s
[12:26:16.240] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:52:0)
[12:26:16.266] Build status: STARTED
[12:26:16.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:53:0) after 9m43s
[12:35:59.401] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:53:0)
[12:35:59.425] Build status: STARTED
[12:35:59.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:54:0) after 7m31s
[12:43:30.461] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:54:0)
[12:43:30.499] Build status: STARTED
[12:43:30.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:55:0) after 7m17s
[12:50:47.530] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:55:0)
[12:50:47.566] Build status: STARTED
[12:50:47.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:56:0) after 6m10s
[12:56:57.589] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:56:0)
[12:56:57.616] Build status: STARTED
[12:56:57.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:57:0) after 1m50s
[12:58:47.649] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:57:0)
[12:58:47.707] Build status: STARTED
[12:58:47.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:58:0) after 2m30s
[13:01:18.090] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:58:0)
[13:01:18.121] Build status: STARTED
[13:01:18.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:59:0) after 3m23s
[13:04:41.146] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:59:0)
[13:04:41.174] Build status: STARTED
[13:04:41.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:60:0) after 1m56s
[13:06:37.205] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:60:0)
[13:06:37.237] Build status: STARTED
[13:06:37.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:61:0) after 1m20s
[13:07:57.312] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:61:0)
[13:07:57.340] Build status: STARTED
[13:07:57.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:62:0) after 1m30s
[13:09:27.365] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:62:0)
[13:09:27.393] Build status: STARTED
[13:09:27.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:63:0) after 2m50s
[13:12:17.568] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:63:0)
[13:12:17.603] Build status: STARTED
[13:12:17.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:64:0) after 6m48s
[13:19:05.651] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:64:0)
[13:19:05.678] Build status: STARTED
[13:19:05.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:65:0) after 3m34s
[13:22:39.768] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:65:0)
[13:22:39.796] Build status: STARTED
[13:22:39.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015147648440981536:66:0) after 5m12s
[13:25:15.980] Received PubSub notification, asking Buildbucket for the build status
[13:25:16.019] Build:
{
"id": "8849717586325322064",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 21942,
"createdBy": "project:chromium",
"createTime": "2021-04-17T08:37:32.680973Z",
"startTime": "2021-04-17T08:40:27.608377Z",
"endTime": "2021-04-17T13:25:15.744307385Z",
"updateTime": "2021-04-17T13:25:15.744603020Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "275ab70a7d13c9728eea60dadc18b23c2916a3f0",
"ref": "refs/heads/master"
}
}
}
[13:25:16.019] Invocation finished in 4h47m44.739582592s with status FAILED