[23:52:24.122] New invocation is queued and will start shortly
[23:52:25.262] Starting the invocation (attempt 1)
[23:52:25.306] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/255de7f208e62176eab2d12ad9080f0347be10bf"
[23:52:25.306] Popped gitiles commit info from properties and tags
[23:52:25.306] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:52:25.306] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:52:25.306] Buildbucket request:
{
"requestId": "9005305616770541488",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "255de7f208e62176eab2d12ad9080f0347be10bf",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9005305616770541488"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:52:25.989] Scheduled build:
{
"id": "8839875554787942705",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22880,
"createdBy": "project:chromium",
"createTime": "2021-08-03T23:52:25.379037531Z",
"updateTime": "2021-08-03T23:52:25.787543391Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "255de7f208e62176eab2d12ad9080f0347be10bf",
"ref": "refs/heads/main"
}
}
}
[23:52:25.989] Task URL: https://cr-buildbucket.appspot.com/build/8839875554787942705
[23:52:25.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:2:0) after 3m40s
[23:54:53.446] Received PubSub notification, asking Buildbucket for the build status
[23:54:53.477] Build status: STARTED
[23:56:06.227] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:2:0)
[23:56:06.264] Build status: STARTED
[23:56:06.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:4:0) after 3m24s
[23:59:30.497] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:4:0)
[23:59:30.532] Build status: STARTED
[23:59:30.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:5:0) after 3m35s
[00:03:05.991] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:5:0)
[00:03:06.026] Build status: STARTED
[00:03:06.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:6:0) after 8m34s
[00:11:40.218] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:6:0)
[00:11:40.263] Build status: STARTED
[00:11:40.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:7:0) after 1m9s
[00:12:49.638] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:7:0)
[00:12:49.670] Build status: STARTED
[00:12:49.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:8:0) after 3m12s
[00:16:01.815] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:8:0)
[00:16:01.839] Build status: STARTED
[00:16:01.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:9:0) after 8m56s
[00:24:57.847] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:9:0)
[00:24:57.877] Build status: STARTED
[00:24:57.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:10:0) after 5m44s
[00:30:42.174] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:10:0)
[00:30:42.211] Build status: STARTED
[00:30:42.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:11:0) after 8m44s
[00:39:26.239] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:11:0)
[00:39:26.291] Build status: STARTED
[00:39:26.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:12:0) after 7m39s
[00:47:05.414] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:12:0)
[00:47:05.455] Build status: STARTED
[00:47:05.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:13:0) after 4m16s
[00:51:22.104] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:13:0)
[00:51:22.134] Build status: STARTED
[00:51:22.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:14:0) after 7m46s
[00:59:08.149] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:14:0)
[00:59:08.199] Build status: STARTED
[00:59:08.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:15:0) after 9m11s
[01:08:19.757] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:15:0)
[01:08:19.792] Build status: STARTED
[01:08:19.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:16:0) after 6m27s
[01:14:46.932] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:16:0)
[01:14:46.963] Build status: STARTED
[01:14:46.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:17:0) after 3m20s
[01:18:06.988] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:17:0)
[01:18:07.015] Build status: STARTED
[01:18:07.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:18:0) after 2m22s
[01:20:29.120] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:18:0)
[01:20:29.156] Build status: STARTED
[01:20:29.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:19:0) after 4m25s
[01:24:54.181] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:19:0)
[01:24:54.208] Build status: STARTED
[01:24:54.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:20:0) after 2m25s
[01:27:19.247] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:20:0)
[01:27:19.281] Build status: STARTED
[01:27:19.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:21:0) after 8m12s
[01:35:31.324] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:21:0)
[01:35:31.440] Build status: STARTED
[01:35:31.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:22:0) after 1m1s
[01:36:32.467] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:22:0)
[01:36:32.500] Build status: STARTED
[01:36:32.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:23:0) after 8m31s
[01:45:03.994] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:23:0)
[01:45:04.057] Build status: STARTED
[01:45:04.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:24:0) after 3m26s
[01:48:30.335] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:24:0)
[01:48:30.372] Build status: STARTED
[01:48:30.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:25:0) after 1m27s
[01:49:57.482] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:25:0)
[01:49:57.513] Build status: STARTED
[01:49:57.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:26:0) after 1m52s
[01:51:49.524] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:26:0)
[01:51:49.576] Build status: STARTED
[01:51:49.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:27:0) after 6m50s
[01:58:39.605] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:27:0)
[01:58:39.639] Build status: STARTED
[01:58:39.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:28:0) after 8m21s
[02:07:00.807] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:28:0)
[02:07:00.839] Build status: STARTED
[02:07:00.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:29:0) after 4m40s
[02:11:40.830] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:29:0)
[02:11:40.865] Build status: STARTED
[02:11:40.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:30:0) after 3m41s
[02:15:22.252] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:30:0)
[02:15:22.306] Build status: STARTED
[02:15:22.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:31:0) after 8m55s
[02:24:17.364] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:31:0)
[02:24:17.414] Build status: STARTED
[02:24:17.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:32:0) after 7m52s
[02:32:09.561] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:32:0)
[02:32:09.589] Build status: STARTED
[02:32:09.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:33:0) after 8m55s
[02:41:04.611] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:33:0)
[02:41:04.653] Build status: STARTED
[02:41:04.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:34:0) after 3m4s
[02:44:08.684] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:34:0)
[02:44:08.727] Build status: STARTED
[02:44:08.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:35:0) after 4m17s
[02:48:25.752] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:35:0)
[02:48:25.788] Build status: STARTED
[02:48:25.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:36:0) after 1m46s
[02:50:11.905] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:36:0)
[02:50:11.935] Build status: STARTED
[02:50:11.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:37:0) after 7m56s
[02:58:08.060] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:37:0)
[02:58:08.226] Build status: STARTED
[02:58:08.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:38:0) after 4m12s
[03:02:20.479] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:38:0)
[03:02:20.524] Build status: STARTED
[03:02:20.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:39:0) after 3m35s
[03:05:55.635] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:39:0)
[03:05:55.674] Build status: STARTED
[03:05:55.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:40:0) after 6m31s
[03:12:26.824] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:40:0)
[03:12:26.857] Build status: STARTED
[03:12:26.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:41:0) after 6m10s
[03:18:36.985] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:41:0)
[03:18:37.017] Build status: STARTED
[03:18:37.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:42:0) after 8m37s
[03:27:14.390] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:42:0)
[03:27:14.433] Build status: STARTED
[03:27:14.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:43:0) after 1m21s
[03:28:35.662] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:43:0)
[03:28:35.695] Build status: STARTED
[03:28:35.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:44:0) after 2m52s
[03:31:27.904] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:44:0)
[03:31:27.943] Build status: STARTED
[03:31:27.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:45:0) after 4m47s
[03:36:14.970] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:45:0)
[03:36:15.002] Build status: STARTED
[03:36:15.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:46:0) after 2m24s
[03:38:39.029] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:46:0)
[03:38:39.113] Build status: STARTED
[03:38:39.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:47:0) after 9m18s
[03:47:57.285] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:47:0)
[03:47:57.327] Build status: STARTED
[03:47:57.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:48:0) after 7m33s
[03:55:30.644] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:48:0)
[03:55:30.682] Build status: STARTED
[03:55:30.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:49:0) after 6m51s
[04:02:21.806] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:49:0)
[04:02:21.881] Build status: STARTED
[04:02:21.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:50:0) after 1m42s
[04:04:03.970] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:50:0)
[04:04:04.002] Build status: STARTED
[04:04:04.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:51:0) after 9m0s
[04:13:04.137] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:51:0)
[04:13:04.168] Build status: STARTED
[04:13:04.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:52:0) after 4m59s
[04:18:03.457] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:52:0)
[04:18:03.488] Build status: STARTED
[04:18:03.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:53:0) after 4m22s
[04:22:25.614] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:53:0)
[04:22:25.685] Build status: STARTED
[04:22:25.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:54:0) after 4m38s
[04:27:03.831] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:54:0)
[04:27:03.861] Build status: STARTED
[04:27:03.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:55:0) after 7m37s
[04:34:40.897] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:55:0)
[04:34:40.925] Build status: STARTED
[04:34:40.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:56:0) after 7m32s
[04:42:12.949] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:56:0)
[04:42:12.985] Build status: STARTED
[04:42:12.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:57:0) after 5m34s
[04:47:47.058] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:57:0)
[04:47:47.111] Build status: STARTED
[04:47:47.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:58:0) after 4m7s
[04:51:54.107] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:58:0)
[04:51:54.138] Build status: STARTED
[04:51:54.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:59:0) after 6m51s
[04:58:45.184] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:59:0)
[04:58:45.213] Build status: STARTED
[04:58:45.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:60:0) after 7m11s
[05:05:56.976] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:60:0)
[05:05:57.008] Build status: STARTED
[05:05:57.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:61:0) after 6m53s
[05:12:50.033] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:61:0)
[05:12:50.065] Build status: STARTED
[05:12:50.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:62:0) after 8m7s
[05:20:57.302] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:62:0)
[05:20:57.331] Build status: STARTED
[05:20:57.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:63:0) after 1m12s
[05:22:09.397] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:63:0)
[05:22:09.459] Build status: STARTED
[05:22:09.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005305616770541488:64:0) after 7m58s
[05:22:47.209] Received PubSub notification, asking Buildbucket for the build status
[05:22:47.238] Build:
{
"id": "8839875554787942705",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22880,
"createdBy": "project:chromium",
"createTime": "2021-08-03T23:52:25.379037531Z",
"startTime": "2021-08-03T23:54:52.810753Z",
"endTime": "2021-08-04T05:22:46.974699833Z",
"updateTime": "2021-08-04T05:22:46.975214608Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "255de7f208e62176eab2d12ad9080f0347be10bf",
"ref": "refs/heads/main"
}
}
}
[05:22:47.238] Invocation finished in 5h30m23.133905121s with status FAILED