[21:38:56.286] New invocation is queued and will start shortly
[21:38:57.359] Starting the invocation (attempt 1)
[21:38:57.394] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/38e2b2839a5bec38c0fac4869ecbdb335ffafd79"
[21:38:57.394] Popped gitiles commit info from properties and tags
[21:38:57.394] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:38:57.394] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:38:57.394] Buildbucket request:
{
"requestId": "9011746398207021440",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "38e2b2839a5bec38c0fac4869ecbdb335ffafd79",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9011746398207021440"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:38:58.407] Scheduled build:
{
"id": "8846316336030490896",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22175,
"createdBy": "project:chromium",
"createTime": "2021-05-24T21:38:57.730532Z",
"updateTime": "2021-05-24T21:38:58.325609Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "38e2b2839a5bec38c0fac4869ecbdb335ffafd79",
"ref": "refs/heads/master"
}
}
}
[21:38:58.407] Task URL: https://cr-buildbucket.appspot.com/build/8846316336030490896
[21:38:58.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:2:0) after 7m33s
[21:41:45.732] Received PubSub notification, asking Buildbucket for the build status
[21:41:45.766] Build status: STARTED
[21:46:31.461] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:2:0)
[21:46:31.505] Build status: STARTED
[21:46:31.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:4:0) after 5m25s
[21:51:56.535] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:4:0)
[21:51:56.573] Build status: STARTED
[21:51:56.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:5:0) after 9m57s
[22:01:53.733] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:5:0)
[22:01:53.763] Build status: STARTED
[22:01:53.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:6:0) after 3m46s
[22:05:39.785] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:6:0)
[22:05:39.820] Build status: STARTED
[22:05:39.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:7:0) after 5m10s
[22:10:49.839] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:7:0)
[22:10:49.873] Build status: STARTED
[22:10:49.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:8:0) after 1m54s
[22:12:43.894] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:8:0)
[22:12:43.932] Build status: STARTED
[22:12:43.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:9:0) after 5m18s
[22:18:02.121] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:9:0)
[22:18:02.157] Build status: STARTED
[22:18:02.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:10:0) after 1m29s
[22:19:31.289] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:10:0)
[22:19:31.319] Build status: STARTED
[22:19:31.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:11:0) after 4m12s
[22:23:43.738] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:11:0)
[22:23:43.780] Build status: STARTED
[22:23:43.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:12:0) after 1m2s
[22:24:45.954] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:12:0)
[22:24:45.981] Build status: STARTED
[22:24:45.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:13:0) after 2m9s
[22:26:55.092] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:13:0)
[22:26:55.120] Build status: STARTED
[22:26:55.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:14:0) after 8m13s
[22:35:08.152] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:14:0)
[22:35:08.219] Build status: STARTED
[22:35:08.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:15:0) after 4m15s
[22:39:23.779] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:15:0)
[22:39:23.820] Build status: STARTED
[22:39:23.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:16:0) after 8m35s
[22:47:59.055] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:16:0)
[22:47:59.086] Build status: STARTED
[22:47:59.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:17:0) after 8m30s
[22:56:29.107] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:17:0)
[22:56:29.135] Build status: STARTED
[22:56:29.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:18:0) after 5m2s
[23:01:31.123] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:18:0)
[23:01:31.224] Build status: STARTED
[23:01:31.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:19:0) after 3m27s
[23:04:58.252] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:19:0)
[23:04:58.284] Build status: STARTED
[23:04:58.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:20:0) after 2m18s
[23:07:16.386] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:20:0)
[23:07:16.423] Build status: STARTED
[23:07:16.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:21:0) after 7m12s
[23:14:28.446] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:21:0)
[23:14:28.945] Build status: STARTED
[23:14:28.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:22:0) after 6m40s
[23:21:08.984] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:22:0)
[23:21:09.017] Build status: STARTED
[23:21:09.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:23:0) after 3m22s
[23:24:31.379] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:23:0)
[23:24:31.438] Build status: STARTED
[23:24:31.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:24:0) after 1m25s
[23:25:56.552] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:24:0)
[23:25:56.584] Build status: STARTED
[23:25:56.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:25:0) after 3m43s
[23:29:39.948] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:25:0)
[23:29:39.983] Build status: STARTED
[23:29:39.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:26:0) after 4m29s
[23:34:09.046] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:26:0)
[23:34:09.082] Build status: STARTED
[23:34:09.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:27:0) after 4m1s
[23:38:10.209] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:27:0)
[23:38:10.239] Build status: STARTED
[23:38:10.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:28:0) after 2m40s
[23:40:50.260] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:28:0)
[23:40:50.285] Build status: STARTED
[23:40:50.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:29:0) after 4m17s
[23:45:07.308] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:29:0)
[23:45:07.360] Build status: STARTED
[23:45:07.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:30:0) after 1m47s
[23:46:54.481] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:30:0)
[23:46:54.506] Build status: STARTED
[23:46:54.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:31:0) after 8m9s
[23:55:03.765] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:31:0)
[23:55:03.798] Build status: STARTED
[23:55:03.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:32:0) after 4m27s
[23:59:31.471] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:32:0)
[23:59:31.502] Build status: STARTED
[23:59:31.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:33:0) after 2m42s
[00:02:13.525] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:33:0)
[00:02:13.556] Build status: STARTED
[00:02:13.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:34:0) after 6m28s
[00:08:41.658] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:34:0)
[00:08:41.691] Build status: STARTED
[00:08:41.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:35:0) after 4m3s
[00:12:45.100] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:35:0)
[00:12:45.129] Build status: STARTED
[00:12:45.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:36:0) after 7m40s
[00:20:25.367] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:36:0)
[00:20:25.394] Build status: STARTED
[00:20:25.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:37:0) after 2m15s
[00:22:40.708] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:37:0)
[00:22:40.741] Build status: STARTED
[00:22:40.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:38:0) after 3m35s
[00:26:15.965] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:38:0)
[00:26:15.998] Build status: STARTED
[00:26:15.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:39:0) after 4m28s
[00:30:44.057] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:39:0)
[00:30:44.088] Build status: STARTED
[00:30:44.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:40:0) after 3m51s
[00:34:35.205] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:40:0)
[00:34:35.235] Build status: STARTED
[00:34:35.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:41:0) after 8m23s
[00:42:58.261] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:41:0)
[00:42:58.289] Build status: STARTED
[00:42:58.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:42:0) after 9m51s
[00:52:49.445] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:42:0)
[00:52:49.480] Build status: STARTED
[00:52:49.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:43:0) after 6m50s
[00:59:39.581] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:43:0)
[00:59:39.623] Build status: STARTED
[00:59:39.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:44:0) after 3m13s
[01:02:52.649] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:44:0)
[01:02:52.686] Build status: STARTED
[01:02:52.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:45:0) after 5m11s
[01:08:03.726] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:45:0)
[01:08:03.765] Build status: STARTED
[01:08:03.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:46:0) after 5m10s
[01:13:13.968] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:46:0)
[01:13:14.014] Build status: STARTED
[01:13:14.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:47:0) after 6m13s
[01:19:27.307] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:47:0)
[01:19:27.344] Build status: STARTED
[01:19:27.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:48:0) after 4m0s
[01:23:27.405] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:48:0)
[01:23:27.447] Build status: STARTED
[01:23:27.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:49:0) after 2m31s
[01:25:58.954] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:49:0)
[01:25:58.992] Build status: STARTED
[01:25:58.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:50:0) after 7m0s
[01:32:59.166] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:50:0)
[01:32:59.195] Build status: STARTED
[01:32:59.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:51:0) after 5m1s
[01:38:00.366] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:51:0)
[01:38:00.435] Build status: STARTED
[01:38:00.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:52:0) after 5m6s
[01:43:06.557] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:52:0)
[01:43:06.584] Build status: STARTED
[01:43:06.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:53:0) after 1m16s
[01:44:22.608] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:53:0)
[01:44:22.705] Build status: STARTED
[01:44:22.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:54:0) after 9m5s
[01:53:27.741] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:54:0)
[01:53:27.770] Build status: STARTED
[01:53:27.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:55:0) after 6m32s
[01:59:59.794] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:55:0)
[01:59:59.835] Build status: STARTED
[01:59:59.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:56:0) after 5m48s
[02:05:48.201] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:56:0)
[02:05:48.232] Build status: STARTED
[02:05:48.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:57:0) after 2m46s
[02:08:34.276] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:57:0)
[02:08:34.309] Build status: STARTED
[02:08:34.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:58:0) after 7m56s
[02:16:30.450] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:58:0)
[02:16:30.478] Build status: STARTED
[02:16:30.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:59:0) after 5m10s
[02:21:40.497] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:59:0)
[02:21:40.568] Build status: STARTED
[02:21:40.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:60:0) after 1m6s
[02:22:46.684] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:60:0)
[02:22:46.713] Build status: STARTED
[02:22:46.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:61:0) after 1m46s
[02:24:32.918] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:61:0)
[02:24:32.946] Build status: STARTED
[02:24:32.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:62:0) after 9m0s
[02:33:32.996] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:62:0)
[02:33:33.023] Build status: STARTED
[02:33:33.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9011746398207021440:63:0) after 9m48s
[02:36:28.259] Received PubSub notification, asking Buildbucket for the build status
[02:36:28.288] Build:
{
"id": "8846316336030490896",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22175,
"createdBy": "project:chromium",
"createTime": "2021-05-24T21:38:57.730532Z",
"startTime": "2021-05-24T21:41:44.945770Z",
"endTime": "2021-05-25T02:36:27.890396517Z",
"updateTime": "2021-05-25T02:36:27.890773229Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "38e2b2839a5bec38c0fac4869ecbdb335ffafd79",
"ref": "refs/heads/master"
}
}
}
[02:36:28.288] Invocation finished in 4h57m32.016604226s with status FAILED