[13:39:08.974] New invocation is queued and will start shortly
[13:39:10.274] Starting the invocation (attempt 1)
[13:39:10.314] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3a47655be492210675505516f1beb9c62c12c271"
[13:39:10.314] Popped gitiles commit info from properties and tags
[13:39:10.314] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:39:10.315] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:39:10.315] Buildbucket request:
{
"requestId": "9007065541638608288",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3a47655be492210675505516f1beb9c62c12c271",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9007065541638608288"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:39:11.549] Scheduled build:
{
"id": "8841635479413690096",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22538,
"createdBy": "project:chromium",
"createTime": "2021-07-15T13:39:10.464787Z",
"updateTime": "2021-07-15T13:39:11.309554Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3a47655be492210675505516f1beb9c62c12c271",
"ref": "refs/heads/main"
}
}
}
[13:39:11.549] Task URL: https://cr-buildbucket.appspot.com/build/8841635479413690096
[13:39:11.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:2:0) after 7m28s
[13:42:13.844] Received PubSub notification, asking Buildbucket for the build status
[13:42:13.867] Build status: STARTED
[13:46:39.654] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:2:0)
[13:46:39.691] Build status: STARTED
[13:46:39.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:4:0) after 1m43s
[13:48:22.759] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:4:0)
[13:48:22.788] Build status: STARTED
[13:48:22.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:5:0) after 6m23s
[13:54:45.851] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:5:0)
[13:54:45.879] Build status: STARTED
[13:54:45.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:6:0) after 7m44s
[14:02:29.916] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:6:0)
[14:02:29.942] Build status: STARTED
[14:02:29.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:7:0) after 6m48s
[14:09:17.996] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:7:0)
[14:09:18.027] Build status: STARTED
[14:09:18.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:8:0) after 7m51s
[14:17:09.076] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:8:0)
[14:17:09.106] Build status: STARTED
[14:17:09.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:9:0) after 5m1s
[14:22:10.371] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:9:0)
[14:22:10.406] Build status: STARTED
[14:22:10.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:10:0) after 1m26s
[14:23:36.480] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:10:0)
[14:23:36.523] Build status: STARTED
[14:23:36.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:11:0) after 1m23s
[14:24:59.560] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:11:0)
[14:24:59.588] Build status: STARTED
[14:24:59.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:12:0) after 7m33s
[14:32:32.622] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:12:0)
[14:32:32.655] Build status: STARTED
[14:32:32.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:13:0) after 8m55s
[14:41:27.708] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:13:0)
[14:41:27.737] Build status: STARTED
[14:41:27.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:14:0) after 6m42s
[14:48:09.833] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:14:0)
[14:48:09.868] Build status: STARTED
[14:48:09.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:15:0) after 8m16s
[14:56:25.935] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:15:0)
[14:56:25.969] Build status: STARTED
[14:56:25.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:16:0) after 2m29s
[14:58:55.127] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:16:0)
[14:58:55.158] Build status: STARTED
[14:58:55.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:17:0) after 5m44s
[15:04:39.552] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:17:0)
[15:04:39.581] Build status: STARTED
[15:04:39.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:18:0) after 5m40s
[15:10:19.677] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:18:0)
[15:10:19.706] Build status: STARTED
[15:10:19.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:19:0) after 2m27s
[15:12:46.760] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:19:0)
[15:12:46.786] Build status: STARTED
[15:12:46.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:20:0) after 3m45s
[15:16:31.904] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:20:0)
[15:16:31.934] Build status: STARTED
[15:16:31.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:21:0) after 9m8s
[15:25:39.957] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:21:0)
[15:25:39.999] Build status: STARTED
[15:25:39.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:22:0) after 7m35s
[15:33:15.023] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:22:0)
[15:33:15.118] Build status: STARTED
[15:33:15.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:23:0) after 9m31s
[15:42:46.140] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:23:0)
[15:42:46.169] Build status: STARTED
[15:42:46.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:24:0) after 1m26s
[15:44:12.204] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:24:0)
[15:44:12.232] Build status: STARTED
[15:44:12.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:25:0) after 8m24s
[15:52:36.529] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:25:0)
[15:52:36.576] Build status: STARTED
[15:52:36.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:26:0) after 1m42s
[15:54:18.601] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:26:0)
[15:54:18.629] Build status: STARTED
[15:54:18.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:27:0) after 4m38s
[15:58:56.673] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:27:0)
[15:58:56.701] Build status: STARTED
[15:58:56.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:28:0) after 5m8s
[16:04:04.922] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:28:0)
[16:04:04.951] Build status: STARTED
[16:04:04.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:29:0) after 4m38s
[16:08:43.023] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:29:0)
[16:08:43.066] Build status: STARTED
[16:08:43.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:30:0) after 4m34s
[16:13:17.133] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:30:0)
[16:13:17.172] Build status: STARTED
[16:13:17.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:31:0) after 4m56s
[16:18:13.245] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:31:0)
[16:18:13.273] Build status: STARTED
[16:18:13.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:32:0) after 7m17s
[16:25:30.447] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:32:0)
[16:25:30.475] Build status: STARTED
[16:25:30.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:33:0) after 4m57s
[16:30:27.647] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:33:0)
[16:30:27.673] Build status: STARTED
[16:30:27.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:34:0) after 5m21s
[16:35:48.740] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:34:0)
[16:35:48.778] Build status: STARTED
[16:35:48.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:35:0) after 5m53s
[16:41:42.057] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:35:0)
[16:41:42.087] Build status: STARTED
[16:41:42.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:36:0) after 8m37s
[16:50:19.114] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:36:0)
[16:50:19.143] Build status: STARTED
[16:50:19.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:37:0) after 7m34s
[16:57:53.194] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:37:0)
[16:57:53.223] Build status: STARTED
[16:57:53.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:38:0) after 1m17s
[16:59:10.333] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:38:0)
[16:59:10.394] Build status: STARTED
[16:59:10.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:39:0) after 6m4s
[17:05:14.784] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:39:0)
[17:05:14.836] Build status: STARTED
[17:05:14.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:40:0) after 1m35s
[17:06:49.858] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:40:0)
[17:06:49.945] Build status: STARTED
[17:06:49.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:41:0) after 3m10s
[17:10:00.365] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:41:0)
[17:10:00.431] Build status: STARTED
[17:10:00.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:42:0) after 6m39s
[17:16:39.472] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:42:0)
[17:16:39.509] Build status: STARTED
[17:16:39.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:43:0) after 4m33s
[17:21:12.779] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:43:0)
[17:21:12.805] Build status: STARTED
[17:21:12.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:44:0) after 4m8s
[17:25:20.831] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:44:0)
[17:25:20.867] Build status: STARTED
[17:25:20.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:45:0) after 3m20s
[17:28:40.892] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:45:0)
[17:28:41.002] Build status: STARTED
[17:28:41.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:46:0) after 6m7s
[17:34:48.051] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:46:0)
[17:34:48.080] Build status: STARTED
[17:34:48.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:47:0) after 6m27s
[17:41:15.207] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:47:0)
[17:41:15.309] Build status: STARTED
[17:41:15.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:48:0) after 4m4s
[17:45:19.393] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:48:0)
[17:45:19.426] Build status: STARTED
[17:45:19.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:49:0) after 2m15s
[17:47:34.484] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:49:0)
[17:47:34.556] Build status: STARTED
[17:47:34.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:50:0) after 3m5s
[17:50:39.597] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:50:0)
[17:50:39.630] Build status: STARTED
[17:50:39.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:51:0) after 5m19s
[17:55:58.658] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:51:0)
[17:55:59.038] Build status: STARTED
[17:55:59.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:52:0) after 5m16s
[18:01:15.101] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:52:0)
[18:01:15.142] Build status: STARTED
[18:01:15.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:53:0) after 2m22s
[18:03:37.173] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:53:0)
[18:03:37.201] Build status: STARTED
[18:03:37.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:54:0) after 8m2s
[18:11:39.275] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:54:0)
[18:11:39.363] Build status: STARTED
[18:11:39.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:55:0) after 6m48s
[18:18:27.713] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:55:0)
[18:18:27.740] Build status: STARTED
[18:18:27.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:56:0) after 1m41s
[18:20:08.871] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:56:0)
[18:20:08.983] Build status: STARTED
[18:20:08.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:57:0) after 7m41s
[18:27:50.062] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:57:0)
[18:27:50.097] Build status: STARTED
[18:27:50.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:58:0) after 7m36s
[18:35:26.082] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:58:0)
[18:35:26.172] Build status: STARTED
[18:35:26.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:59:0) after 2m9s
[18:37:35.430] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:59:0)
[18:37:35.464] Build status: STARTED
[18:37:35.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:60:0) after 4m22s
[18:41:57.487] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:60:0)
[18:41:57.557] Build status: STARTED
[18:41:57.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:61:0) after 1m14s
[18:43:11.896] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:61:0)
[18:43:11.937] Build status: STARTED
[18:43:11.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9007065541638608288:62:0) after 6m59s
[18:46:02.086] Received PubSub notification, asking Buildbucket for the build status
[18:46:02.125] Build:
{
"id": "8841635479413690096",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22538,
"createdBy": "project:chromium",
"createTime": "2021-07-15T13:39:10.464787Z",
"startTime": "2021-07-15T13:42:12.708843Z",
"endTime": "2021-07-15T18:46:01.732059565Z",
"updateTime": "2021-07-15T18:46:01.732690785Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3a47655be492210675505516f1beb9c62c12c271",
"ref": "refs/heads/main"
}
}
}
[18:46:02.125] Invocation finished in 5h6m53.166084908s with status FAILED