[14:02:02.736] New invocation is queued and will start shortly
[14:02:03.832] Starting the invocation (attempt 1)
[14:02:03.893] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5af89e9a771002664287ebbc93e53223b054d46c"
[14:02:03.893] Popped gitiles commit info from properties and tags
[14:02:03.893] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:02:03.893] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:02:03.893] Buildbucket request:
{
"requestId": "8940656524771111856",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5af89e9a771002664287ebbc93e53223b054d46c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8940656524771111856"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:02:04.372] Scheduled build:
{
"id": "8775226462814103041",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30009,
"createdBy": "project:chromium",
"createTime": "2023-07-18T14:02:03.973991972Z",
"updateTime": "2023-07-18T14:02:03.973991972Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5af89e9a771002664287ebbc93e53223b054d46c",
"ref": "refs/heads/main"
}
}
}
[14:02:04.372] Task URL: https://cr-buildbucket.appspot.com/build/8775226462814103041
[14:02:04.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:2:0) after 8m42s
[14:05:42.156] Received PubSub notification, asking Buildbucket for the build status
[14:05:42.175] Build status: STARTED
[14:10:46.561] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:2:0)
[14:10:46.578] Build status: STARTED
[14:10:46.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:4:0) after 7m36s
[14:18:22.599] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:4:0)
[14:18:22.620] Build status: STARTED
[14:18:22.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:5:0) after 2m47s
[14:21:09.747] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:5:0)
[14:21:09.773] Build status: STARTED
[14:21:09.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:6:0) after 2m4s
[14:23:13.843] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:6:0)
[14:23:13.874] Build status: STARTED
[14:23:13.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:7:0) after 2m52s
[14:26:06.075] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:7:0)
[14:26:06.129] Build status: STARTED
[14:26:06.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:8:0) after 2m44s
[14:28:50.215] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:8:0)
[14:28:50.229] Build status: STARTED
[14:28:50.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:9:0) after 7m40s
[14:36:30.251] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:9:0)
[14:36:30.279] Build status: STARTED
[14:36:30.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:10:0) after 1m28s
[14:37:58.297] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:10:0)
[14:37:58.345] Build status: STARTED
[14:37:58.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:11:0) after 7m33s
[14:45:31.366] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:11:0)
[14:45:31.390] Build status: STARTED
[14:45:31.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:12:0) after 5m31s
[14:51:02.409] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:12:0)
[14:51:02.428] Build status: STARTED
[14:51:02.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:13:0) after 3m44s
[14:54:46.808] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:13:0)
[14:54:46.900] Build status: STARTED
[14:54:46.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:14:0) after 4m18s
[14:59:04.892] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:14:0)
[14:59:04.965] Build status: STARTED
[14:59:04.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:15:0) after 2m5s
[15:01:09.990] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:15:0)
[15:01:10.016] Build status: STARTED
[15:01:10.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:16:0) after 6m52s
[15:08:02.155] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:16:0)
[15:08:02.178] Build status: STARTED
[15:08:02.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:17:0) after 2m0s
[15:10:02.259] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:17:0)
[15:10:02.284] Build status: STARTED
[15:10:02.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:18:0) after 9m53s
[15:19:55.300] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:18:0)
[15:19:55.319] Build status: STARTED
[15:19:55.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:19:0) after 1m56s
[15:21:51.341] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:19:0)
[15:21:51.360] Build status: STARTED
[15:21:51.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:20:0) after 2m9s
[15:24:00.362] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:20:0)
[15:24:00.382] Build status: STARTED
[15:24:00.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:21:0) after 8m48s
[15:32:48.485] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:21:0)
[15:32:48.498] Build status: STARTED
[15:32:48.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:22:0) after 9m25s
[15:42:13.630] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:22:0)
[15:42:13.653] Build status: STARTED
[15:42:13.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:23:0) after 2m24s
[15:44:37.771] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:23:0)
[15:44:37.790] Build status: STARTED
[15:44:37.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:24:0) after 6m49s
[15:51:26.897] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:24:0)
[15:51:26.933] Build status: STARTED
[15:51:26.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:25:0) after 7m7s
[15:58:34.219] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:25:0)
[15:58:34.235] Build status: STARTED
[15:58:34.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:26:0) after 9m39s
[16:08:13.935] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:26:0)
[16:08:13.953] Build status: STARTED
[16:08:13.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:27:0) after 1m33s
[16:09:47.347] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:27:0)
[16:09:47.422] Build status: STARTED
[16:09:47.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:28:0) after 5m32s
[16:15:20.219] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:28:0)
[16:15:20.274] Build status: STARTED
[16:15:20.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:29:0) after 1m33s
[16:16:53.652] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:29:0)
[16:16:53.682] Build status: STARTED
[16:16:53.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:30:0) after 9m30s
[16:26:23.673] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:30:0)
[16:26:23.691] Build status: STARTED
[16:26:23.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:31:0) after 7m36s
[16:33:59.930] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:31:0)
[16:33:59.951] Build status: STARTED
[16:33:59.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:32:0) after 2m24s
[16:36:24.180] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:32:0)
[16:36:24.205] Build status: STARTED
[16:36:24.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:33:0) after 7m7s
[16:43:31.541] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:33:0)
[16:43:31.572] Build status: STARTED
[16:43:31.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:34:0) after 3m14s
[16:46:45.729] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:34:0)
[16:46:45.792] Build status: STARTED
[16:46:45.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:35:0) after 4m57s
[16:51:42.797] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:35:0)
[16:51:42.814] Build status: STARTED
[16:51:42.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:36:0) after 4m34s
[16:56:16.985] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:36:0)
[16:56:17.037] Build status: STARTED
[16:56:17.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:37:0) after 6m24s
[17:02:41.168] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:37:0)
[17:02:41.199] Build status: STARTED
[17:02:41.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:38:0) after 3m17s
[17:05:58.182] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:38:0)
[17:05:58.265] Build status: STARTED
[17:05:58.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:39:0) after 5m40s
[17:11:38.367] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:39:0)
[17:11:38.407] Build status: STARTED
[17:11:38.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:40:0) after 4m19s
[17:15:57.439] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:40:0)
[17:15:57.471] Build status: STARTED
[17:15:57.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:41:0) after 2m45s
[17:18:42.671] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:41:0)
[17:18:42.692] Build status: STARTED
[17:18:42.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:42:0) after 2m52s
[17:21:35.105] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:42:0)
[17:21:35.124] Build status: STARTED
[17:21:35.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:43:0) after 1m34s
[17:23:09.268] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:43:0)
[17:23:09.289] Build status: STARTED
[17:23:09.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:44:0) after 3m8s
[17:26:17.578] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:44:0)
[17:26:17.599] Build status: STARTED
[17:26:17.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:45:0) after 9m53s
[17:36:10.944] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:45:0)
[17:36:10.961] Build status: STARTED
[17:36:10.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:46:0) after 9m46s
[17:45:57.391] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:46:0)
[17:45:57.414] Build status: STARTED
[17:45:57.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:47:0) after 5m52s
[17:51:49.495] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:47:0)
[17:51:49.512] Build status: STARTED
[17:51:49.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:48:0) after 9m37s
[18:01:26.665] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:48:0)
[18:01:26.696] Build status: STARTED
[18:01:26.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:49:0) after 8m4s
[18:09:30.721] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:49:0)
[18:09:30.784] Build status: STARTED
[18:09:30.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:50:0) after 7m11s
[18:16:41.773] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:50:0)
[18:16:41.791] Build status: STARTED
[18:16:41.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:51:0) after 6m18s
[18:22:59.873] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:51:0)
[18:22:59.969] Build status: STARTED
[18:22:59.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:52:0) after 6m15s
[18:29:15.043] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:52:0)
[18:29:15.068] Build status: STARTED
[18:29:15.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:53:0) after 8m36s
[18:37:51.097] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:53:0)
[18:37:51.118] Build status: STARTED
[18:37:51.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:54:0) after 4m41s
[18:42:32.173] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:54:0)
[18:42:32.191] Build status: STARTED
[18:42:32.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:55:0) after 2m32s
[18:45:04.264] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:55:0)
[18:45:04.293] Build status: STARTED
[18:45:04.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:56:0) after 3m14s
[18:48:18.307] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:56:0)
[18:48:18.329] Build status: STARTED
[18:48:18.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:57:0) after 7m22s
[18:55:40.428] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:57:0)
[18:55:40.458] Build status: STARTED
[18:55:40.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:58:0) after 3m24s
[18:59:04.734] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:58:0)
[18:59:04.752] Build status: STARTED
[18:59:04.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:59:0) after 7m35s
[19:06:39.786] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:59:0)
[19:06:39.810] Build status: STARTED
[19:06:39.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:60:0) after 9m24s
[19:16:03.988] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:60:0)
[19:16:04.004] Build status: STARTED
[19:16:04.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:61:0) after 8m22s
[19:24:26.039] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:61:0)
[19:24:26.055] Build status: STARTED
[19:24:26.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:62:0) after 5m5s
[19:29:31.108] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:62:0)
[19:29:31.127] Build status: STARTED
[19:29:31.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:63:0) after 9m49s
[19:39:20.375] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:63:0)
[19:39:20.403] Build status: STARTED
[19:39:20.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8940656524771111856:64:0) after 5m29s
[19:42:51.493] Received PubSub notification, asking Buildbucket for the build status
[19:42:51.509] Build:
{
"id": "8775226462814103041",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 30009,
"createdBy": "project:chromium",
"createTime": "2023-07-18T14:02:03.973991972Z",
"startTime": "2023-07-18T14:05:41.556165Z",
"endTime": "2023-07-18T19:42:51.287037068Z",
"updateTime": "2023-07-18T19:42:51.287037068Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5af89e9a771002664287ebbc93e53223b054d46c",
"ref": "refs/heads/main"
}
}
}
[19:42:51.509] Invocation finished in 5h40m48.786325783s with status FAILED