[03:56:07.875] New invocation is queued and will start shortly
[03:56:08.964] Starting the invocation (attempt 1)
[03:56:09.006] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/456566e709dfad844a92a539171f40094eb0cb22"
[03:56:09.006] Popped gitiles commit info from properties and tags
[03:56:09.006] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:56:09.006] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:56:09.006] Buildbucket request:
{
"requestId": "8952653445168750592",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "456566e709dfad844a92a539171f40094eb0cb22",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8952653445168750592"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:56:09.581] Scheduled build:
{
"id": "8787223383235025633",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29040,
"createdBy": "project:chromium",
"createTime": "2023-03-08T03:56:09.092875626Z",
"updateTime": "2023-03-08T03:56:09.092875626Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "456566e709dfad844a92a539171f40094eb0cb22",
"ref": "refs/heads/main"
}
},
"canary": true
}
[03:56:09.581] Task URL: https://cr-buildbucket.appspot.com/build/8787223383235025633
[03:56:09.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:2:0) after 7m55s
[03:58:51.705] Received PubSub notification, asking Buildbucket for the build status
[03:58:51.732] Build status: STARTED
[04:04:04.594] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:2:0)
[04:04:04.619] Build status: STARTED
[04:04:04.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:4:0) after 3m39s
[04:07:43.852] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:4:0)
[04:07:43.895] Build status: STARTED
[04:07:43.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:5:0) after 7m44s
[04:15:27.983] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:5:0)
[04:15:28.038] Build status: STARTED
[04:15:28.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:6:0) after 1m21s
[04:16:49.063] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:6:0)
[04:16:49.084] Build status: STARTED
[04:16:49.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:7:0) after 2m23s
[04:19:12.113] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:7:0)
[04:19:12.140] Build status: STARTED
[04:19:12.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:8:0) after 5m46s
[04:24:58.318] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:8:0)
[04:24:58.384] Build status: STARTED
[04:24:58.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:9:0) after 2m54s
[04:27:52.438] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:9:0)
[04:27:52.467] Build status: STARTED
[04:27:52.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:10:0) after 2m44s
[04:30:36.570] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:10:0)
[04:30:36.591] Build status: STARTED
[04:30:36.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:11:0) after 7m25s
[04:38:01.626] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:11:0)
[04:38:01.666] Build status: STARTED
[04:38:01.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:12:0) after 3m2s
[04:41:03.945] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:12:0)
[04:41:03.974] Build status: STARTED
[04:41:03.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:13:0) after 7m12s
[04:48:16.550] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:13:0)
[04:48:16.580] Build status: STARTED
[04:48:16.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:14:0) after 7m35s
[04:55:51.880] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:14:0)
[04:55:51.900] Build status: STARTED
[04:55:51.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:15:0) after 1m15s
[04:57:07.020] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:15:0)
[04:57:07.040] Build status: STARTED
[04:57:07.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:16:0) after 8m49s
[05:05:56.068] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:16:0)
[05:05:56.091] Build status: STARTED
[05:05:56.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:17:0) after 9m45s
[05:15:41.356] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:17:0)
[05:15:41.387] Build status: STARTED
[05:15:41.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:18:0) after 7m32s
[05:23:13.424] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:18:0)
[05:23:13.444] Build status: STARTED
[05:23:13.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:19:0) after 8m35s
[05:31:48.674] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:19:0)
[05:31:48.693] Build status: STARTED
[05:31:48.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:20:0) after 3m23s
[05:35:11.809] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:20:0)
[05:35:11.831] Build status: STARTED
[05:35:11.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:21:0) after 5m49s
[05:41:00.852] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:21:0)
[05:41:00.886] Build status: STARTED
[05:41:00.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:22:0) after 2m51s
[05:43:52.152] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:22:0)
[05:43:52.175] Build status: STARTED
[05:43:52.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:23:0) after 7m54s
[05:51:46.313] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:23:0)
[05:51:46.331] Build status: STARTED
[05:51:46.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:24:0) after 2m44s
[05:54:30.354] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:24:0)
[05:54:30.373] Build status: STARTED
[05:54:30.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:25:0) after 5m12s
[05:59:42.416] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:25:0)
[05:59:42.435] Build status: STARTED
[05:59:42.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:26:0) after 8m21s
[06:08:03.507] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:26:0)
[06:08:03.537] Build status: STARTED
[06:08:03.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:27:0) after 3m13s
[06:11:16.627] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:27:0)
[06:11:16.650] Build status: STARTED
[06:11:16.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:28:0) after 1m47s
[06:13:03.684] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:28:0)
[06:13:03.704] Build status: STARTED
[06:13:03.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:29:0) after 2m16s
[06:15:19.826] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:29:0)
[06:15:19.847] Build status: STARTED
[06:15:19.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:30:0) after 7m23s
[06:22:42.871] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:30:0)
[06:22:42.892] Build status: STARTED
[06:22:42.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:31:0) after 8m32s
[06:31:14.922] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:31:0)
[06:31:14.948] Build status: STARTED
[06:31:14.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:32:0) after 5m18s
[06:36:33.115] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:32:0)
[06:36:33.138] Build status: STARTED
[06:36:33.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:33:0) after 7m31s
[06:44:04.243] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:33:0)
[06:44:04.263] Build status: STARTED
[06:44:04.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:34:0) after 9m2s
[06:53:06.498] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:34:0)
[06:53:06.538] Build status: STARTED
[06:53:06.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:35:0) after 9m11s
[07:02:17.608] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:35:0)
[07:02:17.632] Build status: STARTED
[07:02:17.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:36:0) after 9m48s
[07:12:05.802] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:36:0)
[07:12:05.825] Build status: STARTED
[07:12:05.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:37:0) after 3m23s
[07:15:28.844] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:37:0)
[07:15:28.882] Build status: STARTED
[07:15:28.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:38:0) after 1m0s
[07:16:28.953] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:38:0)
[07:16:28.976] Build status: STARTED
[07:16:28.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:39:0) after 2m49s
[07:19:18.005] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:39:0)
[07:19:18.027] Build status: STARTED
[07:19:18.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:40:0) after 1m56s
[07:21:14.524] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:40:0)
[07:21:14.545] Build status: STARTED
[07:21:14.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:41:0) after 9m26s
[07:30:40.604] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:41:0)
[07:30:40.629] Build status: STARTED
[07:30:40.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:42:0) after 1m48s
[07:32:28.661] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:42:0)
[07:32:28.681] Build status: STARTED
[07:32:28.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:43:0) after 7m42s
[07:40:10.737] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:43:0)
[07:40:10.819] Build status: STARTED
[07:40:10.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:44:0) after 6m40s
[07:46:50.849] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:44:0)
[07:46:50.870] Build status: STARTED
[07:46:50.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:45:0) after 7m53s
[07:54:44.039] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:45:0)
[07:54:44.058] Build status: STARTED
[07:54:44.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:46:0) after 2m33s
[07:57:17.080] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:46:0)
[07:57:17.102] Build status: STARTED
[07:57:17.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:47:0) after 6m0s
[08:03:17.293] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:47:0)
[08:03:17.321] Build status: STARTED
[08:03:17.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:48:0) after 6m7s
[08:09:24.448] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:48:0)
[08:09:24.474] Build status: STARTED
[08:09:24.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:49:0) after 9m28s
[08:18:52.498] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:49:0)
[08:18:52.518] Build status: STARTED
[08:18:52.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:50:0) after 4m4s
[08:22:56.619] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:50:0)
[08:22:56.641] Build status: STARTED
[08:22:56.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:51:0) after 1m32s
[08:24:28.855] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:51:0)
[08:24:28.877] Build status: STARTED
[08:24:28.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:52:0) after 1m43s
[08:26:12.022] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:52:0)
[08:26:12.043] Build status: STARTED
[08:26:12.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:53:0) after 3m36s
[08:29:48.074] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:53:0)
[08:29:48.097] Build status: STARTED
[08:29:48.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:54:0) after 8m11s
[08:37:59.123] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:54:0)
[08:37:59.141] Build status: STARTED
[08:37:59.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:55:0) after 1m22s
[08:39:21.138] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:55:0)
[08:39:21.167] Build status: STARTED
[08:39:21.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:56:0) after 4m16s
[08:43:37.293] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:56:0)
[08:43:37.321] Build status: STARTED
[08:43:37.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:57:0) after 2m12s
[08:45:49.356] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:57:0)
[08:45:49.375] Build status: STARTED
[08:45:49.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:58:0) after 8m33s
[08:54:22.512] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:58:0)
[08:54:22.539] Build status: STARTED
[08:54:22.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8952653445168750592:59:0) after 7m13s
[08:59:45.827] Received PubSub notification, asking Buildbucket for the build status
[08:59:45.850] Build:
{
"id": "8787223383235025633",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29040,
"createdBy": "project:chromium",
"createTime": "2023-03-08T03:56:09.092875626Z",
"startTime": "2023-03-08T03:58:51.158755Z",
"endTime": "2023-03-08T08:59:45.579098264Z",
"updateTime": "2023-03-08T08:59:45.579098264Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "456566e709dfad844a92a539171f40094eb0cb22",
"ref": "refs/heads/main"
}
},
"canary": true
}
[08:59:45.850] Invocation finished in 5h3m37.985871625s with status FAILED