[22:49:18.977] New invocation is queued and will start shortly
[22:49:20.167] Starting the invocation (attempt 1)
[22:49:20.203] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d11eb351e6e5f2fb5e89239d8c5c6d325b1208dd"
[22:49:20.203] Popped gitiles commit info from properties and tags
[22:49:20.203] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:49:20.203] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:49:20.203] Buildbucket request:
{
"requestId": "8946783945477999728",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d11eb351e6e5f2fb5e89239d8c5c6d325b1208dd",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8946783945477999728"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:49:20.707] Scheduled build:
{
"id": "8781353883465950785",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29387,
"createdBy": "project:chromium",
"createTime": "2023-05-11T22:49:20.272110597Z",
"updateTime": "2023-05-11T22:49:20.272110597Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d11eb351e6e5f2fb5e89239d8c5c6d325b1208dd",
"ref": "refs/heads/main"
}
}
}
[22:49:20.707] Task URL: https://cr-buildbucket.appspot.com/build/8781353883465950785
[22:49:20.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:2:0) after 7m24s
[22:52:10.805] Received PubSub notification, asking Buildbucket for the build status
[22:52:10.834] Build status: STARTED
[22:56:45.212] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:2:0)
[22:56:45.232] Build status: STARTED
[22:56:45.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:4:0) after 6m34s
[23:03:20.149] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:4:0)
[23:03:20.196] Build status: STARTED
[23:03:20.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:5:0) after 5m16s
[23:08:36.294] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:5:0)
[23:08:36.335] Build status: STARTED
[23:08:36.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:6:0) after 9m49s
[23:18:25.362] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:6:0)
[23:18:25.420] Build status: STARTED
[23:18:25.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:7:0) after 1m12s
[23:19:37.443] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:7:0)
[23:19:37.469] Build status: STARTED
[23:19:37.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:8:0) after 2m52s
[23:22:29.504] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:8:0)
[23:22:29.524] Build status: STARTED
[23:22:29.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:9:0) after 8m3s
[23:30:32.648] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:9:0)
[23:30:32.677] Build status: STARTED
[23:30:32.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:10:0) after 1m29s
[23:32:01.877] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:10:0)
[23:32:01.900] Build status: STARTED
[23:32:01.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:11:0) after 5m11s
[23:37:13.570] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:11:0)
[23:37:13.653] Build status: STARTED
[23:37:13.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:12:0) after 5m41s
[23:42:55.051] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:12:0)
[23:42:55.072] Build status: STARTED
[23:42:55.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:13:0) after 8m39s
[23:51:34.259] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:13:0)
[23:51:34.334] Build status: STARTED
[23:51:34.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:14:0) after 7m25s
[23:58:59.357] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:14:0)
[23:58:59.378] Build status: STARTED
[23:58:59.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:15:0) after 2m32s
[00:01:31.500] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:15:0)
[00:01:31.899] Build status: STARTED
[00:01:31.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:16:0) after 4m45s
[00:06:17.409] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:16:0)
[00:06:17.427] Build status: STARTED
[00:06:17.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:17:0) after 2m49s
[00:09:06.628] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:17:0)
[00:09:06.658] Build status: STARTED
[00:09:06.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:18:0) after 4m35s
[00:13:41.829] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:18:0)
[00:13:41.854] Build status: STARTED
[00:13:41.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:19:0) after 5m4s
[00:18:46.015] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:19:0)
[00:18:46.035] Build status: STARTED
[00:18:46.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:20:0) after 6m57s
[00:25:43.084] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:20:0)
[00:25:43.122] Build status: STARTED
[00:25:43.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:21:0) after 7m2s
[00:32:45.145] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:21:0)
[00:32:45.163] Build status: STARTED
[00:32:45.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:22:0) after 9m6s
[00:41:51.384] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:22:0)
[00:41:51.401] Build status: STARTED
[00:41:51.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:23:0) after 6m49s
[00:48:41.107] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:23:0)
[00:48:41.127] Build status: STARTED
[00:48:41.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:24:0) after 4m12s
[00:52:53.151] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:24:0)
[00:52:53.169] Build status: STARTED
[00:52:53.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:25:0) after 6m4s
[00:58:57.192] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:25:0)
[00:58:57.210] Build status: STARTED
[00:58:57.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:26:0) after 6m46s
[01:05:43.332] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:26:0)
[01:05:43.350] Build status: STARTED
[01:05:43.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:27:0) after 1m9s
[01:06:52.482] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:27:0)
[01:06:52.502] Build status: STARTED
[01:06:52.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:28:0) after 5m43s
[01:12:35.531] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:28:0)
[01:12:35.549] Build status: STARTED
[01:12:35.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:29:0) after 4m39s
[01:17:14.661] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:29:0)
[01:17:14.676] Build status: STARTED
[01:17:14.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:30:0) after 8m16s
[01:25:30.730] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:30:0)
[01:25:30.755] Build status: STARTED
[01:25:30.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:31:0) after 8m15s
[01:33:45.785] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:31:0)
[01:33:45.812] Build status: STARTED
[01:33:45.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:32:0) after 1m25s
[01:35:10.993] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:32:0)
[01:35:11.018] Build status: STARTED
[01:35:11.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:33:0) after 9m41s
[01:44:52.148] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:33:0)
[01:44:52.174] Build status: STARTED
[01:44:52.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:34:0) after 4m52s
[01:49:44.161] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:34:0)
[01:49:44.188] Build status: STARTED
[01:49:44.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:35:0) after 5m53s
[01:55:37.430] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:35:0)
[01:55:37.540] Build status: STARTED
[01:55:37.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:36:0) after 4m37s
[02:00:14.668] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:36:0)
[02:00:14.693] Build status: STARTED
[02:00:14.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:37:0) after 8m33s
[02:08:48.040] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:37:0)
[02:08:48.060] Build status: STARTED
[02:08:48.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:38:0) after 9m50s
[02:18:38.250] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:38:0)
[02:18:38.275] Build status: STARTED
[02:18:38.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:39:0) after 8m30s
[02:27:08.479] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:39:0)
[02:27:08.504] Build status: STARTED
[02:27:08.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:40:0) after 6m58s
[02:34:06.528] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:40:0)
[02:34:06.548] Build status: STARTED
[02:34:06.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:41:0) after 3m52s
[02:37:58.567] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:41:0)
[02:37:58.595] Build status: STARTED
[02:37:58.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:42:0) after 9m33s
[02:47:31.789] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:42:0)
[02:47:31.807] Build status: STARTED
[02:47:31.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:43:0) after 7m16s
[02:54:47.879] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:43:0)
[02:54:47.900] Build status: STARTED
[02:54:47.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:44:0) after 6m16s
[03:01:04.098] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:44:0)
[03:01:04.126] Build status: STARTED
[03:01:04.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:45:0) after 2m4s
[03:03:08.153] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:45:0)
[03:03:08.171] Build status: STARTED
[03:03:08.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:46:0) after 2m12s
[03:05:20.196] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:46:0)
[03:05:20.223] Build status: STARTED
[03:05:20.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:47:0) after 3m11s
[03:08:31.246] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:47:0)
[03:08:31.264] Build status: STARTED
[03:08:31.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:48:0) after 4m58s
[03:13:29.573] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:48:0)
[03:13:29.589] Build status: STARTED
[03:13:29.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:49:0) after 4m46s
[03:18:15.639] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:49:0)
[03:18:15.658] Build status: STARTED
[03:18:15.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:50:0) after 6m50s
[03:25:05.746] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:50:0)
[03:25:05.763] Build status: STARTED
[03:25:05.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:51:0) after 8m45s
[03:33:50.806] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:51:0)
[03:33:50.828] Build status: STARTED
[03:33:50.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:52:0) after 6m20s
[03:40:10.932] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:52:0)
[03:40:10.960] Build status: STARTED
[03:40:10.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:53:0) after 7m39s
[03:47:50.029] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:53:0)
[03:47:50.050] Build status: STARTED
[03:47:50.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:54:0) after 6m22s
[03:54:12.072] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:54:0)
[03:54:12.112] Build status: STARTED
[03:54:12.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:55:0) after 2m53s
[03:57:05.144] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:55:0)
[03:57:05.164] Build status: STARTED
[03:57:05.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8946783945477999728:56:0) after 8m57s
[04:02:31.032] Received PubSub notification, asking Buildbucket for the build status
[04:02:31.049] Build:
{
"id": "8781353883465950785",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29387,
"createdBy": "project:chromium",
"createTime": "2023-05-11T22:49:20.272110597Z",
"startTime": "2023-05-11T22:52:10.051528Z",
"endTime": "2023-05-12T04:02:30.703469585Z",
"updateTime": "2023-05-12T04:02:30.703469585Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d11eb351e6e5f2fb5e89239d8c5c6d325b1208dd",
"ref": "refs/heads/main"
}
}
}
[04:02:31.049] Invocation finished in 5h13m12.08044478s with status FAILED