[11:09:20.217] New invocation is queued and will start shortly
[11:09:21.359] Starting the invocation (attempt 1)
[11:09:21.392] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/39500a82881ba92406e8074ee9dcf733d8b55262"
[11:09:21.392] Popped gitiles commit info from properties and tags
[11:09:21.392] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:09:21.392] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:09:21.392] Buildbucket request:
{
"requestId": "9003813476247555584",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "39500a82881ba92406e8074ee9dcf733d8b55262",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9003813476247555584"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:09:21.942] Scheduled build:
{
"id": "8838383414277310017",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22979,
"createdBy": "project:chromium",
"createTime": "2021-08-20T11:09:21.460902619Z",
"updateTime": "2021-08-20T11:09:21.723301521Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "39500a82881ba92406e8074ee9dcf733d8b55262",
"ref": "refs/heads/main"
}
}
}
[11:09:21.942] Task URL: https://cr-buildbucket.appspot.com/build/8838383414277310017
[11:09:21.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:2:0) after 4m15s
[11:12:06.175] Received PubSub notification, asking Buildbucket for the build status
[11:12:06.204] Build status: STARTED
[11:13:36.985] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:2:0)
[11:13:37.019] Build status: STARTED
[11:13:37.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:4:0) after 8m41s
[11:22:18.296] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:4:0)
[11:22:18.322] Build status: STARTED
[11:22:18.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:5:0) after 6m11s
[11:28:29.339] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:5:0)
[11:28:29.369] Build status: STARTED
[11:28:29.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:6:0) after 8m16s
[11:36:45.438] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:6:0)
[11:36:45.488] Build status: STARTED
[11:36:45.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:7:0) after 9m53s
[11:46:38.666] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:7:0)
[11:46:38.725] Build status: STARTED
[11:46:38.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:8:0) after 8m55s
[11:55:33.746] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:8:0)
[11:55:33.776] Build status: STARTED
[11:55:33.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:9:0) after 5m36s
[12:01:09.872] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:9:0)
[12:01:09.913] Build status: STARTED
[12:01:09.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:10:0) after 1m52s
[12:03:02.005] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:10:0)
[12:03:02.065] Build status: STARTED
[12:03:02.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:11:0) after 1m42s
[12:04:44.086] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:11:0)
[12:04:44.113] Build status: STARTED
[12:04:44.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:12:0) after 5m58s
[12:10:42.268] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:12:0)
[12:10:42.305] Build status: STARTED
[12:10:42.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:13:0) after 6m38s
[12:17:20.333] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:13:0)
[12:17:20.497] Build status: STARTED
[12:17:20.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:14:0) after 6m54s
[12:24:14.519] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:14:0)
[12:24:14.546] Build status: STARTED
[12:24:14.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:15:0) after 4m10s
[12:28:24.596] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:15:0)
[12:28:24.627] Build status: STARTED
[12:28:24.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:16:0) after 4m38s
[12:33:02.656] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:16:0)
[12:33:02.734] Build status: STARTED
[12:33:02.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:17:0) after 2m4s
[12:35:06.757] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:17:0)
[12:35:06.795] Build status: STARTED
[12:35:06.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:18:0) after 2m12s
[12:37:18.915] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:18:0)
[12:37:18.946] Build status: STARTED
[12:37:18.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:19:0) after 8m47s
[12:46:06.024] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:19:0)
[12:46:06.056] Build status: STARTED
[12:46:06.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:20:0) after 7m53s
[12:53:59.166] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:20:0)
[12:53:59.200] Build status: STARTED
[12:53:59.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:21:0) after 4m24s
[12:58:23.246] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:21:0)
[12:58:23.277] Build status: STARTED
[12:58:23.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:22:0) after 9m24s
[13:07:47.530] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:22:0)
[13:07:47.590] Build status: STARTED
[13:07:47.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:23:0) after 9m30s
[13:17:17.714] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:23:0)
[13:17:17.766] Build status: STARTED
[13:17:17.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:24:0) after 8m12s
[13:25:29.936] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:24:0)
[13:25:29.969] Build status: STARTED
[13:25:29.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:25:0) after 5m4s
[13:30:34.099] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:25:0)
[13:30:34.139] Build status: STARTED
[13:30:34.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:26:0) after 3m14s
[13:33:48.165] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:26:0)
[13:33:48.193] Build status: STARTED
[13:33:48.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:27:0) after 1m59s
[13:35:47.188] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:27:0)
[13:35:47.217] Build status: STARTED
[13:35:47.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:28:0) after 2m45s
[13:38:32.269] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:28:0)
[13:38:32.341] Build status: STARTED
[13:38:32.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:29:0) after 2m50s
[13:41:22.342] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:29:0)
[13:41:22.387] Build status: STARTED
[13:41:22.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:30:0) after 3m47s
[13:45:09.418] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:30:0)
[13:45:09.457] Build status: STARTED
[13:45:09.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:31:0) after 3m17s
[13:48:26.716] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:31:0)
[13:48:26.754] Build status: STARTED
[13:48:26.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:32:0) after 6m13s
[13:54:39.775] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:32:0)
[13:54:39.808] Build status: STARTED
[13:54:39.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:33:0) after 8m1s
[14:02:40.829] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:33:0)
[14:02:40.859] Build status: STARTED
[14:02:40.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:34:0) after 4m1s
[14:06:41.895] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:34:0)
[14:06:41.938] Build status: STARTED
[14:06:41.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:35:0) after 2m42s
[14:09:24.149] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:35:0)
[14:09:24.190] Build status: STARTED
[14:09:24.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:36:0) after 1m29s
[14:10:53.622] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:36:0)
[14:10:53.655] Build status: STARTED
[14:10:53.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:37:0) after 8m28s
[14:19:21.680] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:37:0)
[14:19:21.715] Build status: STARTED
[14:19:21.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:38:0) after 9m37s
[14:28:58.735] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:38:0)
[14:28:58.770] Build status: STARTED
[14:28:58.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:39:0) after 3m35s
[14:32:33.897] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:39:0)
[14:32:33.929] Build status: STARTED
[14:32:33.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:40:0) after 5m31s
[14:38:04.970] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:40:0)
[14:38:05.001] Build status: STARTED
[14:38:05.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:41:0) after 5m2s
[14:43:06.991] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:41:0)
[14:43:07.041] Build status: STARTED
[14:43:07.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:42:0) after 5m43s
[14:48:50.065] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:42:0)
[14:48:50.103] Build status: STARTED
[14:48:50.103] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:43:0) after 2m50s
[14:51:40.234] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:43:0)
[14:51:40.296] Build status: STARTED
[14:51:40.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:44:0) after 1m57s
[14:53:37.388] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:44:0)
[14:53:37.423] Build status: STARTED
[14:53:37.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:45:0) after 2m14s
[14:55:51.443] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:45:0)
[14:55:51.474] Build status: STARTED
[14:55:51.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:46:0) after 2m51s
[14:58:42.507] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:46:0)
[14:58:42.554] Build status: STARTED
[14:58:42.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:47:0) after 4m58s
[15:03:40.622] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:47:0)
[15:03:40.683] Build status: STARTED
[15:03:40.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:48:0) after 8m33s
[15:12:13.804] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:48:0)
[15:12:13.837] Build status: STARTED
[15:12:13.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:49:0) after 2m32s
[15:14:46.416] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:49:0)
[15:14:46.471] Build status: STARTED
[15:14:46.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:50:0) after 5m38s
[15:20:24.460] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:50:0)
[15:20:24.513] Build status: STARTED
[15:20:24.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:51:0) after 3m52s
[15:24:16.640] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:51:0)
[15:24:16.671] Build status: STARTED
[15:24:16.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:52:0) after 8m31s
[15:32:47.719] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:52:0)
[15:32:47.747] Build status: STARTED
[15:32:47.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:53:0) after 3m46s
[15:36:33.859] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:53:0)
[15:36:33.894] Build status: STARTED
[15:36:33.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:54:0) after 3m55s
[15:40:28.977] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:54:0)
[15:40:29.013] Build status: STARTED
[15:40:29.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:55:0) after 7m59s
[15:48:28.049] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:55:0)
[15:48:28.093] Build status: STARTED
[15:48:28.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:56:0) after 4m38s
[15:53:06.165] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:56:0)
[15:53:06.196] Build status: STARTED
[15:53:06.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:57:0) after 9m13s
[16:02:19.320] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:57:0)
[16:02:19.383] Build status: STARTED
[16:02:19.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:58:0) after 7m21s
[16:09:40.728] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:58:0)
[16:09:40.762] Build status: STARTED
[16:09:40.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:59:0) after 5m3s
[16:14:43.960] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:59:0)
[16:14:43.997] Build status: STARTED
[16:14:43.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:60:0) after 4m42s
[16:19:26.101] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:60:0)
[16:19:26.135] Build status: STARTED
[16:19:26.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:61:0) after 2m3s
[16:21:29.165] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:61:0)
[16:21:29.271] Build status: STARTED
[16:21:29.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:62:0) after 4m26s
[16:25:55.303] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:62:0)
[16:25:55.344] Build status: STARTED
[16:25:55.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:63:0) after 9m37s
[16:35:32.455] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:63:0)
[16:35:32.531] Build status: STARTED
[16:35:32.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:64:0) after 2m35s
[16:38:07.573] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:64:0)
[16:38:07.621] Build status: STARTED
[16:38:07.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9003813476247555584:65:0) after 6m46s
[16:38:46.303] Received PubSub notification, asking Buildbucket for the build status
[16:38:46.330] Build:
{
"id": "8838383414277310017",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22979,
"createdBy": "project:chromium",
"createTime": "2021-08-20T11:09:21.460902619Z",
"startTime": "2021-08-20T11:12:05.228918Z",
"endTime": "2021-08-20T16:38:45.775561967Z",
"updateTime": "2021-08-20T16:38:45.775984786Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "39500a82881ba92406e8074ee9dcf733d8b55262",
"ref": "refs/heads/main"
}
}
}
[16:38:46.331] Invocation finished in 5h29m26.132914957s with status FAILED