[13:48:02.686] New invocation is queued and will start shortly
[13:48:03.755] Starting the invocation (attempt 1)
[13:48:03.781] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/beb57a34594ea7991130c42d0b6e51da5c732ace"
[13:48:03.781] Popped gitiles commit info from properties and tags
[13:48:03.781] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:48:03.781] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:48:03.781] Buildbucket request:
{
"requestId": "8945187253940323056",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "beb57a34594ea7991130c42d0b6e51da5c732ace",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8945187253940323056"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:48:04.129] Scheduled build:
{
"id": "8779757192088957521",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29494,
"createdBy": "project:chromium",
"createTime": "2023-05-29T13:48:03.829740797Z",
"updateTime": "2023-05-29T13:48:03.829740797Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "beb57a34594ea7991130c42d0b6e51da5c732ace",
"ref": "refs/heads/main"
}
}
}
[13:48:04.129] Task URL: https://cr-buildbucket.appspot.com/build/8779757192088957521
[13:48:04.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:2:0) after 3m31s
[13:50:55.459] Received PubSub notification, asking Buildbucket for the build status
[13:50:55.493] Build status: STARTED
[13:51:35.151] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:2:0)
[13:51:35.172] Build status: STARTED
[13:51:35.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:4:0) after 1m45s
[13:53:20.188] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:4:0)
[13:53:20.251] Build status: STARTED
[13:53:20.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:5:0) after 9m3s
[14:02:23.259] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:5:0)
[14:02:23.274] Build status: STARTED
[14:02:23.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:6:0) after 4m7s
[14:06:30.336] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:6:0)
[14:06:30.365] Build status: STARTED
[14:06:30.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:7:0) after 1m25s
[14:07:55.381] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:7:0)
[14:07:55.408] Build status: STARTED
[14:07:55.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:8:0) after 5m59s
[14:13:54.511] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:8:0)
[14:13:54.540] Build status: STARTED
[14:13:54.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:9:0) after 9m38s
[14:23:32.554] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:9:0)
[14:23:32.576] Build status: STARTED
[14:23:32.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:10:0) after 7m57s
[14:31:29.817] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:10:0)
[14:31:29.852] Build status: STARTED
[14:31:29.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:11:0) after 3m30s
[14:34:59.879] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:11:0)
[14:34:59.900] Build status: STARTED
[14:34:59.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:12:0) after 6m42s
[14:41:41.938] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:12:0)
[14:41:41.954] Build status: STARTED
[14:41:41.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:13:0) after 8m36s
[14:50:18.031] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:13:0)
[14:50:18.048] Build status: STARTED
[14:50:18.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:14:0) after 9m9s
[14:59:27.149] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:14:0)
[14:59:27.179] Build status: STARTED
[14:59:27.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:15:0) after 2m33s
[15:02:00.209] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:15:0)
[15:02:00.237] Build status: STARTED
[15:02:00.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:16:0) after 1m40s
[15:03:40.262] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:16:0)
[15:03:40.286] Build status: STARTED
[15:03:40.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:17:0) after 9m15s
[15:12:55.308] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:17:0)
[15:12:55.327] Build status: STARTED
[15:12:55.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:18:0) after 3m38s
[15:16:33.349] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:18:0)
[15:16:33.374] Build status: STARTED
[15:16:33.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:19:0) after 4m42s
[15:21:15.392] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:19:0)
[15:21:15.409] Build status: STARTED
[15:21:15.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:20:0) after 4m15s
[15:25:30.812] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:20:0)
[15:25:30.833] Build status: STARTED
[15:25:30.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:21:0) after 4m19s
[15:29:49.798] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:21:0)
[15:29:49.815] Build status: STARTED
[15:29:49.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:22:0) after 2m39s
[15:32:29.013] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:22:0)
[15:32:29.035] Build status: STARTED
[15:32:29.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:23:0) after 2m18s
[15:34:47.063] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:23:0)
[15:34:47.095] Build status: STARTED
[15:34:47.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:24:0) after 5m11s
[15:39:58.126] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:24:0)
[15:39:58.170] Build status: STARTED
[15:39:58.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:25:0) after 9m53s
[15:49:51.196] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:25:0)
[15:49:51.217] Build status: STARTED
[15:49:51.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:26:0) after 1m7s
[15:50:58.202] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:26:0)
[15:50:58.225] Build status: STARTED
[15:50:58.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:27:0) after 7m22s
[15:58:20.248] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:27:0)
[15:58:20.268] Build status: STARTED
[15:58:20.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:28:0) after 2m41s
[16:01:01.285] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:28:0)
[16:01:01.300] Build status: STARTED
[16:01:01.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:29:0) after 3m55s
[16:04:56.471] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:29:0)
[16:04:56.491] Build status: STARTED
[16:04:56.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:30:0) after 2m38s
[16:07:34.514] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:30:0)
[16:07:34.542] Build status: STARTED
[16:07:34.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:31:0) after 2m49s
[16:10:23.559] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:31:0)
[16:10:23.669] Build status: STARTED
[16:10:23.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:32:0) after 5m0s
[16:15:23.685] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:32:0)
[16:15:23.706] Build status: STARTED
[16:15:23.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:33:0) after 7m37s
[16:23:00.754] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:33:0)
[16:23:00.770] Build status: STARTED
[16:23:00.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:34:0) after 2m3s
[16:25:03.787] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:34:0)
[16:25:03.809] Build status: STARTED
[16:25:03.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:35:0) after 2m34s
[16:27:37.824] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:35:0)
[16:27:37.853] Build status: STARTED
[16:27:37.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:36:0) after 9m7s
[16:36:44.892] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:36:0)
[16:36:44.908] Build status: STARTED
[16:36:44.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:37:0) after 8m54s
[16:45:39.023] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:37:0)
[16:45:39.046] Build status: STARTED
[16:45:39.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:38:0) after 2m42s
[16:48:21.187] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:38:0)
[16:48:21.207] Build status: STARTED
[16:48:21.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:39:0) after 4m6s
[16:52:27.337] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:39:0)
[16:52:27.381] Build status: STARTED
[16:52:27.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:40:0) after 2m33s
[16:55:00.405] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:40:0)
[16:55:00.445] Build status: STARTED
[16:55:00.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:41:0) after 5m41s
[17:00:41.503] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:41:0)
[17:00:41.541] Build status: STARTED
[17:00:41.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:42:0) after 4m18s
[17:04:59.686] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:42:0)
[17:04:59.715] Build status: STARTED
[17:04:59.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:43:0) after 4m17s
[17:09:16.730] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:43:0)
[17:09:16.762] Build status: STARTED
[17:09:16.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:44:0) after 4m4s
[17:13:21.091] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:44:0)
[17:13:21.117] Build status: STARTED
[17:13:21.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:45:0) after 6m44s
[17:20:05.238] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:45:0)
[17:20:05.262] Build status: STARTED
[17:20:05.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:46:0) after 8m33s
[17:28:38.300] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:46:0)
[17:28:38.335] Build status: STARTED
[17:28:38.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:47:0) after 4m25s
[17:33:03.505] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:47:0)
[17:33:03.525] Build status: STARTED
[17:33:03.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:48:0) after 3m53s
[17:36:56.700] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:48:0)
[17:36:56.724] Build status: STARTED
[17:36:56.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:49:0) after 7m14s
[17:44:10.746] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:49:0)
[17:44:10.813] Build status: STARTED
[17:44:10.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:50:0) after 2m18s
[17:46:28.832] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:50:0)
[17:46:28.907] Build status: STARTED
[17:46:28.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:51:0) after 4m6s
[17:50:34.920] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:51:0)
[17:50:34.940] Build status: STARTED
[17:50:34.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:52:0) after 4m28s
[17:55:03.079] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:52:0)
[17:55:03.100] Build status: STARTED
[17:55:03.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:53:0) after 4m17s
[17:59:20.116] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:53:0)
[17:59:20.137] Build status: STARTED
[17:59:20.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:54:0) after 8m23s
[18:07:43.155] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:54:0)
[18:07:43.172] Build status: STARTED
[18:07:43.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:55:0) after 5m43s
[18:13:26.418] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:55:0)
[18:13:26.461] Build status: STARTED
[18:13:26.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:56:0) after 6m37s
[18:20:03.557] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:56:0)
[18:20:03.581] Build status: STARTED
[18:20:03.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:57:0) after 8m4s
[18:28:07.598] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:57:0)
[18:28:07.619] Build status: STARTED
[18:28:07.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:58:0) after 3m7s
[18:31:14.644] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:58:0)
[18:31:14.670] Build status: STARTED
[18:31:14.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:59:0) after 5m33s
[18:36:47.693] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:59:0)
[18:36:47.716] Build status: STARTED
[18:36:47.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:60:0) after 9m9s
[18:45:56.804] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:60:0)
[18:45:56.830] Build status: STARTED
[18:45:56.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:61:0) after 2m33s
[18:48:30.191] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:61:0)
[18:48:30.266] Build status: STARTED
[18:48:30.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:62:0) after 2m59s
[18:51:29.397] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:62:0)
[18:51:29.420] Build status: STARTED
[18:51:29.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:63:0) after 5m47s
[18:57:16.452] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:63:0)
[18:57:16.576] Build status: STARTED
[18:57:16.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945187253940323056:64:0) after 7m42s
[19:01:43.340] Received PubSub notification, asking Buildbucket for the build status
[19:01:43.382] Build:
{
"id": "8779757192088957521",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29494,
"createdBy": "project:chromium",
"createTime": "2023-05-29T13:48:03.829740797Z",
"startTime": "2023-05-29T13:50:54.903064Z",
"endTime": "2023-05-29T19:01:43.070286239Z",
"updateTime": "2023-05-29T19:01:43.070286239Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "beb57a34594ea7991130c42d0b6e51da5c732ace",
"ref": "refs/heads/main"
}
}
}
[19:01:43.382] Invocation finished in 5h13m40.702344963s with status FAILED