[11:15:37.062] New invocation is queued and will start shortly
[11:15:38.113] Starting the invocation (attempt 1)
[11:15:38.154] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/4235f56f35ccc66e3d0a722b52deef425a745a7b"
[11:15:38.154] Popped gitiles commit info from properties and tags
[11:15:38.154] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:15:38.154] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:15:38.154] Buildbucket request:
{
"requestId": "9013235165604715360",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4235f56f35ccc66e3d0a722b52deef425a745a7b",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9013235165604715360"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:15:38.747] Scheduled build:
{
"id": "8847805103675101904",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22091,
"createdBy": "project:chromium",
"createTime": "2021-05-08T11:15:38.264138Z",
"updateTime": "2021-05-08T11:15:38.686976Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4235f56f35ccc66e3d0a722b52deef425a745a7b",
"ref": "refs/heads/master"
}
}
}
[11:15:38.747] Task URL: https://cr-buildbucket.appspot.com/build/8847805103675101904
[11:15:38.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:2:0) after 5m34s
[11:18:41.335] Received PubSub notification, asking Buildbucket for the build status
[11:18:41.365] Build status: STARTED
[11:21:12.821] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:2:0)
[11:21:12.847] Build status: STARTED
[11:21:12.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:4:0) after 7m3s
[11:28:16.229] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:4:0)
[11:28:16.252] Build status: STARTED
[11:28:16.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:5:0) after 3m28s
[11:31:44.265] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:5:0)
[11:31:44.291] Build status: STARTED
[11:31:44.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:6:0) after 6m12s
[11:37:56.428] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:6:0)
[11:37:56.460] Build status: STARTED
[11:37:56.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:7:0) after 9m2s
[11:46:58.612] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:7:0)
[11:46:58.636] Build status: STARTED
[11:46:58.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:8:0) after 9m23s
[11:56:21.649] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:8:0)
[11:56:21.673] Build status: STARTED
[11:56:21.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:9:0) after 7m44s
[12:04:05.902] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:9:0)
[12:04:05.929] Build status: STARTED
[12:04:05.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:10:0) after 2m12s
[12:06:18.032] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:10:0)
[12:06:18.057] Build status: STARTED
[12:06:18.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:11:0) after 3m17s
[12:09:35.266] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:11:0)
[12:09:35.297] Build status: STARTED
[12:09:35.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:12:0) after 6m14s
[12:15:49.555] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:12:0)
[12:15:49.581] Build status: STARTED
[12:15:49.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:13:0) after 4m58s
[12:20:47.863] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:13:0)
[12:20:47.890] Build status: STARTED
[12:20:47.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:14:0) after 8m13s
[12:29:01.304] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:14:0)
[12:29:01.382] Build status: STARTED
[12:29:01.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:15:0) after 1m43s
[12:30:44.408] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:15:0)
[12:30:44.438] Build status: STARTED
[12:30:44.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:16:0) after 6m11s
[12:36:56.121] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:16:0)
[12:36:56.157] Build status: STARTED
[12:36:56.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:17:0) after 9m11s
[12:46:07.336] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:17:0)
[12:46:07.364] Build status: STARTED
[12:46:07.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:18:0) after 6m13s
[12:52:20.392] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:18:0)
[12:52:20.430] Build status: STARTED
[12:52:20.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:19:0) after 7m15s
[12:59:35.621] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:19:0)
[12:59:35.694] Build status: STARTED
[12:59:35.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:20:0) after 9m41s
[13:09:16.712] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:20:0)
[13:09:16.741] Build status: STARTED
[13:09:16.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:21:0) after 1m40s
[13:10:56.934] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:21:0)
[13:10:56.965] Build status: STARTED
[13:10:56.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:22:0) after 1m37s
[13:12:33.983] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:22:0)
[13:12:34.017] Build status: STARTED
[13:12:34.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:23:0) after 4m48s
[13:17:22.036] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:23:0)
[13:17:22.062] Build status: STARTED
[13:17:22.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:24:0) after 2m8s
[13:19:30.135] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:24:0)
[13:19:30.167] Build status: STARTED
[13:19:30.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:25:0) after 8m10s
[13:27:40.194] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:25:0)
[13:27:40.222] Build status: STARTED
[13:27:40.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:26:0) after 7m55s
[13:35:35.240] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:26:0)
[13:35:35.284] Build status: STARTED
[13:35:35.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:27:0) after 3m20s
[13:38:55.302] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:27:0)
[13:38:55.332] Build status: STARTED
[13:38:55.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:28:0) after 6m16s
[13:45:11.507] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:28:0)
[13:45:11.533] Build status: STARTED
[13:45:11.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:29:0) after 4m15s
[13:49:26.552] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:29:0)
[13:49:26.576] Build status: STARTED
[13:49:26.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:30:0) after 6m18s
[13:55:44.599] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:30:0)
[13:55:44.625] Build status: STARTED
[13:55:44.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:31:0) after 8m0s
[14:03:44.780] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:31:0)
[14:03:44.805] Build status: STARTED
[14:03:44.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:32:0) after 9m52s
[14:13:36.906] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:32:0)
[14:13:36.933] Build status: STARTED
[14:13:36.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:33:0) after 9m38s
[14:23:14.960] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:33:0)
[14:23:14.984] Build status: STARTED
[14:23:14.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:34:0) after 1m36s
[14:24:51.098] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:34:0)
[14:24:51.139] Build status: STARTED
[14:24:51.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:35:0) after 3m18s
[14:28:09.190] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:35:0)
[14:28:09.242] Build status: STARTED
[14:28:09.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:36:0) after 8m38s
[14:36:47.612] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:36:0)
[14:36:47.636] Build status: STARTED
[14:36:47.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:37:0) after 1m57s
[14:38:44.676] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:37:0)
[14:38:44.704] Build status: STARTED
[14:38:44.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:38:0) after 6m25s
[14:45:09.725] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:38:0)
[14:45:09.760] Build status: STARTED
[14:45:09.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:39:0) after 2m16s
[14:47:25.788] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:39:0)
[14:47:25.817] Build status: STARTED
[14:47:25.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:40:0) after 4m0s
[14:51:25.873] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:40:0)
[14:51:25.904] Build status: STARTED
[14:51:25.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:41:0) after 3m10s
[14:54:35.923] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:41:0)
[14:54:35.958] Build status: STARTED
[14:54:35.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:42:0) after 5m50s
[15:00:27.830] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:42:0)
[15:00:27.887] Build status: STARTED
[15:00:27.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:43:0) after 6m4s
[15:06:32.106] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:43:0)
[15:06:32.135] Build status: STARTED
[15:06:32.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:44:0) after 9m29s
[15:16:01.946] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:44:0)
[15:16:01.996] Build status: STARTED
[15:16:01.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:45:0) after 4m2s
[15:20:04.272] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:45:0)
[15:20:04.303] Build status: STARTED
[15:20:04.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:46:0) after 5m44s
[15:25:48.407] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:46:0)
[15:25:48.434] Build status: STARTED
[15:25:48.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:47:0) after 1m32s
[15:27:21.562] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:47:0)
[15:27:21.587] Build status: STARTED
[15:27:21.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:48:0) after 5m51s
[15:33:12.824] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:48:0)
[15:33:12.855] Build status: STARTED
[15:33:12.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:49:0) after 9m9s
[15:42:21.881] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:49:0)
[15:42:21.907] Build status: STARTED
[15:42:21.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:50:0) after 5m30s
[15:47:51.960] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:50:0)
[15:47:51.986] Build status: STARTED
[15:47:51.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:51:0) after 3m32s
[15:51:24.071] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:51:0)
[15:51:24.097] Build status: STARTED
[15:51:24.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:52:0) after 5m51s
[15:57:15.129] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:52:0)
[15:57:15.155] Build status: STARTED
[15:57:15.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:53:0) after 2m32s
[15:59:47.178] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:53:0)
[15:59:47.213] Build status: STARTED
[15:59:47.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:54:0) after 5m42s
[16:05:29.491] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:54:0)
[16:05:29.523] Build status: STARTED
[16:05:29.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:55:0) after 2m58s
[16:08:27.870] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:55:0)
[16:08:27.898] Build status: STARTED
[16:08:27.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9013235165604715360:56:0) after 7m39s
[16:11:33.381] Received PubSub notification, asking Buildbucket for the build status
[16:11:33.407] Build:
{
"id": "8847805103675101904",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22091,
"createdBy": "project:chromium",
"createTime": "2021-05-08T11:15:38.264138Z",
"startTime": "2021-05-08T11:18:40.745257Z",
"endTime": "2021-05-08T16:11:31.884264363Z",
"updateTime": "2021-05-08T16:11:31.887361441Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4235f56f35ccc66e3d0a722b52deef425a745a7b",
"ref": "refs/heads/master"
}
}
}
[16:11:33.409] Invocation finished in 4h55m56.367745018s with status FAILED