[07:27:40.293] New invocation is queued and will start shortly
[07:27:41.644] Starting the invocation (attempt 1)
[07:27:41.680] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/584ff409a545e5392b0af8585258ac11173c83cc"
[07:27:41.680] Popped gitiles commit info from properties and tags
[07:27:41.680] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:27:41.680] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:27:41.680] Buildbucket request:
{
"requestId": "8997032649744533504",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "584ff409a545e5392b0af8585258ac11173c83cc",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8997032649744533504"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:27:42.378] Scheduled build:
{
"id": "8831602587570276193",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23503,
"createdBy": "project:chromium",
"createTime": "2021-11-03T07:27:41.735170734Z",
"updateTime": "2021-11-03T07:27:41.735170734Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "584ff409a545e5392b0af8585258ac11173c83cc",
"ref": "refs/heads/main"
}
}
}
[07:27:42.378] Task URL: https://cr-buildbucket.appspot.com/build/8831602587570276193
[07:27:42.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:2:0) after 5m29s
[07:30:19.027] Received PubSub notification, asking Buildbucket for the build status
[07:30:19.055] Build status: STARTED
[07:33:11.357] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:2:0)
[07:33:11.391] Build status: STARTED
[07:33:11.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:4:0) after 6m59s
[07:40:10.523] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:4:0)
[07:40:10.563] Build status: STARTED
[07:40:10.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:5:0) after 2m9s
[07:42:19.693] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:5:0)
[07:42:19.723] Build status: STARTED
[07:42:19.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:6:0) after 2m52s
[07:45:11.913] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:6:0)
[07:45:12.069] Build status: STARTED
[07:45:12.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:7:0) after 2m48s
[07:48:00.179] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:7:0)
[07:48:00.212] Build status: STARTED
[07:48:00.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:8:0) after 2m59s
[07:50:59.255] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:8:0)
[07:50:59.289] Build status: STARTED
[07:50:59.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:9:0) after 2m58s
[07:53:57.392] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:9:0)
[07:53:57.421] Build status: STARTED
[07:53:57.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:10:0) after 7m55s
[08:01:52.556] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:10:0)
[08:01:52.594] Build status: STARTED
[08:01:52.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:11:0) after 7m5s
[08:08:57.747] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:11:0)
[08:08:57.805] Build status: STARTED
[08:08:57.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:12:0) after 1m53s
[08:10:50.949] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:12:0)
[08:10:50.985] Build status: STARTED
[08:10:50.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:13:0) after 5m24s
[08:16:15.004] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:13:0)
[08:16:15.045] Build status: STARTED
[08:16:15.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:14:0) after 4m45s
[08:21:00.069] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:14:0)
[08:21:00.098] Build status: STARTED
[08:21:00.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:15:0) after 7m34s
[08:28:34.188] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:15:0)
[08:28:34.214] Build status: STARTED
[08:28:34.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:16:0) after 1m36s
[08:30:10.512] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:16:0)
[08:30:10.689] Build status: STARTED
[08:30:10.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:17:0) after 6m46s
[08:36:56.707] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:17:0)
[08:36:56.765] Build status: STARTED
[08:36:56.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:18:0) after 4m11s
[08:41:07.846] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:18:0)
[08:41:07.882] Build status: STARTED
[08:41:07.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:19:0) after 6m20s
[08:47:27.954] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:19:0)
[08:47:28.072] Build status: STARTED
[08:47:28.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:20:0) after 1m27s
[08:48:55.089] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:20:0)
[08:48:55.135] Build status: STARTED
[08:48:55.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:21:0) after 1m19s
[08:50:14.250] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:21:0)
[08:50:14.295] Build status: STARTED
[08:50:14.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:22:0) after 4m51s
[08:55:05.288] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:22:0)
[08:55:05.321] Build status: STARTED
[08:55:05.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:23:0) after 2m14s
[08:57:19.338] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:23:0)
[08:57:19.369] Build status: STARTED
[08:57:19.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:24:0) after 7m26s
[09:04:45.390] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:24:0)
[09:04:45.426] Build status: STARTED
[09:04:45.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:25:0) after 8m4s
[09:12:49.788] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:25:0)
[09:12:49.821] Build status: STARTED
[09:12:49.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:26:0) after 7m8s
[09:19:57.840] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:26:0)
[09:19:57.872] Build status: STARTED
[09:19:57.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:27:0) after 6m53s
[09:26:50.912] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:27:0)
[09:26:50.948] Build status: STARTED
[09:26:50.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:28:0) after 8m16s
[09:35:06.978] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:28:0)
[09:35:07.015] Build status: STARTED
[09:35:07.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:29:0) after 8m19s
[09:43:26.109] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:29:0)
[09:43:26.137] Build status: STARTED
[09:43:26.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:30:0) after 7m23s
[09:50:49.159] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:30:0)
[09:50:49.193] Build status: STARTED
[09:50:49.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:31:0) after 5m2s
[09:55:51.221] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:31:0)
[09:55:51.250] Build status: STARTED
[09:55:51.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:32:0) after 4m32s
[10:00:23.275] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:32:0)
[10:00:23.306] Build status: STARTED
[10:00:23.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:33:0) after 6m53s
[10:07:16.308] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:33:0)
[10:07:16.345] Build status: STARTED
[10:07:16.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:34:0) after 6m35s
[10:13:51.544] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:34:0)
[10:13:51.578] Build status: STARTED
[10:13:51.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:35:0) after 7m20s
[10:21:11.705] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:35:0)
[10:21:11.777] Build status: STARTED
[10:21:11.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:36:0) after 6m11s
[10:27:23.065] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:36:0)
[10:27:23.100] Build status: STARTED
[10:27:23.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:37:0) after 6m5s
[10:33:28.207] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:37:0)
[10:33:28.239] Build status: STARTED
[10:33:28.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:38:0) after 3m33s
[10:37:01.280] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:38:0)
[10:37:01.312] Build status: STARTED
[10:37:01.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:39:0) after 4m54s
[10:41:55.340] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:39:0)
[10:41:55.368] Build status: STARTED
[10:41:55.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:40:0) after 7m19s
[10:49:14.469] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:40:0)
[10:49:14.502] Build status: STARTED
[10:49:14.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:41:0) after 1m16s
[10:50:30.534] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:41:0)
[10:50:30.569] Build status: STARTED
[10:50:30.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:42:0) after 4m11s
[10:54:41.677] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:42:0)
[10:54:41.733] Build status: STARTED
[10:54:41.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:43:0) after 5m36s
[11:00:17.802] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:43:0)
[11:00:17.877] Build status: STARTED
[11:00:17.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:44:0) after 1m26s
[11:01:43.911] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:44:0)
[11:01:43.940] Build status: STARTED
[11:01:43.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:45:0) after 3m45s
[11:05:29.076] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:45:0)
[11:05:29.110] Build status: STARTED
[11:05:29.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:46:0) after 4m57s
[11:10:26.146] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:46:0)
[11:10:26.236] Build status: STARTED
[11:10:26.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:47:0) after 2m3s
[11:12:29.361] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:47:0)
[11:12:29.394] Build status: STARTED
[11:12:29.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:48:0) after 9m10s
[11:21:39.423] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:48:0)
[11:21:39.452] Build status: STARTED
[11:21:39.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:49:0) after 7m1s
[11:28:40.604] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:49:0)
[11:28:40.637] Build status: STARTED
[11:28:40.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:50:0) after 9m14s
[11:37:54.662] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:50:0)
[11:37:54.697] Build status: STARTED
[11:37:54.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:51:0) after 1m5s
[11:38:59.717] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:51:0)
[11:38:59.743] Build status: STARTED
[11:38:59.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:52:0) after 4m42s
[11:43:41.876] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:52:0)
[11:43:41.907] Build status: STARTED
[11:43:41.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:53:0) after 8m24s
[11:52:05.996] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:53:0)
[11:52:06.058] Build status: STARTED
[11:52:06.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:54:0) after 9m55s
[12:02:01.373] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:54:0)
[12:02:01.481] Build status: STARTED
[12:02:01.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:55:0) after 7m1s
[12:09:02.586] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:55:0)
[12:09:02.620] Build status: STARTED
[12:09:02.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:56:0) after 6m47s
[12:15:49.702] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:56:0)
[12:15:49.735] Build status: STARTED
[12:15:49.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:57:0) after 9m33s
[12:25:22.852] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:57:0)
[12:25:22.887] Build status: STARTED
[12:25:22.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:58:0) after 9m7s
[12:34:29.911] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:58:0)
[12:34:29.944] Build status: STARTED
[12:34:29.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:59:0) after 9m50s
[12:44:19.963] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:59:0)
[12:44:20.000] Build status: STARTED
[12:44:20.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8997032649744533504:60:0) after 4m21s
[12:46:24.185] Received PubSub notification, asking Buildbucket for the build status
[12:46:24.216] Build:
{
"id": "8831602587570276193",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23503,
"createdBy": "project:chromium",
"createTime": "2021-11-03T07:27:41.735170734Z",
"startTime": "2021-11-03T07:30:18.265589Z",
"endTime": "2021-11-03T12:46:23.901719767Z",
"updateTime": "2021-11-03T12:46:23.901719767Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "584ff409a545e5392b0af8585258ac11173c83cc",
"ref": "refs/heads/main"
}
}
}
[12:46:24.216] Invocation finished in 5h18m43.937522826s with status FAILED