[22:41:12.577] New invocation is queued and will start shortly
[22:41:13.661] Starting the invocation (attempt 1)
[22:41:13.705] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e9f1789187d669a3ee7f57f1528b6dfea0f2633d"
[22:41:13.705] Popped gitiles commit info from properties and tags
[22:41:13.705] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:41:13.705] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:41:13.705] Buildbucket request:
{
"requestId": "9008209198732608928",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e9f1789187d669a3ee7f57f1528b6dfea0f2633d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9008209198732608928"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:41:14.346] Scheduled build:
{
"id": "8842779136790773088",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22477,
"createdBy": "project:chromium",
"createTime": "2021-07-02T22:41:13.797734Z",
"updateTime": "2021-07-02T22:41:14.245203Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e9f1789187d669a3ee7f57f1528b6dfea0f2633d",
"ref": "refs/heads/main"
}
}
}
[22:41:14.346] Task URL: https://cr-buildbucket.appspot.com/build/8842779136790773088
[22:41:14.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:2:0) after 9m36s
[22:43:19.476] Received PubSub notification, asking Buildbucket for the build status
[22:43:19.503] Build status: STARTED
[22:50:50.480] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:2:0)
[22:50:50.508] Build status: STARTED
[22:50:50.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:4:0) after 5m56s
[22:56:46.659] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:4:0)
[22:56:46.719] Build status: STARTED
[22:56:46.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:5:0) after 1m31s
[22:58:17.802] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:5:0)
[22:58:17.844] Build status: STARTED
[22:58:17.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:6:0) after 5m59s
[23:04:16.900] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:6:0)
[23:04:16.949] Build status: STARTED
[23:04:16.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:7:0) after 3m10s
[23:07:27.015] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:7:0)
[23:07:27.044] Build status: STARTED
[23:07:27.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:8:0) after 6m46s
[23:14:13.077] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:8:0)
[23:14:13.107] Build status: STARTED
[23:14:13.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:9:0) after 1m8s
[23:15:21.142] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:9:0)
[23:15:21.182] Build status: STARTED
[23:15:21.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:10:0) after 8m20s
[23:23:41.177] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:10:0)
[23:23:41.206] Build status: STARTED
[23:23:41.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:11:0) after 4m41s
[23:28:22.233] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:11:0)
[23:28:22.265] Build status: STARTED
[23:28:22.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:12:0) after 3m22s
[23:31:44.461] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:12:0)
[23:31:44.487] Build status: STARTED
[23:31:44.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:13:0) after 5m25s
[23:37:09.543] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:13:0)
[23:37:09.571] Build status: STARTED
[23:37:09.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:14:0) after 1m46s
[23:38:55.597] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:14:0)
[23:38:55.629] Build status: STARTED
[23:38:55.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:15:0) after 4m44s
[23:43:39.748] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:15:0)
[23:43:39.781] Build status: STARTED
[23:43:39.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:16:0) after 8m54s
[23:52:33.816] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:16:0)
[23:52:33.846] Build status: STARTED
[23:52:33.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:17:0) after 6m40s
[23:59:13.875] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:17:0)
[23:59:13.921] Build status: STARTED
[23:59:13.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:18:0) after 4m47s
[00:04:01.846] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:18:0)
[00:04:01.951] Build status: STARTED
[00:04:01.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:19:0) after 8m23s
[00:12:24.979] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:19:0)
[00:12:25.016] Build status: STARTED
[00:12:25.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:20:0) after 4m21s
[00:16:46.073] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:20:0)
[00:16:46.109] Build status: STARTED
[00:16:46.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:21:0) after 7m32s
[00:24:18.144] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:21:0)
[00:24:18.183] Build status: STARTED
[00:24:18.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:22:0) after 9m46s
[00:34:04.208] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:22:0)
[00:34:04.235] Build status: STARTED
[00:34:04.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:23:0) after 3m14s
[00:37:18.272] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:23:0)
[00:37:18.312] Build status: STARTED
[00:37:18.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:24:0) after 1m33s
[00:38:51.434] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:24:0)
[00:38:51.618] Build status: STARTED
[00:38:51.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:25:0) after 1m34s
[00:40:25.644] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:25:0)
[00:40:25.735] Build status: STARTED
[00:40:25.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:26:0) after 7m23s
[00:47:48.878] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:26:0)
[00:47:48.913] Build status: STARTED
[00:47:48.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:27:0) after 3m40s
[00:51:29.007] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:27:0)
[00:51:29.037] Build status: STARTED
[00:51:29.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:28:0) after 9m12s
[01:00:41.066] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:28:0)
[01:00:41.117] Build status: STARTED
[01:00:41.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:29:0) after 2m9s
[01:02:50.256] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:29:0)
[01:02:50.290] Build status: STARTED
[01:02:50.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:30:0) after 2m6s
[01:04:56.363] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:30:0)
[01:04:56.399] Build status: STARTED
[01:04:56.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:31:0) after 4m29s
[01:09:25.587] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:31:0)
[01:09:25.618] Build status: STARTED
[01:09:25.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:32:0) after 9m39s
[01:19:04.692] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:32:0)
[01:19:04.722] Build status: STARTED
[01:19:04.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:33:0) after 9m25s
[01:28:29.926] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:33:0)
[01:28:30.009] Build status: STARTED
[01:28:30.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:34:0) after 2m10s
[01:30:40.263] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:34:0)
[01:30:40.295] Build status: STARTED
[01:30:40.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:35:0) after 1m21s
[01:32:01.570] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:35:0)
[01:32:01.770] Build status: STARTED
[01:32:01.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:36:0) after 5m18s
[01:37:19.801] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:36:0)
[01:37:19.831] Build status: STARTED
[01:37:19.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:37:0) after 1m26s
[01:38:45.856] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:37:0)
[01:38:45.918] Build status: STARTED
[01:38:45.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:38:0) after 3m43s
[01:42:29.213] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:38:0)
[01:42:29.243] Build status: STARTED
[01:42:29.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:39:0) after 4m25s
[01:46:54.280] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:39:0)
[01:46:54.328] Build status: STARTED
[01:46:54.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:40:0) after 9m10s
[01:56:04.553] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:40:0)
[01:56:04.584] Build status: STARTED
[01:56:04.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:41:0) after 5m58s
[02:02:02.867] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:41:0)
[02:02:02.924] Build status: STARTED
[02:02:02.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:42:0) after 8m47s
[02:10:49.995] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:42:0)
[02:10:50.108] Build status: STARTED
[02:10:50.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:43:0) after 3m47s
[02:14:37.240] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:43:0)
[02:14:37.268] Build status: STARTED
[02:14:37.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:44:0) after 3m26s
[02:18:03.378] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:44:0)
[02:18:03.407] Build status: STARTED
[02:18:03.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:45:0) after 6m5s
[02:24:08.751] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:45:0)
[02:24:08.786] Build status: STARTED
[02:24:08.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:46:0) after 2m35s
[02:26:44.143] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:46:0)
[02:26:44.176] Build status: STARTED
[02:26:44.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:47:0) after 2m34s
[02:29:18.984] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:47:0)
[02:29:19.040] Build status: STARTED
[02:29:19.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:48:0) after 7m45s
[02:37:04.697] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:48:0)
[02:37:04.728] Build status: STARTED
[02:37:04.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:49:0) after 9m19s
[02:46:23.752] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:49:0)
[02:46:23.787] Build status: STARTED
[02:46:23.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:50:0) after 7m23s
[02:53:46.813] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:50:0)
[02:53:46.842] Build status: STARTED
[02:53:46.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:51:0) after 3m22s
[02:57:08.867] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:51:0)
[02:57:08.897] Build status: STARTED
[02:57:08.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:52:0) after 6m54s
[03:04:03.023] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:52:0)
[03:04:03.051] Build status: STARTED
[03:04:03.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:53:0) after 2m14s
[03:06:17.078] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:53:0)
[03:06:17.111] Build status: STARTED
[03:06:17.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:54:0) after 8m55s
[03:15:12.269] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:54:0)
[03:15:12.297] Build status: STARTED
[03:15:12.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:55:0) after 9m23s
[03:24:35.455] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:55:0)
[03:24:35.491] Build status: STARTED
[03:24:35.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:56:0) after 2m22s
[03:26:57.608] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:56:0)
[03:26:57.645] Build status: STARTED
[03:26:57.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:57:0) after 5m43s
[03:32:40.814] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:57:0)
[03:32:40.842] Build status: STARTED
[03:32:40.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:58:0) after 4m21s
[03:37:03.136] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:58:0)
[03:37:03.166] Build status: STARTED
[03:37:03.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:59:0) after 8m37s
[03:45:40.373] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:59:0)
[03:45:40.402] Build status: STARTED
[03:45:40.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008209198732608928:60:0) after 4m43s
[03:48:45.886] Received PubSub notification, asking Buildbucket for the build status
[03:48:46.116] Build:
{
"id": "8842779136790773088",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22477,
"createdBy": "project:chromium",
"createTime": "2021-07-02T22:41:13.797734Z",
"startTime": "2021-07-02T22:43:18.723546Z",
"endTime": "2021-07-03T03:48:45.457560689Z",
"updateTime": "2021-07-03T03:48:45.457994060Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e9f1789187d669a3ee7f57f1528b6dfea0f2633d",
"ref": "refs/heads/main"
}
}
}
[03:48:46.116] Invocation finished in 5h7m33.553494492s with status FAILED