[22:52:17.051] New invocation is queued and will start shortly
[22:52:18.134] Starting the invocation (attempt 1)
[22:52:18.171] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f7cb0f11041d47b848a84d5a82f4bb7e5dace6a0"
[22:52:18.171] Popped gitiles commit info from properties and tags
[22:52:18.171] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:52:18.171] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:52:18.171] Buildbucket request:
{
"requestId": "9005037608159007216",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f7cb0f11041d47b848a84d5a82f4bb7e5dace6a0",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9005037608159007216"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:52:19.072] Scheduled build:
{
"id": "8839607546201716016",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22893,
"createdBy": "project:chromium",
"createTime": "2021-08-06T22:52:18.284711Z",
"updateTime": "2021-08-06T22:52:18.990769Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f7cb0f11041d47b848a84d5a82f4bb7e5dace6a0",
"ref": "refs/heads/main"
}
}
}
[22:52:19.072] Task URL: https://cr-buildbucket.appspot.com/build/8839607546201716016
[22:52:19.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:2:0) after 5m47s
[22:54:56.643] Received PubSub notification, asking Buildbucket for the build status
[22:54:56.669] Build status: STARTED
[22:58:06.084] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:2:0)
[22:58:06.116] Build status: STARTED
[22:58:06.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:4:0) after 6m29s
[23:04:35.140] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:4:0)
[23:04:35.169] Build status: STARTED
[23:04:35.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:5:0) after 9m9s
[23:13:44.207] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:5:0)
[23:13:44.236] Build status: STARTED
[23:13:44.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:6:0) after 6m47s
[23:20:31.275] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:6:0)
[23:20:31.312] Build status: STARTED
[23:20:31.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:7:0) after 7m0s
[23:27:31.334] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:7:0)
[23:27:31.367] Build status: STARTED
[23:27:31.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:8:0) after 5m19s
[23:32:50.391] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:8:0)
[23:32:50.425] Build status: STARTED
[23:32:50.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:9:0) after 2m57s
[23:35:47.460] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:9:0)
[23:35:47.488] Build status: STARTED
[23:35:47.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:10:0) after 9m51s
[23:45:38.493] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:10:0)
[23:45:38.565] Build status: STARTED
[23:45:38.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:11:0) after 2m42s
[23:48:20.616] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:11:0)
[23:48:20.710] Build status: STARTED
[23:48:20.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:12:0) after 9m32s
[23:57:52.930] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:12:0)
[23:57:53.001] Build status: STARTED
[23:57:53.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:13:0) after 3m59s
[00:01:52.301] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:13:0)
[00:01:52.331] Build status: STARTED
[00:01:52.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:14:0) after 4m40s
[00:06:32.354] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:14:0)
[00:06:32.386] Build status: STARTED
[00:06:32.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:15:0) after 5m46s
[00:12:18.944] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:15:0)
[00:12:18.975] Build status: STARTED
[00:12:18.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:16:0) after 9m43s
[00:22:02.114] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:16:0)
[00:22:02.147] Build status: STARTED
[00:22:02.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:17:0) after 1m11s
[00:23:13.249] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:17:0)
[00:23:13.281] Build status: STARTED
[00:23:13.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:18:0) after 5m4s
[00:28:17.307] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:18:0)
[00:28:17.339] Build status: STARTED
[00:28:17.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:19:0) after 7m47s
[00:36:04.493] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:19:0)
[00:36:04.531] Build status: STARTED
[00:36:04.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:20:0) after 4m34s
[00:40:38.551] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:20:0)
[00:40:38.597] Build status: STARTED
[00:40:38.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:21:0) after 8m38s
[00:49:16.620] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:21:0)
[00:49:16.645] Build status: STARTED
[00:49:16.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:22:0) after 5m47s
[00:55:03.847] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:22:0)
[00:55:03.877] Build status: STARTED
[00:55:03.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:23:0) after 9m12s
[01:04:15.911] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:23:0)
[01:04:15.945] Build status: STARTED
[01:04:15.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:24:0) after 3m1s
[01:07:17.024] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:24:0)
[01:07:17.053] Build status: STARTED
[01:07:17.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:25:0) after 2m38s
[01:09:55.118] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:25:0)
[01:09:55.149] Build status: STARTED
[01:09:55.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:26:0) after 1m56s
[01:11:51.395] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:26:0)
[01:11:51.424] Build status: STARTED
[01:11:51.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:27:0) after 1m30s
[01:13:21.658] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:27:0)
[01:13:21.689] Build status: STARTED
[01:13:21.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:28:0) after 1m4s
[01:14:26.045] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:28:0)
[01:14:26.072] Build status: STARTED
[01:14:26.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:29:0) after 8m16s
[01:22:42.240] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:29:0)
[01:22:42.272] Build status: STARTED
[01:22:42.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:30:0) after 9m39s
[01:32:21.546] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:30:0)
[01:32:21.576] Build status: STARTED
[01:32:21.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:31:0) after 6m9s
[01:38:30.690] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:31:0)
[01:38:30.720] Build status: STARTED
[01:38:30.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:32:0) after 8m37s
[01:47:07.845] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:32:0)
[01:47:07.877] Build status: STARTED
[01:47:07.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:33:0) after 6m46s
[01:53:53.978] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:33:0)
[01:53:54.014] Build status: STARTED
[01:53:54.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:34:0) after 3m35s
[01:57:29.037] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:34:0)
[01:57:29.069] Build status: STARTED
[01:57:29.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:35:0) after 4m11s
[02:01:40.117] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:35:0)
[02:01:40.149] Build status: STARTED
[02:01:40.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:36:0) after 6m0s
[02:07:40.214] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:36:0)
[02:07:40.240] Build status: STARTED
[02:07:40.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:37:0) after 9m19s
[02:16:59.304] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:37:0)
[02:16:59.388] Build status: STARTED
[02:16:59.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:38:0) after 9m48s
[02:26:47.814] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:38:0)
[02:26:47.843] Build status: STARTED
[02:26:47.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:39:0) after 8m0s
[02:34:47.895] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:39:0)
[02:34:47.925] Build status: STARTED
[02:34:47.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:40:0) after 9m17s
[02:44:05.169] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:40:0)
[02:44:05.205] Build status: STARTED
[02:44:05.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:41:0) after 3m13s
[02:47:18.383] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:41:0)
[02:47:18.413] Build status: STARTED
[02:47:18.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:42:0) after 5m44s
[02:53:02.646] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:42:0)
[02:53:02.672] Build status: STARTED
[02:53:02.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:43:0) after 9m24s
[03:02:26.730] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:43:0)
[03:02:26.761] Build status: STARTED
[03:02:26.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:44:0) after 4m12s
[03:06:38.787] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:44:0)
[03:06:38.844] Build status: STARTED
[03:06:38.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:45:0) after 8m28s
[03:15:07.138] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:45:0)
[03:15:07.170] Build status: STARTED
[03:15:07.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:46:0) after 9m46s
[03:24:53.432] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:46:0)
[03:24:53.464] Build status: STARTED
[03:24:53.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:47:0) after 9m35s
[03:34:28.490] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:47:0)
[03:34:28.520] Build status: STARTED
[03:34:28.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:48:0) after 9m57s
[03:44:25.554] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:48:0)
[03:44:25.580] Build status: STARTED
[03:44:25.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:49:0) after 8m57s
[03:53:22.606] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:49:0)
[03:53:22.636] Build status: STARTED
[03:53:22.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:50:0) after 9m49s
[04:03:11.669] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:50:0)
[04:03:11.703] Build status: STARTED
[04:03:11.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:51:0) after 6m43s
[04:09:54.775] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:51:0)
[04:09:54.830] Build status: STARTED
[04:09:54.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:52:0) after 4m50s
[04:14:44.931] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:52:0)
[04:14:44.959] Build status: STARTED
[04:14:44.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:53:0) after 3m35s
[04:18:20.298] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:53:0)
[04:18:20.326] Build status: STARTED
[04:18:20.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005037608159007216:54:0) after 2m42s
[04:18:26.465] Received PubSub notification, asking Buildbucket for the build status
[04:18:26.511] Build:
{
"id": "8839607546201716016",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22893,
"createdBy": "project:chromium",
"createTime": "2021-08-06T22:52:18.284711Z",
"startTime": "2021-08-06T22:54:56.097733Z",
"endTime": "2021-08-07T04:18:26.189499569Z",
"updateTime": "2021-08-07T04:18:26.189998906Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f7cb0f11041d47b848a84d5a82f4bb7e5dace6a0",
"ref": "refs/heads/main"
}
}
}
[04:18:26.511] Invocation finished in 5h26m9.476895202s with status FAILED