[08:43:46.219] New invocation is queued and will start shortly
[08:43:48.792] Starting the invocation (attempt 1)
[08:43:48.830] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/20b02db0b5ffca8d07dc0684567625844cc82933"
[08:43:48.830] Popped gitiles commit info from properties and tags
[08:43:48.830] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:43:48.830] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:43:48.830] Buildbucket request:
{
"requestId": "8999383383150835904",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "20b02db0b5ffca8d07dc0684567625844cc82933",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8999383383150835904"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:43:49.622] Scheduled build:
{
"id": "8833953319639548369",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23318,
"createdBy": "project:chromium",
"createTime": "2021-10-08T08:43:48.936513855Z",
"updateTime": "2021-10-08T08:43:49.234116819Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "20b02db0b5ffca8d07dc0684567625844cc82933",
"ref": "refs/heads/main"
}
}
}
[08:43:49.622] Task URL: https://cr-buildbucket.appspot.com/build/8833953319639548369
[08:43:49.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:2:0) after 2m32s
[08:46:05.245] Received PubSub notification, asking Buildbucket for the build status
[08:46:05.320] Build status: STARTED
[08:46:21.715] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:2:0)
[08:46:21.750] Build status: STARTED
[08:46:21.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:4:0) after 8m53s
[08:55:14.804] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:4:0)
[08:55:14.840] Build status: STARTED
[08:55:14.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:5:0) after 5m2s
[09:00:16.867] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:5:0)
[09:00:16.900] Build status: STARTED
[09:00:16.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:6:0) after 6m20s
[09:06:36.972] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:6:0)
[09:06:37.043] Build status: STARTED
[09:06:37.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:7:0) after 2m20s
[09:08:57.066] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:7:0)
[09:08:57.096] Build status: STARTED
[09:08:57.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:8:0) after 1m1s
[09:09:58.082] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:8:0)
[09:09:58.116] Build status: STARTED
[09:09:58.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:9:0) after 8m0s
[09:17:58.142] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:9:0)
[09:17:58.184] Build status: STARTED
[09:17:58.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:10:0) after 5m57s
[09:23:55.307] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:10:0)
[09:23:55.339] Build status: STARTED
[09:23:55.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:11:0) after 4m12s
[09:28:07.497] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:11:0)
[09:28:07.523] Build status: STARTED
[09:28:07.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:12:0) after 5m21s
[09:33:28.681] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:12:0)
[09:33:28.716] Build status: STARTED
[09:33:28.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:13:0) after 7m54s
[09:41:22.736] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:13:0)
[09:41:22.763] Build status: STARTED
[09:41:22.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:14:0) after 2m26s
[09:43:48.785] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:14:0)
[09:43:48.830] Build status: STARTED
[09:43:48.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:15:0) after 5m10s
[09:48:58.870] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:15:0)
[09:48:58.915] Build status: STARTED
[09:48:58.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:16:0) after 5m41s
[09:54:39.941] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:16:0)
[09:54:39.979] Build status: STARTED
[09:54:39.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:17:0) after 4m27s
[09:59:07.104] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:17:0)
[09:59:07.142] Build status: STARTED
[09:59:07.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:18:0) after 9m29s
[10:08:36.166] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:18:0)
[10:08:36.203] Build status: STARTED
[10:08:36.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:19:0) after 2m56s
[10:11:32.569] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:19:0)
[10:11:32.613] Build status: STARTED
[10:11:32.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:20:0) after 6m11s
[10:17:43.652] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:20:0)
[10:17:43.684] Build status: STARTED
[10:17:43.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:21:0) after 4m31s
[10:22:14.714] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:21:0)
[10:22:14.878] Build status: STARTED
[10:22:14.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:22:0) after 7m23s
[10:29:38.119] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:22:0)
[10:29:38.155] Build status: STARTED
[10:29:38.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:23:0) after 9m9s
[10:38:47.229] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:23:0)
[10:38:47.257] Build status: STARTED
[10:38:47.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:24:0) after 8m9s
[10:46:56.378] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:24:0)
[10:46:56.414] Build status: STARTED
[10:46:56.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:25:0) after 9m43s
[10:56:39.413] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:25:0)
[10:56:39.449] Build status: STARTED
[10:56:39.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:26:0) after 6m49s
[11:03:28.572] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:26:0)
[11:03:28.605] Build status: STARTED
[11:03:28.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:27:0) after 3m45s
[11:07:13.738] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:27:0)
[11:07:13.778] Build status: STARTED
[11:07:13.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:28:0) after 7m0s
[11:14:13.935] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:28:0)
[11:14:14.062] Build status: STARTED
[11:14:14.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:29:0) after 5m39s
[11:19:53.112] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:29:0)
[11:19:53.141] Build status: STARTED
[11:19:53.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:30:0) after 5m13s
[11:25:06.183] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:30:0)
[11:25:06.216] Build status: STARTED
[11:25:06.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:31:0) after 3m20s
[11:28:26.238] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:31:0)
[11:28:26.271] Build status: STARTED
[11:28:26.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:32:0) after 9m26s
[11:37:52.457] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:32:0)
[11:37:52.488] Build status: STARTED
[11:37:52.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:33:0) after 7m54s
[11:45:46.668] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:33:0)
[11:45:46.773] Build status: STARTED
[11:45:46.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:34:0) after 6m44s
[11:52:30.815] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:34:0)
[11:52:30.859] Build status: STARTED
[11:52:30.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:35:0) after 7m8s
[11:59:38.879] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:35:0)
[11:59:38.916] Build status: STARTED
[11:59:38.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:36:0) after 1m13s
[12:00:52.695] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:36:0)
[12:00:52.736] Build status: STARTED
[12:00:52.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:37:0) after 7m5s
[12:07:57.824] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:37:0)
[12:07:57.863] Build status: STARTED
[12:07:57.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:38:0) after 5m13s
[12:13:10.893] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:38:0)
[12:13:11.392] Build status: STARTED
[12:13:11.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:39:0) after 3m34s
[12:16:45.410] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:39:0)
[12:16:45.441] Build status: STARTED
[12:16:45.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:40:0) after 6m47s
[12:23:32.450] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:40:0)
[12:23:32.481] Build status: STARTED
[12:23:32.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:41:0) after 9m26s
[12:32:58.542] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:41:0)
[12:32:58.577] Build status: STARTED
[12:32:58.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:42:0) after 4m32s
[12:37:30.701] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:42:0)
[12:37:30.728] Build status: STARTED
[12:37:30.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:43:0) after 2m56s
[12:40:26.835] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:43:0)
[12:40:26.888] Build status: STARTED
[12:40:26.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:44:0) after 6m49s
[12:47:15.908] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:44:0)
[12:47:15.941] Build status: STARTED
[12:47:15.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:45:0) after 7m30s
[12:54:45.975] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:45:0)
[12:54:46.045] Build status: STARTED
[12:54:46.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:46:0) after 6m39s
[13:01:25.116] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:46:0)
[13:01:25.149] Build status: STARTED
[13:01:25.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:47:0) after 8m43s
[13:10:08.191] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:47:0)
[13:10:08.242] Build status: STARTED
[13:10:08.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:48:0) after 5m54s
[13:16:02.395] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:48:0)
[13:16:02.423] Build status: STARTED
[13:16:02.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:49:0) after 2m20s
[13:18:22.488] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:49:0)
[13:18:22.543] Build status: STARTED
[13:18:22.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:50:0) after 4m29s
[13:22:51.581] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:50:0)
[13:22:51.624] Build status: STARTED
[13:22:51.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:51:0) after 7m33s
[13:30:24.883] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:51:0)
[13:30:24.945] Build status: STARTED
[13:30:24.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:52:0) after 6m37s
[13:37:02.070] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:52:0)
[13:37:02.195] Build status: STARTED
[13:37:02.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:53:0) after 7m44s
[13:44:46.271] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:53:0)
[13:44:46.355] Build status: STARTED
[13:44:46.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:54:0) after 5m5s
[13:49:51.475] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:54:0)
[13:49:51.504] Build status: STARTED
[13:49:51.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:55:0) after 5m8s
[13:54:59.539] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:55:0)
[13:54:59.567] Build status: STARTED
[13:54:59.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:56:0) after 5m45s
[14:00:44.758] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:56:0)
[14:00:44.911] Build status: STARTED
[14:00:44.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:57:0) after 6m16s
[14:07:01.077] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:57:0)
[14:07:01.193] Build status: STARTED
[14:07:01.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8999383383150835904:58:0) after 6m32s
[14:08:54.116] Received PubSub notification, asking Buildbucket for the build status
[14:08:54.147] Build:
{
"id": "8833953319639548369",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23318,
"createdBy": "project:chromium",
"createTime": "2021-10-08T08:43:48.936513855Z",
"startTime": "2021-10-08T08:46:04.598210Z",
"endTime": "2021-10-08T14:08:53.805715838Z",
"updateTime": "2021-10-08T14:08:53.806036885Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "20b02db0b5ffca8d07dc0684567625844cc82933",
"ref": "refs/heads/main"
}
}
}
[14:08:54.147] Invocation finished in 5h25m7.943903842s with status FAILED