[09:30:56.597] New invocation is queued and will start shortly
[09:30:57.745] Starting the invocation (attempt 1)
[09:30:57.784] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/7928de1ba3078c1e971729cb2f2614302080264f"
[09:30:57.784] Popped gitiles commit info from properties and tags
[09:30:57.784] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:30:57.785] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:30:57.785] Buildbucket request:
{
"requestId": "9005812799900505584",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7928de1ba3078c1e971729cb2f2614302080264f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9005812799900505584"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:30:58.792] Scheduled build:
{
"id": "8840382737806905664",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22849,
"createdBy": "project:chromium",
"createTime": "2021-07-29T09:30:57.960428Z",
"updateTime": "2021-07-29T09:30:58.606621Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7928de1ba3078c1e971729cb2f2614302080264f",
"ref": "refs/heads/main"
}
}
}
[09:30:58.792] Task URL: https://cr-buildbucket.appspot.com/build/8840382737806905664
[09:30:58.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:2:0) after 4m41s
[09:31:46.418] Received PubSub notification, asking Buildbucket for the build status
[09:31:46.444] Build status: STARTED
[09:35:39.815] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:2:0)
[09:35:39.851] Build status: STARTED
[09:35:39.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:4:0) after 9m14s
[09:44:53.833] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:4:0)
[09:44:53.859] Build status: STARTED
[09:44:53.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:5:0) after 1m49s
[09:46:42.957] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:5:0)
[09:46:42.985] Build status: STARTED
[09:46:42.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:6:0) after 1m37s
[09:48:20.034] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:6:0)
[09:48:20.087] Build status: STARTED
[09:48:20.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:7:0) after 1m19s
[09:49:39.109] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:7:0)
[09:49:39.136] Build status: STARTED
[09:49:39.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:8:0) after 6m34s
[09:56:13.314] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:8:0)
[09:56:13.405] Build status: STARTED
[09:56:13.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:9:0) after 7m59s
[10:04:12.538] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:9:0)
[10:04:12.569] Build status: STARTED
[10:04:12.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:10:0) after 9m50s
[10:14:02.597] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:10:0)
[10:14:02.660] Build status: STARTED
[10:14:02.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:11:0) after 1m52s
[10:15:54.789] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:11:0)
[10:15:54.831] Build status: STARTED
[10:15:54.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:12:0) after 4m46s
[10:20:40.948] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:12:0)
[10:20:40.973] Build status: STARTED
[10:20:40.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:13:0) after 6m35s
[10:27:15.991] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:13:0)
[10:27:16.023] Build status: STARTED
[10:27:16.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:14:0) after 4m34s
[10:31:50.144] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:14:0)
[10:31:50.171] Build status: STARTED
[10:31:50.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:15:0) after 5m15s
[10:37:05.232] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:15:0)
[10:37:05.257] Build status: STARTED
[10:37:05.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:16:0) after 2m27s
[10:39:32.443] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:16:0)
[10:39:32.483] Build status: STARTED
[10:39:32.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:17:0) after 8m56s
[10:48:29.415] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:17:0)
[10:48:29.442] Build status: STARTED
[10:48:29.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:18:0) after 8m30s
[10:56:59.595] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:18:0)
[10:56:59.622] Build status: STARTED
[10:56:59.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:19:0) after 4m45s
[11:01:44.681] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:19:0)
[11:01:44.710] Build status: STARTED
[11:01:44.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:20:0) after 7m33s
[11:09:17.829] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:20:0)
[11:09:17.859] Build status: STARTED
[11:09:17.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:21:0) after 2m34s
[11:11:52.230] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:21:0)
[11:11:52.259] Build status: STARTED
[11:11:52.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:22:0) after 7m7s
[11:18:59.303] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:22:0)
[11:18:59.333] Build status: STARTED
[11:18:59.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:23:0) after 7m41s
[11:26:40.378] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:23:0)
[11:26:40.407] Build status: STARTED
[11:26:40.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:24:0) after 7m27s
[11:34:07.432] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:24:0)
[11:34:07.469] Build status: STARTED
[11:34:07.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:25:0) after 9m9s
[11:43:16.784] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:25:0)
[11:43:16.860] Build status: STARTED
[11:43:16.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:26:0) after 5m51s
[11:49:07.878] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:26:0)
[11:49:07.922] Build status: STARTED
[11:49:07.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:27:0) after 6m39s
[11:55:47.013] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:27:0)
[11:55:47.047] Build status: STARTED
[11:55:47.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:28:0) after 8m34s
[12:04:21.067] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:28:0)
[12:04:21.099] Build status: STARTED
[12:04:21.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:29:0) after 9m42s
[12:14:03.129] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:29:0)
[12:14:03.163] Build status: STARTED
[12:14:03.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:30:0) after 7m26s
[12:21:29.179] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:30:0)
[12:21:29.206] Build status: STARTED
[12:21:29.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:31:0) after 9m45s
[12:31:14.312] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:31:0)
[12:31:14.340] Build status: STARTED
[12:31:14.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:32:0) after 9m0s
[12:40:14.361] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:32:0)
[12:40:14.395] Build status: STARTED
[12:40:14.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:33:0) after 1m15s
[12:41:29.414] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:33:0)
[12:41:29.455] Build status: STARTED
[12:41:29.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:34:0) after 5m33s
[12:47:02.478] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:34:0)
[12:47:02.609] Build status: STARTED
[12:47:02.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:35:0) after 6m51s
[12:53:53.627] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:35:0)
[12:53:53.654] Build status: STARTED
[12:53:53.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:36:0) after 8m59s
[13:02:52.680] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:36:0)
[13:02:52.704] Build status: STARTED
[13:02:52.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:37:0) after 7m35s
[13:10:27.721] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:37:0)
[13:10:27.750] Build status: STARTED
[13:10:27.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:38:0) after 1m54s
[13:12:22.299] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:38:0)
[13:12:22.328] Build status: STARTED
[13:12:22.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:39:0) after 6m43s
[13:19:05.538] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:39:0)
[13:19:05.567] Build status: STARTED
[13:19:05.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:40:0) after 4m20s
[13:23:25.593] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:40:0)
[13:23:25.622] Build status: STARTED
[13:23:25.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:41:0) after 4m59s
[13:28:24.743] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:41:0)
[13:28:24.771] Build status: STARTED
[13:28:24.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:42:0) after 7m32s
[13:35:56.751] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:42:0)
[13:35:56.877] Build status: STARTED
[13:35:56.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:43:0) after 1m39s
[13:37:35.906] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:43:0)
[13:37:35.935] Build status: STARTED
[13:37:35.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:44:0) after 3m22s
[13:40:58.078] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:44:0)
[13:40:58.108] Build status: STARTED
[13:40:58.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:45:0) after 1m37s
[13:42:35.169] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:45:0)
[13:42:35.195] Build status: STARTED
[13:42:35.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:46:0) after 9m19s
[13:51:54.216] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:46:0)
[13:51:54.244] Build status: STARTED
[13:51:54.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:47:0) after 6m22s
[13:58:16.266] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:47:0)
[13:58:16.294] Build status: STARTED
[13:58:16.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:48:0) after 1m35s
[13:59:51.315] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:48:0)
[13:59:51.433] Build status: STARTED
[13:59:51.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:49:0) after 1m45s
[14:01:36.455] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:49:0)
[14:01:36.493] Build status: STARTED
[14:01:36.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:50:0) after 9m7s
[14:10:43.555] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:50:0)
[14:10:44.888] Build status: STARTED
[14:10:44.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:51:0) after 2m47s
[14:13:32.179] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:51:0)
[14:13:32.219] Build status: STARTED
[14:13:32.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:52:0) after 1m33s
[14:15:05.240] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:52:0)
[14:15:05.286] Build status: STARTED
[14:15:05.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:53:0) after 7m54s
[14:22:59.288] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:53:0)
[14:22:59.318] Build status: STARTED
[14:22:59.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:54:0) after 3m41s
[14:26:40.344] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:54:0)
[14:26:40.391] Build status: STARTED
[14:26:40.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:55:0) after 1m12s
[14:27:52.516] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:55:0)
[14:27:52.591] Build status: STARTED
[14:27:52.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:56:0) after 5m26s
[14:33:18.724] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:56:0)
[14:33:18.751] Build status: STARTED
[14:33:18.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:57:0) after 1m9s
[14:34:27.776] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:57:0)
[14:34:27.810] Build status: STARTED
[14:34:27.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:58:0) after 3m1s
[14:37:28.831] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:58:0)
[14:37:28.863] Build status: STARTED
[14:37:28.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:59:0) after 7m21s
[14:44:49.900] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:59:0)
[14:44:49.995] Build status: STARTED
[14:44:49.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:60:0) after 4m20s
[14:49:10.119] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:60:0)
[14:49:10.153] Build status: STARTED
[14:49:10.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:61:0) after 5m36s
[14:54:46.246] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:61:0)
[14:54:46.281] Build status: STARTED
[14:54:46.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:62:0) after 4m21s
[14:59:07.430] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:62:0)
[14:59:07.459] Build status: STARTED
[14:59:07.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005812799900505584:63:0) after 6m6s
[14:59:21.205] Received PubSub notification, asking Buildbucket for the build status
[14:59:21.231] Build:
{
"id": "8840382737806905664",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22849,
"createdBy": "project:chromium",
"createTime": "2021-07-29T09:30:57.960428Z",
"startTime": "2021-07-29T09:31:45.651721Z",
"endTime": "2021-07-29T14:59:20.187229080Z",
"updateTime": "2021-07-29T14:59:20.187674878Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7928de1ba3078c1e971729cb2f2614302080264f",
"ref": "refs/heads/main"
}
}
}
[14:59:21.231] Invocation finished in 5h28m24.651110112s with status FAILED