[20:00:49.434] New invocation is queued and will start shortly
[20:00:50.841] Starting the invocation (attempt 1)
[20:00:50.896] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/72538f0d5658d3b3ef8d61069f8d7160b6e17d07"
[20:00:50.896] Popped gitiles commit info from properties and tags
[20:00:50.896] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:00:50.896] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:00:50.897] Buildbucket request:
{
"requestId": "9008309886300094896",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "72538f0d5658d3b3ef8d61069f8d7160b6e17d07",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9008309886300094896"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:00:52.182] Scheduled build:
{
"id": "8842879823789103456",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22472,
"createdBy": "project:chromium",
"createTime": "2021-07-01T20:00:51.193478Z",
"updateTime": "2021-07-01T20:00:52.002735Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "72538f0d5658d3b3ef8d61069f8d7160b6e17d07",
"ref": "refs/heads/main"
}
}
}
[20:00:52.182] Task URL: https://cr-buildbucket.appspot.com/build/8842879823789103456
[20:00:52.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:2:0) after 5m9s
[20:03:52.328] Received PubSub notification, asking Buildbucket for the build status
[20:03:52.359] Build status: STARTED
[20:06:01.207] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:2:0)
[20:06:01.237] Build status: STARTED
[20:06:01.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:4:0) after 6m49s
[20:12:50.461] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:4:0)
[20:12:50.492] Build status: STARTED
[20:12:50.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:5:0) after 2m1s
[20:14:51.659] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:5:0)
[20:14:51.688] Build status: STARTED
[20:14:51.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:6:0) after 5m46s
[20:20:37.800] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:6:0)
[20:20:37.852] Build status: STARTED
[20:20:37.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:7:0) after 3m3s
[20:23:40.888] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:7:0)
[20:23:40.916] Build status: STARTED
[20:23:40.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:8:0) after 1m17s
[20:24:57.990] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:8:0)
[20:24:58.021] Build status: STARTED
[20:24:58.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:9:0) after 6m7s
[20:31:05.131] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:9:0)
[20:31:05.177] Build status: STARTED
[20:31:05.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:10:0) after 7m39s
[20:38:44.234] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:10:0)
[20:38:44.263] Build status: STARTED
[20:38:44.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:11:0) after 1m4s
[20:39:48.387] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:11:0)
[20:39:48.414] Build status: STARTED
[20:39:48.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:12:0) after 7m49s
[20:47:37.436] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:12:0)
[20:47:37.598] Build status: STARTED
[20:47:37.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:13:0) after 7m39s
[20:55:16.706] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:13:0)
[20:55:16.734] Build status: STARTED
[20:55:16.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:14:0) after 6m47s
[21:02:03.746] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:14:0)
[21:02:03.792] Build status: STARTED
[21:02:03.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:15:0) after 1m52s
[21:03:55.889] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:15:0)
[21:03:55.915] Build status: STARTED
[21:03:55.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:16:0) after 9m33s
[21:13:28.944] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:16:0)
[21:13:28.975] Build status: STARTED
[21:13:28.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:17:0) after 4m47s
[21:18:16.062] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:17:0)
[21:18:16.116] Build status: STARTED
[21:18:16.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:18:0) after 9m10s
[21:27:26.152] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:18:0)
[21:27:26.179] Build status: STARTED
[21:27:26.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:19:0) after 3m8s
[21:30:34.452] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:19:0)
[21:30:35.717] Build status: STARTED
[21:30:35.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:20:0) after 8m3s
[21:38:38.776] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:20:0)
[21:38:38.819] Build status: STARTED
[21:38:38.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:21:0) after 3m2s
[21:41:40.980] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:21:0)
[21:41:41.010] Build status: STARTED
[21:41:41.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:22:0) after 4m53s
[21:46:34.048] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:22:0)
[21:46:34.077] Build status: STARTED
[21:46:34.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:23:0) after 6m46s
[21:53:20.114] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:23:0)
[21:53:20.147] Build status: STARTED
[21:53:20.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:24:0) after 9m37s
[22:02:57.170] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:24:0)
[22:02:57.210] Build status: STARTED
[22:02:57.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:25:0) after 8m34s
[22:11:31.388] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:25:0)
[22:11:31.500] Build status: STARTED
[22:11:31.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:26:0) after 7m15s
[22:18:46.529] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:26:0)
[22:18:46.562] Build status: STARTED
[22:18:46.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:27:0) after 9m57s
[22:28:43.648] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:27:0)
[22:28:43.701] Build status: STARTED
[22:28:43.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:28:0) after 8m53s
[22:37:36.924] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:28:0)
[22:37:36.952] Build status: STARTED
[22:37:36.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:29:0) after 7m27s
[22:45:04.170] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:29:0)
[22:45:04.201] Build status: STARTED
[22:45:04.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:30:0) after 5m41s
[22:50:45.309] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:30:0)
[22:50:45.340] Build status: STARTED
[22:50:45.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:31:0) after 9m57s
[23:00:42.398] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:31:0)
[23:00:42.435] Build status: STARTED
[23:00:42.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:32:0) after 4m17s
[23:04:59.600] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:32:0)
[23:04:59.641] Build status: STARTED
[23:04:59.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:33:0) after 6m0s
[23:10:59.681] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:33:0)
[23:10:59.918] Build status: STARTED
[23:10:59.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:34:0) after 4m16s
[23:15:15.978] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:34:0)
[23:15:16.004] Build status: STARTED
[23:15:16.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:35:0) after 5m36s
[23:20:52.278] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:35:0)
[23:20:52.320] Build status: STARTED
[23:20:52.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:36:0) after 5m52s
[23:26:44.364] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:36:0)
[23:26:44.394] Build status: STARTED
[23:26:44.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:37:0) after 9m41s
[23:36:25.461] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:37:0)
[23:36:25.490] Build status: STARTED
[23:36:25.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:38:0) after 3m48s
[23:40:13.552] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:38:0)
[23:40:13.606] Build status: STARTED
[23:40:13.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:39:0) after 9m28s
[23:49:41.635] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:39:0)
[23:49:41.669] Build status: STARTED
[23:49:41.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:40:0) after 4m10s
[23:53:51.852] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:40:0)
[23:53:51.911] Build status: STARTED
[23:53:51.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:41:0) after 4m54s
[23:58:45.935] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:41:0)
[23:58:45.967] Build status: STARTED
[23:58:45.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:42:0) after 6m29s
[00:05:15.093] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:42:0)
[00:05:15.132] Build status: STARTED
[00:05:15.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:43:0) after 9m13s
[00:14:28.282] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:43:0)
[00:14:28.327] Build status: STARTED
[00:14:28.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:44:0) after 3m34s
[00:18:02.452] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:44:0)
[00:18:02.511] Build status: STARTED
[00:18:02.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:45:0) after 4m18s
[00:22:20.646] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:45:0)
[00:22:20.677] Build status: STARTED
[00:22:20.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:46:0) after 8m47s
[00:31:07.699] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:46:0)
[00:31:07.729] Build status: STARTED
[00:31:07.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:47:0) after 7m21s
[00:38:28.853] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:47:0)
[00:38:28.898] Build status: STARTED
[00:38:28.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:48:0) after 5m13s
[00:43:42.038] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:48:0)
[00:43:42.066] Build status: STARTED
[00:43:42.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:49:0) after 3m27s
[00:47:09.125] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:49:0)
[00:47:09.164] Build status: STARTED
[00:47:09.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:50:0) after 2m10s
[00:49:19.425] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:50:0)
[00:49:19.489] Build status: STARTED
[00:49:19.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:51:0) after 5m56s
[00:55:15.597] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:51:0)
[00:55:15.629] Build status: STARTED
[00:55:15.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:52:0) after 2m45s
[00:58:00.701] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:52:0)
[00:58:00.731] Build status: STARTED
[00:58:00.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:53:0) after 7m54s
[01:05:54.760] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:53:0)
[01:05:54.808] Build status: STARTED
[01:05:54.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:54:0) after 5m33s
[01:11:27.835] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:54:0)
[01:11:27.870] Build status: STARTED
[01:11:27.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9008309886300094896:55:0) after 7m17s
[01:12:16.191] Received PubSub notification, asking Buildbucket for the build status
[01:12:16.227] Build:
{
"id": "8842879823789103456",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22472,
"createdBy": "project:chromium",
"createTime": "2021-07-01T20:00:51.193478Z",
"startTime": "2021-07-01T20:03:51.231523Z",
"endTime": "2021-07-02T01:12:15.898768197Z",
"updateTime": "2021-07-02T01:12:15.899188228Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "72538f0d5658d3b3ef8d61069f8d7160b6e17d07",
"ref": "refs/heads/main"
}
}
}
[01:12:16.227] Invocation finished in 5h11m26.811869035s with status FAILED