[14:41:02.220] New invocation is queued and will start shortly
[14:41:03.314] Starting the invocation (attempt 1)
[14:41:03.361] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/cb76c9f81a0bd79e393cedbd3a04e10499645a6f"
[14:41:03.361] Popped gitiles commit info from properties and tags
[14:41:03.361] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:41:03.362] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:41:03.362] Buildbucket request:
{
"requestId": "9016574329495982336",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cb76c9f81a0bd79e393cedbd3a04e10499645a6f",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9016574329495982336"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:41:04.218] Scheduled build:
{
"id": "8851144267529050832",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 21861,
"createdBy": "project:chromium",
"createTime": "2021-04-01T14:41:03.459243Z",
"updateTime": "2021-04-01T14:41:04.080401Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cb76c9f81a0bd79e393cedbd3a04e10499645a6f",
"ref": "refs/heads/master"
}
}
}
[14:41:04.218] Task URL: https://cr-buildbucket.appspot.com/build/8851144267529050832
[14:41:04.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:2:0) after 5m40s
[14:46:26.061] Received PubSub notification, asking Buildbucket for the build status
[14:46:26.085] Build status: STARTED
[14:46:44.276] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:2:0)
[14:46:44.310] Build status: STARTED
[14:46:44.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:4:0) after 8m54s
[14:55:38.401] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:4:0)
[14:55:38.452] Build status: STARTED
[14:55:38.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:5:0) after 5m29s
[15:01:07.628] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:5:0)
[15:01:07.707] Build status: STARTED
[15:01:07.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:6:0) after 9m30s
[15:10:37.777] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:6:0)
[15:10:37.803] Build status: STARTED
[15:10:37.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:7:0) after 7m56s
[15:18:33.841] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:7:0)
[15:18:33.868] Build status: STARTED
[15:18:33.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:8:0) after 2m46s
[15:21:19.891] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:8:0)
[15:21:19.920] Build status: STARTED
[15:21:19.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:9:0) after 5m30s
[15:26:50.028] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:9:0)
[15:26:50.060] Build status: STARTED
[15:26:50.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:10:0) after 1m33s
[15:28:23.079] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:10:0)
[15:28:23.111] Build status: STARTED
[15:28:23.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:11:0) after 6m40s
[15:35:03.133] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:11:0)
[15:35:03.171] Build status: STARTED
[15:35:03.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:12:0) after 6m19s
[15:41:22.190] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:12:0)
[15:41:22.218] Build status: STARTED
[15:41:22.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:13:0) after 5m41s
[15:47:03.256] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:13:0)
[15:47:03.281] Build status: STARTED
[15:47:03.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:14:0) after 9m1s
[15:56:04.358] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:14:0)
[15:56:04.387] Build status: STARTED
[15:56:04.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:15:0) after 3m53s
[15:59:57.410] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:15:0)
[15:59:57.440] Build status: STARTED
[15:59:57.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:16:0) after 7m50s
[16:07:47.498] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:16:0)
[16:07:47.527] Build status: STARTED
[16:07:47.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:17:0) after 6m17s
[16:14:04.636] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:17:0)
[16:14:04.929] Build status: STARTED
[16:14:04.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:18:0) after 2m28s
[16:16:32.963] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:18:0)
[16:16:33.008] Build status: STARTED
[16:16:33.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:19:0) after 7m46s
[16:24:19.199] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:19:0)
[16:24:19.228] Build status: STARTED
[16:24:19.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:20:0) after 1m11s
[16:25:30.249] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:20:0)
[16:25:30.290] Build status: STARTED
[16:25:30.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:21:0) after 3m9s
[16:28:39.340] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:21:0)
[16:28:39.365] Build status: STARTED
[16:28:39.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:22:0) after 5m31s
[16:34:10.444] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:22:0)
[16:34:10.473] Build status: STARTED
[16:34:10.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:23:0) after 9m20s
[16:43:30.674] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:23:0)
[16:43:30.708] Build status: STARTED
[16:43:30.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:24:0) after 2m58s
[16:46:28.961] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:24:0)
[16:46:28.992] Build status: STARTED
[16:46:28.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:25:0) after 8m29s
[16:54:58.016] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:25:0)
[16:54:58.047] Build status: STARTED
[16:54:58.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:26:0) after 1m4s
[16:56:02.241] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:26:0)
[16:56:02.367] Build status: STARTED
[16:56:02.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:27:0) after 8m31s
[17:04:33.392] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:27:0)
[17:04:33.417] Build status: STARTED
[17:04:33.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:28:0) after 7m10s
[17:11:43.576] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:28:0)
[17:11:43.604] Build status: STARTED
[17:11:43.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:29:0) after 2m11s
[17:13:54.643] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:29:0)
[17:13:54.718] Build status: STARTED
[17:13:54.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:30:0) after 7m17s
[17:21:11.762] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:30:0)
[17:21:11.794] Build status: STARTED
[17:21:11.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:31:0) after 5m39s
[17:26:51.244] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:31:0)
[17:26:51.274] Build status: STARTED
[17:26:51.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:32:0) after 1m44s
[17:28:35.287] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:32:0)
[17:28:35.318] Build status: STARTED
[17:28:35.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:33:0) after 4m26s
[17:33:01.337] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:33:0)
[17:33:01.362] Build status: STARTED
[17:33:01.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:34:0) after 3m38s
[17:36:39.389] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:34:0)
[17:36:39.418] Build status: STARTED
[17:36:39.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:35:0) after 6m9s
[17:42:48.484] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:35:0)
[17:42:48.904] Build status: STARTED
[17:42:48.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:36:0) after 2m44s
[17:45:32.935] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:36:0)
[17:45:32.981] Build status: STARTED
[17:45:32.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:37:0) after 1m2s
[17:46:35.007] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:37:0)
[17:46:35.115] Build status: STARTED
[17:46:35.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:38:0) after 3m15s
[17:49:50.407] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:38:0)
[17:49:50.434] Build status: STARTED
[17:49:50.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:39:0) after 9m29s
[17:59:19.709] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:39:0)
[17:59:19.733] Build status: STARTED
[17:59:19.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:40:0) after 1m43s
[18:01:02.835] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:40:0)
[18:01:02.863] Build status: STARTED
[18:01:02.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:41:0) after 7m43s
[18:08:45.949] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:41:0)
[18:08:46.040] Build status: STARTED
[18:08:46.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:42:0) after 5m46s
[18:14:32.073] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:42:0)
[18:14:32.102] Build status: STARTED
[18:14:32.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:43:0) after 3m15s
[18:17:47.273] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:43:0)
[18:17:47.306] Build status: STARTED
[18:17:47.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:44:0) after 7m33s
[18:25:20.441] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:44:0)
[18:25:20.470] Build status: STARTED
[18:25:20.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:45:0) after 7m24s
[18:32:44.576] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:45:0)
[18:32:44.610] Build status: STARTED
[18:32:44.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:46:0) after 4m12s
[18:36:56.706] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:46:0)
[18:36:56.730] Build status: STARTED
[18:36:56.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:47:0) after 1m58s
[18:38:54.750] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:47:0)
[18:38:54.780] Build status: STARTED
[18:38:54.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:48:0) after 5m38s
[18:44:33.058] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:48:0)
[18:44:33.106] Build status: STARTED
[18:44:33.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:49:0) after 1m1s
[18:45:34.359] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:49:0)
[18:45:34.392] Build status: STARTED
[18:45:34.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:50:0) after 3m51s
[18:49:25.536] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:50:0)
[18:49:25.564] Build status: STARTED
[18:49:25.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:51:0) after 6m31s
[18:55:56.601] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:51:0)
[18:55:56.663] Build status: STARTED
[18:55:56.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:52:0) after 4m4s
[19:00:00.830] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:52:0)
[19:00:00.864] Build status: STARTED
[19:00:00.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:53:0) after 8m52s
[19:08:53.122] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:53:0)
[19:08:53.187] Build status: STARTED
[19:08:53.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:54:0) after 4m46s
[19:13:39.546] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:54:0)
[19:13:39.602] Build status: STARTED
[19:13:39.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:55:0) after 1m51s
[19:15:30.644] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:55:0)
[19:15:30.756] Build status: STARTED
[19:15:30.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:56:0) after 9m56s
[19:25:26.784] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:56:0)
[19:25:26.843] Build status: STARTED
[19:25:26.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9016574329495982336:57:0) after 9m43s
[19:35:09.466] Received PubSub notification, asking Buildbucket for the build status
[19:35:09.500] Build:
{
"id": "8851144267529050832",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 21861,
"createdBy": "project:chromium",
"createTime": "2021-04-01T14:41:03.459243Z",
"startTime": "2021-04-01T14:46:25.537736Z",
"endTime": "2021-04-01T19:35:09.058456802Z",
"updateTime": "2021-04-01T19:35:09.058788834Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cb76c9f81a0bd79e393cedbd3a04e10499645a6f",
"ref": "refs/heads/master"
}
}
}
[19:35:09.500] Invocation finished in 4h54m7.301044944s with status FAILED