[08:14:43.219] New invocation is queued and will start shortly
[08:14:44.408] Starting the invocation (attempt 1)
[08:14:44.436] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5cdefbd9efcbf50cea37c7690a9bbd06f501cf95"
[08:14:44.437] Popped gitiles commit info from properties and tags
[08:14:44.437] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:14:44.437] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:14:44.437] Buildbucket request:
{
"requestId": "8925276892293015216",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5cdefbd9efcbf50cea37c7690a9bbd06f501cf95",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8925276892293015216"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:14:45.013] Scheduled build:
{
"id": "8759846830279296097",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 30956,
"createdBy": "project:chromium",
"createTime": "2024-01-04T08:14:44.517660792Z",
"updateTime": "2024-01-04T08:14:44.517660792Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5cdefbd9efcbf50cea37c7690a9bbd06f501cf95",
"ref": "refs/heads/main"
}
}
}
[08:14:45.013] Task URL: https://cr-buildbucket.appspot.com/build/8759846830279296097
[08:14:45.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:2:0) after 1m19s
[08:14:46.117] Received PubSub notification, asking Buildbucket for the build status
[08:14:46.134] Build status: SCHEDULED
[08:14:55.231] Received PubSub notification, asking Buildbucket for the build status
[08:14:55.248] Build status: STARTED
[08:16:04.139] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:2:0)
[08:16:04.169] Build status: STARTED
[08:16:04.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:5:0) after 4m5s
[08:20:09.190] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:5:0)
[08:20:09.208] Build status: STARTED
[08:20:09.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:6:0) after 3m29s
[08:23:38.234] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:6:0)
[08:23:38.252] Build status: STARTED
[08:23:38.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:7:0) after 4m44s
[08:28:22.545] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:7:0)
[08:28:22.569] Build status: STARTED
[08:28:22.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:8:0) after 9m4s
[08:37:26.593] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:8:0)
[08:37:26.614] Build status: STARTED
[08:37:26.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:9:0) after 2m1s
[08:39:27.636] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:9:0)
[08:39:27.653] Build status: STARTED
[08:39:27.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:10:0) after 3m52s
[08:43:19.830] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:10:0)
[08:43:19.860] Build status: STARTED
[08:43:19.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:11:0) after 2m59s
[08:46:18.904] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:11:0)
[08:46:18.952] Build status: STARTED
[08:46:18.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:12:0) after 9m15s
[08:55:33.968] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:12:0)
[08:55:33.995] Build status: STARTED
[08:55:33.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:13:0) after 5m29s
[09:01:03.015] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:13:0)
[09:01:03.039] Build status: STARTED
[09:01:03.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:14:0) after 7m52s
[09:08:55.063] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:14:0)
[09:08:55.094] Build status: STARTED
[09:08:55.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:15:0) after 3m18s
[09:12:13.113] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:15:0)
[09:12:13.136] Build status: STARTED
[09:12:13.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:16:0) after 2m52s
[09:15:05.172] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:16:0)
[09:15:05.203] Build status: STARTED
[09:15:05.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:17:0) after 9m4s
[09:24:09.220] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:17:0)
[09:24:09.267] Build status: STARTED
[09:24:09.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:18:0) after 7m25s
[09:31:34.293] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:18:0)
[09:31:34.310] Build status: STARTED
[09:31:34.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:19:0) after 5m17s
[09:36:51.328] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:19:0)
[09:36:51.363] Build status: STARTED
[09:36:51.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:20:0) after 4m27s
[09:41:18.387] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:20:0)
[09:41:18.408] Build status: STARTED
[09:41:18.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:21:0) after 1m43s
[09:43:01.561] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:21:0)
[09:43:01.648] Build status: STARTED
[09:43:01.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:22:0) after 8m14s
[09:51:15.915] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:22:0)
[09:51:15.935] Build status: STARTED
[09:51:15.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:23:0) after 9m55s
[10:01:11.081] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:23:0)
[10:01:11.108] Build status: STARTED
[10:01:11.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:24:0) after 8m29s
[10:09:40.128] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:24:0)
[10:09:40.161] Build status: STARTED
[10:09:40.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:25:0) after 7m31s
[10:17:11.251] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:25:0)
[10:17:11.323] Build status: STARTED
[10:17:11.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:26:0) after 6m15s
[10:23:26.372] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:26:0)
[10:23:26.391] Build status: STARTED
[10:23:26.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:27:0) after 4m4s
[10:27:30.406] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:27:0)
[10:27:30.428] Build status: STARTED
[10:27:30.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:28:0) after 3m41s
[10:31:11.531] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:28:0)
[10:31:11.561] Build status: STARTED
[10:31:11.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:29:0) after 6m59s
[10:38:10.683] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:29:0)
[10:38:10.713] Build status: STARTED
[10:38:10.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:30:0) after 4m50s
[10:43:00.902] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:30:0)
[10:43:00.921] Build status: STARTED
[10:43:00.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:31:0) after 4m56s
[10:47:56.979] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:31:0)
[10:47:57.001] Build status: STARTED
[10:47:57.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:32:0) after 7m23s
[10:55:20.476] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:32:0)
[10:55:20.499] Build status: STARTED
[10:55:20.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:33:0) after 2m19s
[10:57:39.513] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:33:0)
[10:57:39.534] Build status: STARTED
[10:57:39.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:34:0) after 8m51s
[11:06:30.532] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:34:0)
[11:06:30.550] Build status: STARTED
[11:06:30.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:35:0) after 4m1s
[11:10:31.600] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:35:0)
[11:10:31.620] Build status: STARTED
[11:10:31.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:36:0) after 7m53s
[11:18:24.939] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:36:0)
[11:18:24.955] Build status: STARTED
[11:18:24.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:37:0) after 6m47s
[11:25:12.188] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:37:0)
[11:25:12.233] Build status: STARTED
[11:25:12.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:38:0) after 2m31s
[11:27:43.259] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:38:0)
[11:27:43.278] Build status: STARTED
[11:27:43.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:39:0) after 2m48s
[11:30:31.319] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:39:0)
[11:30:31.339] Build status: STARTED
[11:30:31.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:40:0) after 4m10s
[11:34:41.369] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:40:0)
[11:34:41.395] Build status: STARTED
[11:34:41.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:41:0) after 1m42s
[11:36:23.491] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:41:0)
[11:36:23.513] Build status: STARTED
[11:36:23.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:42:0) after 2m7s
[11:38:30.627] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:42:0)
[11:38:30.650] Build status: STARTED
[11:38:30.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:43:0) after 3m14s
[11:41:44.679] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:43:0)
[11:41:44.694] Build status: STARTED
[11:41:44.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:44:0) after 2m39s
[11:44:23.938] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:44:0)
[11:44:23.956] Build status: STARTED
[11:44:23.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:45:0) after 7m23s
[11:51:47.038] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:45:0)
[11:51:47.055] Build status: STARTED
[11:51:47.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:46:0) after 6m47s
[11:58:34.113] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:46:0)
[11:58:34.137] Build status: STARTED
[11:58:34.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:47:0) after 5m12s
[12:03:46.169] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:47:0)
[12:03:46.199] Build status: STARTED
[12:03:46.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:48:0) after 7m6s
[12:10:52.336] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:48:0)
[12:10:52.395] Build status: STARTED
[12:10:52.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:49:0) after 5m42s
[12:16:34.519] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:49:0)
[12:16:34.552] Build status: STARTED
[12:16:34.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:50:0) after 2m42s
[12:19:16.710] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:50:0)
[12:19:16.731] Build status: STARTED
[12:19:16.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:51:0) after 4m3s
[12:23:19.773] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:51:0)
[12:23:19.795] Build status: STARTED
[12:23:19.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:52:0) after 7m5s
[12:30:24.937] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:52:0)
[12:30:24.957] Build status: STARTED
[12:30:24.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:53:0) after 4m38s
[12:35:03.241] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:53:0)
[12:35:03.280] Build status: STARTED
[12:35:03.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:54:0) after 1m24s
[12:36:27.429] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:54:0)
[12:36:27.680] Build status: STARTED
[12:36:27.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:55:0) after 4m28s
[12:40:55.827] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:55:0)
[12:40:55.849] Build status: STARTED
[12:40:55.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:56:0) after 8m28s
[12:49:23.967] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:56:0)
[12:49:24.060] Build status: STARTED
[12:49:24.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:57:0) after 8m53s
[12:58:17.172] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:57:0)
[12:58:17.191] Build status: STARTED
[12:58:17.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:58:0) after 9m31s
[13:07:48.377] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:58:0)
[13:07:48.396] Build status: STARTED
[13:07:48.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:59:0) after 7m37s
[13:15:25.572] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:59:0)
[13:15:25.594] Build status: STARTED
[13:15:25.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:60:0) after 2m31s
[13:17:56.565] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:60:0)
[13:17:56.583] Build status: STARTED
[13:17:56.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:61:0) after 5m15s
[13:23:11.636] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:61:0)
[13:23:11.674] Build status: STARTED
[13:23:11.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:62:0) after 3m49s
[13:27:00.722] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:62:0)
[13:27:00.741] Build status: STARTED
[13:27:00.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:63:0) after 5m2s
[13:32:02.764] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:63:0)
[13:32:02.785] Build status: STARTED
[13:32:02.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:64:0) after 6m11s
[13:38:14.078] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:64:0)
[13:38:14.094] Build status: STARTED
[13:38:14.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:65:0) after 4m31s
[13:42:45.117] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:65:0)
[13:42:45.136] Build status: STARTED
[13:42:45.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:66:0) after 8m48s
[13:51:33.155] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:66:0)
[13:51:33.175] Build status: STARTED
[13:51:33.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:67:0) after 1m10s
[13:52:43.204] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:67:0)
[13:52:43.248] Build status: STARTED
[13:52:43.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925276892293015216:68:0) after 8m39s
[13:53:30.112] Received PubSub notification, asking Buildbucket for the build status
[13:53:30.147] Build:
{
"id": "8759846830279296097",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 30956,
"createdBy": "project:chromium",
"createTime": "2024-01-04T08:14:44.517660792Z",
"startTime": "2024-01-04T08:14:54.255703Z",
"endTime": "2024-01-04T13:53:28.529405Z",
"updateTime": "2024-01-04T13:53:28.529405Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5cdefbd9efcbf50cea37c7690a9bbd06f501cf95",
"ref": "refs/heads/main"
}
}
}
[13:53:30.147] Invocation finished in 5h38m46.933367558s with status FAILED