[13:37:07.040] New invocation is queued and will start shortly
[13:37:10.637] Starting the invocation (attempt 1)
[13:37:10.666] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/cda388a9f2cfcd1c453e3f288222884b5b37417f"
[13:37:10.666] Popped gitiles commit info from properties and tags
[13:37:10.666] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:37:10.667] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:37:10.667] Buildbucket request:
{
"requestId": "8927430936021036128",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cda388a9f2cfcd1c453e3f288222884b5b37417f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8927430936021036128"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:37:11.316] Scheduled build:
{
"id": "8762000871483105009",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 30822,
"createdBy": "project:chromium",
"createTime": "2023-12-11T13:37:10.745537149Z",
"updateTime": "2023-12-11T13:37:10.745537149Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cda388a9f2cfcd1c453e3f288222884b5b37417f",
"ref": "refs/heads/main"
}
}
}
[13:37:11.316] Task URL: https://cr-buildbucket.appspot.com/build/8762000871483105009
[13:37:11.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:2:0) after 5m32s
[13:37:12.276] Received PubSub notification, asking Buildbucket for the build status
[13:37:12.374] Build status: SCHEDULED
[13:37:13.996] Received PubSub notification, asking Buildbucket for the build status
[13:37:14.024] Build status: STARTED
[13:42:43.337] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:2:0)
[13:42:43.368] Build status: STARTED
[13:42:43.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:5:0) after 1m59s
[13:44:42.392] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:5:0)
[13:44:42.423] Build status: STARTED
[13:44:42.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:6:0) after 5m27s
[13:50:09.570] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:6:0)
[13:50:09.606] Build status: STARTED
[13:50:09.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:7:0) after 2m18s
[13:52:27.626] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:7:0)
[13:52:27.663] Build status: STARTED
[13:52:27.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:8:0) after 5m58s
[13:58:25.734] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:8:0)
[13:58:25.758] Build status: STARTED
[13:58:25.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:9:0) after 9m59s
[14:08:24.775] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:9:0)
[14:08:24.803] Build status: STARTED
[14:08:24.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:10:0) after 1m31s
[14:09:55.942] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:10:0)
[14:09:56.026] Build status: STARTED
[14:09:56.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:11:0) after 5m40s
[14:15:36.516] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:11:0)
[14:15:36.558] Build status: STARTED
[14:15:36.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:12:0) after 9m5s
[14:24:41.916] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:12:0)
[14:24:41.936] Build status: STARTED
[14:24:41.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:13:0) after 2m38s
[14:27:20.164] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:13:0)
[14:27:20.217] Build status: STARTED
[14:27:20.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:14:0) after 4m5s
[14:31:25.242] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:14:0)
[14:31:25.438] Build status: STARTED
[14:31:25.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:15:0) after 3m35s
[14:35:00.732] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:15:0)
[14:35:00.762] Build status: STARTED
[14:35:00.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:16:0) after 3m48s
[14:38:49.090] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:16:0)
[14:38:49.167] Build status: STARTED
[14:38:49.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:17:0) after 9m41s
[14:48:30.191] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:17:0)
[14:48:30.209] Build status: STARTED
[14:48:30.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:18:0) after 9m59s
[14:58:29.276] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:18:0)
[14:58:29.313] Build status: STARTED
[14:58:29.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:19:0) after 9m59s
[15:08:28.513] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:19:0)
[15:08:28.546] Build status: STARTED
[15:08:28.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:20:0) after 8m59s
[15:17:27.684] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:20:0)
[15:17:27.705] Build status: STARTED
[15:17:27.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:21:0) after 7m33s
[15:25:01.441] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:21:0)
[15:25:01.529] Build status: STARTED
[15:25:01.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:22:0) after 6m6s
[15:31:07.617] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:22:0)
[15:31:07.638] Build status: STARTED
[15:31:07.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:23:0) after 1m53s
[15:33:00.735] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:23:0)
[15:33:00.779] Build status: STARTED
[15:33:00.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:24:0) after 2m13s
[15:35:13.808] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:24:0)
[15:35:13.835] Build status: STARTED
[15:35:13.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:25:0) after 8m46s
[15:43:59.860] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:25:0)
[15:43:59.879] Build status: STARTED
[15:43:59.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:26:0) after 3m32s
[15:47:31.975] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:26:0)
[15:47:32.000] Build status: STARTED
[15:47:32.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:27:0) after 3m1s
[15:50:33.027] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:27:0)
[15:50:33.048] Build status: STARTED
[15:50:33.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:28:0) after 6m16s
[15:56:49.208] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:28:0)
[15:56:49.262] Build status: STARTED
[15:56:49.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:29:0) after 1m56s
[15:58:45.295] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:29:0)
[15:58:45.321] Build status: STARTED
[15:58:45.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:30:0) after 1m22s
[16:00:07.354] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:30:0)
[16:00:07.400] Build status: STARTED
[16:00:07.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:31:0) after 5m34s
[16:05:41.476] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:31:0)
[16:05:41.510] Build status: STARTED
[16:05:41.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:32:0) after 9m27s
[16:15:08.534] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:32:0)
[16:15:08.576] Build status: STARTED
[16:15:08.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:33:0) after 6m35s
[16:21:43.578] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:33:0)
[16:21:43.594] Build status: STARTED
[16:21:43.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:34:0) after 2m41s
[16:24:24.613] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:34:0)
[16:24:24.632] Build status: STARTED
[16:24:24.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:35:0) after 5m41s
[16:30:05.738] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:35:0)
[16:30:05.797] Build status: STARTED
[16:30:05.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:36:0) after 4m10s
[16:34:15.819] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:36:0)
[16:34:15.860] Build status: STARTED
[16:34:15.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:37:0) after 3m42s
[16:37:57.887] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:37:0)
[16:37:57.913] Build status: STARTED
[16:37:57.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:38:0) after 3m49s
[16:41:46.938] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:38:0)
[16:41:46.955] Build status: STARTED
[16:41:46.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:39:0) after 6m23s
[16:48:10.033] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:39:0)
[16:48:10.064] Build status: STARTED
[16:48:10.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:40:0) after 5m51s
[16:54:01.101] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:40:0)
[16:54:01.135] Build status: STARTED
[16:54:01.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:41:0) after 4m32s
[16:58:33.184] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:41:0)
[16:58:33.229] Build status: STARTED
[16:58:33.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:42:0) after 6m48s
[17:05:21.282] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:42:0)
[17:05:21.350] Build status: STARTED
[17:05:21.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:43:0) after 5m29s
[17:10:50.861] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:43:0)
[17:10:50.881] Build status: STARTED
[17:10:50.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:44:0) after 5m39s
[17:16:30.135] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:44:0)
[17:16:30.160] Build status: STARTED
[17:16:30.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:45:0) after 3m8s
[17:19:38.183] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:45:0)
[17:19:38.213] Build status: STARTED
[17:19:38.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:46:0) after 8m54s
[17:28:32.263] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:46:0)
[17:28:32.283] Build status: STARTED
[17:28:32.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:47:0) after 7m27s
[17:35:59.313] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:47:0)
[17:35:59.397] Build status: STARTED
[17:35:59.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:48:0) after 4m57s
[17:40:56.404] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:48:0)
[17:40:56.430] Build status: STARTED
[17:40:56.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:49:0) after 8m32s
[17:49:28.502] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:49:0)
[17:49:28.527] Build status: STARTED
[17:49:28.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:50:0) after 8m58s
[17:58:26.541] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:50:0)
[17:58:26.561] Build status: STARTED
[17:58:26.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:51:0) after 8m17s
[18:06:43.655] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:51:0)
[18:06:43.682] Build status: STARTED
[18:06:43.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:52:0) after 4m31s
[18:11:14.759] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:52:0)
[18:11:14.838] Build status: STARTED
[18:11:14.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:53:0) after 6m49s
[18:18:03.863] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:53:0)
[18:18:03.943] Build status: STARTED
[18:18:03.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:54:0) after 1m56s
[18:20:00.121] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:54:0)
[18:20:00.151] Build status: STARTED
[18:20:00.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:55:0) after 3m31s
[18:23:31.184] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:55:0)
[18:23:31.208] Build status: STARTED
[18:23:31.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:56:0) after 5m44s
[18:29:15.300] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:56:0)
[18:29:15.368] Build status: STARTED
[18:29:15.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:57:0) after 5m47s
[18:35:02.434] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:57:0)
[18:35:02.455] Build status: STARTED
[18:35:02.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:58:0) after 9m15s
[18:44:17.522] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:58:0)
[18:44:17.606] Build status: STARTED
[18:44:17.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:59:0) after 1m5s
[18:45:22.637] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:59:0)
[18:45:22.656] Build status: STARTED
[18:45:22.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:60:0) after 1m41s
[18:47:03.674] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:60:0)
[18:47:03.694] Build status: STARTED
[18:47:03.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:61:0) after 3m2s
[18:50:05.729] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:61:0)
[18:50:05.750] Build status: STARTED
[18:50:05.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:62:0) after 4m31s
[18:54:36.823] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:62:0)
[18:54:36.847] Build status: STARTED
[18:54:36.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:63:0) after 2m41s
[18:57:17.865] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:63:0)
[18:57:17.887] Build status: STARTED
[18:57:17.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:64:0) after 4m3s
[19:01:20.971] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:64:0)
[19:01:21.015] Build status: STARTED
[19:01:21.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:65:0) after 6m31s
[19:07:52.065] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:65:0)
[19:07:52.111] Build status: STARTED
[19:07:52.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:66:0) after 2m49s
[19:10:41.146] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:66:0)
[19:10:41.172] Build status: STARTED
[19:10:41.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:67:0) after 5m39s
[19:16:20.239] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:67:0)
[19:16:20.262] Build status: STARTED
[19:16:20.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:68:0) after 2m29s
[19:18:49.380] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:68:0)
[19:18:49.401] Build status: STARTED
[19:18:49.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8927430936021036128:69:0) after 6m39s
[19:20:16.072] Received PubSub notification, asking Buildbucket for the build status
[19:20:16.134] Build:
{
"id": "8762000871483105009",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 30822,
"createdBy": "project:chromium",
"createTime": "2023-12-11T13:37:10.745537149Z",
"startTime": "2023-12-11T13:37:13.211213Z",
"endTime": "2023-12-11T19:20:15.206755Z",
"updateTime": "2023-12-11T19:20:15.206755Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cda388a9f2cfcd1c453e3f288222884b5b37417f",
"ref": "refs/heads/main"
}
}
}
[19:20:16.134] Invocation finished in 5h43m9.099757567s with status FAILED