[19:43:17.048] New invocation is queued and will start shortly
[19:43:18.124] Starting the invocation (attempt 1)
[19:43:18.148] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/09903891569184d8c933eae4b7143bb3f0124e3d"
[19:43:18.148] Popped gitiles commit info from properties and tags
[19:43:18.148] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:43:18.149] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:43:18.149] Buildbucket request:
{
"requestId": "8885008518523242688",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "09903891569184d8c933eae4b7143bb3f0124e3d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8885008518523242688"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:43:18.748] Scheduled build:
{
"id": "8719578456650598241",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 35158,
"createdBy": "project:chromium",
"createTime": "2025-03-23T19:43:18.211118933Z",
"updateTime": "2025-03-23T19:43:18.211118933Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "09903891569184d8c933eae4b7143bb3f0124e3d",
"ref": "refs/heads/main"
}
}
}
[19:43:18.748] Task URL: https://cr-buildbucket.appspot.com/build/8719578456650598241
[19:43:18.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:2:0) after 6m8s
[19:43:19.721] Received PubSub notification, asking Buildbucket for the build status
[19:43:19.741] Build status: SCHEDULED
[19:43:22.063] Received PubSub notification, asking Buildbucket for the build status
[19:43:22.086] Build status: STARTED
[19:49:26.939] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:2:0)
[19:49:26.970] Build status: STARTED
[19:49:26.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:5:0) after 6m50s
[19:56:16.960] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:5:0)
[19:56:16.978] Build status: STARTED
[19:56:16.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:6:0) after 6m19s
[20:02:36.303] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:6:0)
[20:02:36.320] Build status: STARTED
[20:02:36.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:7:0) after 9m13s
[20:11:49.419] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:7:0)
[20:11:49.510] Build status: STARTED
[20:11:49.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:8:0) after 3m37s
[20:15:26.538] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:8:0)
[20:15:26.562] Build status: STARTED
[20:15:26.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:9:0) after 4m17s
[20:19:43.592] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:9:0)
[20:19:43.606] Build status: STARTED
[20:19:43.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:10:0) after 7m58s
[20:27:41.693] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:10:0)
[20:27:41.719] Build status: STARTED
[20:27:41.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:11:0) after 2m7s
[20:29:48.740] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:11:0)
[20:29:48.760] Build status: STARTED
[20:29:48.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:12:0) after 5m13s
[20:35:01.802] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:12:0)
[20:35:01.827] Build status: STARTED
[20:35:01.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:13:0) after 9m13s
[20:44:14.829] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:13:0)
[20:44:14.858] Build status: STARTED
[20:44:14.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:14:0) after 4m28s
[20:48:42.854] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:14:0)
[20:48:42.877] Build status: STARTED
[20:48:42.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:15:0) after 6m5s
[20:54:48.271] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:15:0)
[20:54:48.290] Build status: STARTED
[20:54:48.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:16:0) after 4m29s
[20:59:17.333] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:16:0)
[20:59:17.355] Build status: STARTED
[20:59:17.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:17:0) after 4m13s
[21:03:30.377] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:17:0)
[21:03:30.404] Build status: STARTED
[21:03:30.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:18:0) after 2m19s
[21:05:49.425] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:18:0)
[21:05:49.453] Build status: STARTED
[21:05:49.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:19:0) after 9m52s
[21:15:41.468] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:19:0)
[21:15:41.489] Build status: STARTED
[21:15:41.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:20:0) after 7m51s
[21:23:32.591] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:20:0)
[21:23:32.614] Build status: STARTED
[21:23:32.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:21:0) after 8m17s
[21:31:49.629] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:21:0)
[21:31:49.650] Build status: STARTED
[21:31:49.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:22:0) after 7m26s
[21:39:15.676] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:22:0)
[21:39:15.703] Build status: STARTED
[21:39:15.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:23:0) after 1m1s
[21:40:16.728] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:23:0)
[21:40:16.753] Build status: STARTED
[21:40:16.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:24:0) after 8m5s
[21:48:22.003] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:24:0)
[21:48:22.029] Build status: STARTED
[21:48:22.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:25:0) after 1m53s
[21:50:15.180] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:25:0)
[21:50:15.372] Build status: STARTED
[21:50:15.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:26:0) after 6m11s
[21:56:26.416] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:26:0)
[21:56:26.432] Build status: STARTED
[21:56:26.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:27:0) after 1m10s
[21:57:36.612] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:27:0)
[21:57:36.633] Build status: STARTED
[21:57:36.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:28:0) after 4m58s
[22:02:34.657] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:28:0)
[22:02:34.690] Build status: STARTED
[22:02:34.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:29:0) after 4m30s
[22:07:04.718] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:29:0)
[22:07:04.736] Build status: STARTED
[22:07:04.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:30:0) after 3m51s
[22:10:55.759] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:30:0)
[22:10:55.784] Build status: STARTED
[22:10:55.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:31:0) after 7m15s
[22:18:10.795] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:31:0)
[22:18:10.861] Build status: STARTED
[22:18:10.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:32:0) after 3m16s
[22:21:26.975] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:32:0)
[22:21:26.998] Build status: STARTED
[22:21:26.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:33:0) after 8m12s
[22:29:39.013] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:33:0)
[22:29:39.031] Build status: STARTED
[22:29:39.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:34:0) after 5m32s
[22:35:11.039] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:34:0)
[22:35:11.132] Build status: STARTED
[22:35:11.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:35:0) after 7m5s
[22:42:16.153] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:35:0)
[22:42:16.252] Build status: STARTED
[22:42:16.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:36:0) after 5m52s
[22:48:08.369] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:36:0)
[22:48:08.390] Build status: STARTED
[22:48:08.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:37:0) after 1m38s
[22:49:46.409] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:37:0)
[22:49:46.661] Build status: STARTED
[22:49:46.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:38:0) after 6m4s
[22:55:50.711] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:38:0)
[22:55:50.726] Build status: STARTED
[22:55:50.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:39:0) after 4m44s
[23:00:34.751] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:39:0)
[23:00:34.775] Build status: STARTED
[23:00:34.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:40:0) after 5m56s
[23:06:30.761] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:40:0)
[23:06:30.832] Build status: STARTED
[23:06:30.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:41:0) after 1m1s
[23:07:31.966] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:41:0)
[23:07:32.031] Build status: STARTED
[23:07:32.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:42:0) after 3m42s
[23:11:14.311] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:42:0)
[23:11:14.338] Build status: STARTED
[23:11:14.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:43:0) after 6m49s
[23:18:03.412] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:43:0)
[23:18:03.435] Build status: STARTED
[23:18:03.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:44:0) after 5m48s
[23:23:51.449] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:44:0)
[23:23:51.476] Build status: STARTED
[23:23:51.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:45:0) after 1m46s
[23:25:37.520] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:45:0)
[23:25:37.626] Build status: STARTED
[23:25:37.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:46:0) after 9m4s
[23:34:41.689] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:46:0)
[23:34:41.751] Build status: STARTED
[23:34:41.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:47:0) after 8m49s
[23:43:30.769] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:47:0)
[23:43:30.787] Build status: STARTED
[23:43:30.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:48:0) after 6m52s
[23:50:22.859] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:48:0)
[23:50:22.881] Build status: STARTED
[23:50:22.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:49:0) after 5m2s
[23:55:24.858] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:49:0)
[23:55:24.879] Build status: STARTED
[23:55:24.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:50:0) after 1m29s
[23:56:53.897] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:50:0)
[23:56:53.929] Build status: STARTED
[23:56:53.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:51:0) after 6m3s
[00:02:56.947] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:51:0)
[00:02:56.965] Build status: STARTED
[00:02:56.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:52:0) after 4m7s
[00:07:03.968] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:52:0)
[00:07:03.996] Build status: STARTED
[00:07:03.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:53:0) after 1m53s
[00:08:57.019] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:53:0)
[00:08:57.035] Build status: STARTED
[00:08:57.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:54:0) after 6m35s
[00:15:32.050] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:54:0)
[00:15:32.078] Build status: STARTED
[00:15:32.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:55:0) after 6m5s
[00:21:37.200] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:55:0)
[00:21:37.217] Build status: STARTED
[00:21:37.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:56:0) after 9m9s
[00:30:46.224] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:56:0)
[00:30:46.241] Build status: STARTED
[00:30:46.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:57:0) after 1m48s
[00:32:34.412] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:57:0)
[00:32:34.430] Build status: STARTED
[00:32:34.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:58:0) after 3m37s
[00:36:11.547] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:58:0)
[00:36:11.566] Build status: STARTED
[00:36:11.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:59:0) after 9m40s
[00:45:51.688] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:59:0)
[00:45:51.711] Build status: STARTED
[00:45:51.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:60:0) after 1m43s
[00:47:34.840] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:60:0)
[00:47:34.874] Build status: STARTED
[00:47:34.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:61:0) after 1m54s
[00:49:28.891] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:61:0)
[00:49:28.909] Build status: STARTED
[00:49:28.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:62:0) after 2m17s
[00:51:46.227] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:62:0)
[00:51:46.242] Build status: STARTED
[00:51:46.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:63:0) after 7m31s
[00:59:17.260] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:63:0)
[00:59:17.274] Build status: STARTED
[00:59:17.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:64:0) after 1m26s
[01:00:43.279] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:64:0)
[01:00:43.298] Build status: STARTED
[01:00:43.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:65:0) after 4m15s
[01:04:58.393] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:65:0)
[01:04:58.408] Build status: STARTED
[01:04:58.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:66:0) after 8m44s
[01:13:42.829] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:66:0)
[01:13:42.847] Build status: STARTED
[01:13:42.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:67:0) after 6m43s
[01:20:25.978] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:67:0)
[01:20:26.000] Build status: STARTED
[01:20:26.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8885008518523242688:68:0) after 9m0s
[01:26:00.993] Received PubSub notification, asking Buildbucket for the build status
[01:26:01.013] Build:
{
"id": "8719578456650598241",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 35158,
"createdBy": "project:chromium",
"createTime": "2025-03-23T19:43:18.211118933Z",
"startTime": "2025-03-23T19:43:21.887568292Z",
"endTime": "2025-03-24T01:26:00.508931986Z",
"updateTime": "2025-03-24T01:26:00.508931986Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "09903891569184d8c933eae4b7143bb3f0124e3d",
"ref": "refs/heads/main"
}
}
}
[01:26:01.013] Invocation finished in 5h42m43.971793253s with status FAILED