[06:03:18.232] New invocation is queued and will start shortly
[06:03:19.371] Starting the invocation (attempt 1)
[06:03:19.406] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/af4067d9c858c6818793b27706019b482245320d"
[06:03:19.406] Popped gitiles commit info from properties and tags
[06:03:19.406] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[06:03:19.406] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[06:03:19.406] Buildbucket request:
{
"requestId": "8880983243802275712",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "af4067d9c858c6818793b27706019b482245320d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8880983243802275712"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[06:03:19.867] Scheduled build:
{
"id": "8715553181786811953",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 36021,
"createdBy": "project:chromium",
"createTime": "2025-05-07T06:03:19.465626722Z",
"updateTime": "2025-05-07T06:03:19.465626722Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "af4067d9c858c6818793b27706019b482245320d",
"ref": "refs/heads/main"
}
}
}
[06:03:19.867] Task URL: https://cr-buildbucket.appspot.com/build/8715553181786811953
[06:03:19.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:2:0) after 5m45s
[06:03:22.747] Received PubSub notification, asking Buildbucket for the build status
[06:03:22.780] Build status: SCHEDULED
[06:03:29.907] Received PubSub notification, asking Buildbucket for the build status
[06:03:29.931] Build status: STARTED
[06:09:05.066] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:2:0)
[06:09:05.091] Build status: STARTED
[06:09:05.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:5:0) after 3m16s
[06:12:21.322] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:5:0)
[06:12:21.337] Build status: STARTED
[06:12:21.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:6:0) after 2m52s
[06:15:13.737] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:6:0)
[06:15:13.766] Build status: STARTED
[06:15:13.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:7:0) after 8m45s
[06:23:58.792] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:7:0)
[06:23:58.819] Build status: STARTED
[06:23:58.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:8:0) after 3m37s
[06:27:35.973] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:8:0)
[06:27:36.002] Build status: STARTED
[06:27:36.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:9:0) after 4m51s
[06:32:27.082] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:9:0)
[06:32:27.111] Build status: STARTED
[06:32:27.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:10:0) after 8m51s
[06:41:18.369] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:10:0)
[06:41:18.404] Build status: STARTED
[06:41:18.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:11:0) after 4m36s
[06:45:54.428] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:11:0)
[06:45:54.451] Build status: STARTED
[06:45:54.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:12:0) after 8m44s
[06:54:38.617] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:12:0)
[06:54:38.643] Build status: STARTED
[06:54:38.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:13:0) after 1m14s
[06:55:52.863] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:13:0)
[06:55:52.890] Build status: STARTED
[06:55:52.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:14:0) after 3m16s
[06:59:09.523] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:14:0)
[06:59:09.576] Build status: STARTED
[06:59:09.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:15:0) after 8m35s
[07:07:44.783] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:15:0)
[07:07:44.839] Build status: STARTED
[07:07:44.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:16:0) after 9m53s
[07:17:37.862] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:16:0)
[07:17:37.884] Build status: STARTED
[07:17:37.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:17:0) after 3m32s
[07:21:10.019] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:17:0)
[07:21:10.037] Build status: STARTED
[07:21:10.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:18:0) after 2m22s
[07:23:32.083] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:18:0)
[07:23:32.115] Build status: STARTED
[07:23:32.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:19:0) after 4m4s
[07:27:36.155] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:19:0)
[07:27:36.172] Build status: STARTED
[07:27:36.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:20:0) after 7m48s
[07:35:24.180] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:20:0)
[07:35:24.205] Build status: STARTED
[07:35:24.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:21:0) after 4m15s
[07:39:39.221] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:21:0)
[07:39:39.244] Build status: STARTED
[07:39:39.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:22:0) after 2m55s
[07:42:34.486] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:22:0)
[07:42:34.509] Build status: STARTED
[07:42:34.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:23:0) after 8m22s
[07:50:56.579] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:23:0)
[07:50:56.598] Build status: STARTED
[07:50:56.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:24:0) after 7m56s
[07:58:52.622] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:24:0)
[07:58:52.645] Build status: STARTED
[07:58:52.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:25:0) after 7m50s
[08:06:42.730] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:25:0)
[08:06:42.831] Build status: STARTED
[08:06:42.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:26:0) after 6m11s
[08:12:54.060] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:26:0)
[08:12:54.098] Build status: STARTED
[08:12:54.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:27:0) after 3m48s
[08:16:42.277] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:27:0)
[08:16:42.477] Build status: STARTED
[08:16:42.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:28:0) after 9m29s
[08:26:11.511] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:28:0)
[08:26:11.531] Build status: STARTED
[08:26:11.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:29:0) after 9m9s
[08:35:20.557] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:29:0)
[08:35:20.580] Build status: STARTED
[08:35:20.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:30:0) after 7m13s
[08:42:33.612] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:30:0)
[08:42:33.630] Build status: STARTED
[08:42:33.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:31:0) after 7m29s
[08:50:02.665] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:31:0)
[08:50:02.688] Build status: STARTED
[08:50:02.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:32:0) after 5m7s
[08:55:09.691] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:32:0)
[08:55:09.705] Build status: STARTED
[08:55:09.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:33:0) after 3m56s
[08:59:05.779] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:33:0)
[08:59:05.797] Build status: STARTED
[08:59:05.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:34:0) after 2m2s
[09:01:07.859] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:34:0)
[09:01:07.872] Build status: STARTED
[09:01:07.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:35:0) after 4m54s
[09:06:01.984] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:35:0)
[09:06:02.163] Build status: STARTED
[09:06:02.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:36:0) after 7m34s
[09:13:36.204] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:36:0)
[09:13:36.222] Build status: STARTED
[09:13:36.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:37:0) after 6m53s
[09:20:29.248] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:37:0)
[09:20:29.265] Build status: STARTED
[09:20:29.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:38:0) after 5m26s
[09:25:55.286] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:38:0)
[09:25:55.305] Build status: STARTED
[09:25:55.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:39:0) after 1m52s
[09:27:47.329] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:39:0)
[09:27:47.345] Build status: STARTED
[09:27:47.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:40:0) after 1m42s
[09:29:29.372] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:40:0)
[09:29:29.396] Build status: STARTED
[09:29:29.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:41:0) after 3m40s
[09:33:09.427] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:41:0)
[09:33:09.456] Build status: STARTED
[09:33:09.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:42:0) after 4m16s
[09:37:25.483] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:42:0)
[09:37:25.514] Build status: STARTED
[09:37:25.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:43:0) after 9m59s
[09:47:24.547] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:43:0)
[09:47:24.591] Build status: STARTED
[09:47:24.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:44:0) after 5m52s
[09:53:16.622] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:44:0)
[09:53:16.644] Build status: STARTED
[09:53:16.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:45:0) after 2m10s
[09:55:26.659] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:45:0)
[09:55:26.702] Build status: STARTED
[09:55:26.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:46:0) after 1m47s
[09:57:13.771] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:46:0)
[09:57:13.797] Build status: STARTED
[09:57:13.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:47:0) after 1m16s
[09:58:29.822] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:47:0)
[09:58:29.840] Build status: STARTED
[09:58:29.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:48:0) after 5m17s
[10:03:46.893] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:48:0)
[10:03:46.910] Build status: STARTED
[10:03:46.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:49:0) after 3m50s
[10:07:36.940] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:49:0)
[10:07:36.968] Build status: STARTED
[10:07:36.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:50:0) after 6m26s
[10:14:02.997] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:50:0)
[10:14:03.020] Build status: STARTED
[10:14:03.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:51:0) after 8m41s
[10:22:44.143] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:51:0)
[10:22:44.170] Build status: STARTED
[10:22:44.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:52:0) after 4m37s
[10:27:21.195] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:52:0)
[10:27:21.210] Build status: STARTED
[10:27:21.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:53:0) after 8m20s
[10:35:41.187] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:53:0)
[10:35:41.210] Build status: STARTED
[10:35:41.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:54:0) after 1m5s
[10:36:46.230] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:54:0)
[10:36:46.249] Build status: STARTED
[10:36:46.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:55:0) after 1m9s
[10:37:55.480] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:55:0)
[10:37:55.507] Build status: STARTED
[10:37:55.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:56:0) after 5m34s
[10:43:29.937] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:56:0)
[10:43:30.014] Build status: STARTED
[10:43:30.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:57:0) after 3m34s
[10:47:04.049] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:57:0)
[10:47:04.064] Build status: STARTED
[10:47:04.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:58:0) after 7m17s
[10:54:21.113] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:58:0)
[10:54:21.135] Build status: STARTED
[10:54:21.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:59:0) after 5m7s
[10:59:28.152] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:59:0)
[10:59:28.169] Build status: STARTED
[10:59:28.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:60:0) after 2m42s
[11:02:10.189] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:60:0)
[11:02:10.205] Build status: STARTED
[11:02:10.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:61:0) after 3m1s
[11:05:11.225] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:61:0)
[11:05:11.243] Build status: STARTED
[11:05:11.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:62:0) after 1m32s
[11:06:43.278] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:62:0)
[11:06:43.297] Build status: STARTED
[11:06:43.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:63:0) after 7m50s
[11:14:33.415] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:63:0)
[11:14:33.464] Build status: STARTED
[11:14:33.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:64:0) after 9m55s
[11:24:28.461] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:64:0)
[11:24:28.475] Build status: STARTED
[11:24:28.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:65:0) after 8m6s
[11:32:34.502] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:65:0)
[11:32:34.525] Build status: STARTED
[11:32:34.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:66:0) after 7m19s
[11:39:53.649] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:66:0)
[11:39:53.686] Build status: STARTED
[11:39:53.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:67:0) after 1m25s
[11:41:18.705] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:67:0)
[11:41:18.728] Build status: STARTED
[11:41:18.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:68:0) after 6m15s
[11:47:33.797] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:68:0)
[11:47:33.823] Build status: STARTED
[11:47:33.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:69:0) after 5m32s
[11:53:05.852] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:69:0)
[11:53:05.944] Build status: STARTED
[11:53:05.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8880983243802275712:70:0) after 7m24s
[11:57:48.345] Received PubSub notification, asking Buildbucket for the build status
[11:57:48.405] Build:
{
"id": "8715553181786811953",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 36021,
"createdBy": "project:chromium",
"createTime": "2025-05-07T06:03:19.465626722Z",
"startTime": "2025-05-07T06:03:26.015964834Z",
"endTime": "2025-05-07T11:57:47.979981766Z",
"updateTime": "2025-05-07T11:57:47.979981766Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "af4067d9c858c6818793b27706019b482245320d",
"ref": "refs/heads/main"
}
}
}
[11:57:48.405] Invocation finished in 5h54m30.246520131s with status FAILED