[08:17:49.384] New invocation is queued and will start shortly
[08:17:50.915] Starting the invocation (attempt 1)
[08:17:50.947] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/4b2db29401f954b897e96a9886e93de645a9a287"
[08:17:50.947] Popped gitiles commit info from properties and tags
[08:17:50.947] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:17:50.947] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:17:50.947] Buildbucket request:
{
"requestId": "8884779853108357760",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4b2db29401f954b897e96a9886e93de645a9a287",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8884779853108357760"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:17:51.557] Scheduled build:
{
"id": "8719349790737102305",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 35287,
"createdBy": "project:chromium",
"createTime": "2025-03-26T08:17:51.019448140Z",
"updateTime": "2025-03-26T08:17:51.019448140Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4b2db29401f954b897e96a9886e93de645a9a287",
"ref": "refs/heads/main"
}
},
"canary": true
}
[08:17:51.557] Task URL: https://cr-buildbucket.appspot.com/build/8719349790737102305
[08:17:51.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:2:0) after 6m54s
[08:17:52.904] Received PubSub notification, asking Buildbucket for the build status
[08:17:52.935] Build status: SCHEDULED
[08:18:35.231] Received PubSub notification, asking Buildbucket for the build status
[08:18:35.264] Build status: STARTED
[08:24:45.578] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:2:0)
[08:24:45.796] Build status: STARTED
[08:24:45.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:5:0) after 4m12s
[08:28:57.891] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:5:0)
[08:28:57.914] Build status: STARTED
[08:28:57.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:6:0) after 1m28s
[08:30:25.933] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:6:0)
[08:30:25.948] Build status: STARTED
[08:30:25.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:7:0) after 5m56s
[08:36:21.966] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:7:0)
[08:36:22.039] Build status: STARTED
[08:36:22.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:8:0) after 8m18s
[08:44:40.739] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:8:0)
[08:44:40.829] Build status: STARTED
[08:44:40.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:9:0) after 7m57s
[08:52:38.218] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:9:0)
[08:52:38.240] Build status: STARTED
[08:52:38.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:10:0) after 4m19s
[08:56:57.357] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:10:0)
[08:56:57.373] Build status: STARTED
[08:56:57.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:11:0) after 7m50s
[09:04:47.699] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:11:0)
[09:04:47.840] Build status: STARTED
[09:04:47.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:12:0) after 2m50s
[09:07:38.035] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:12:0)
[09:07:38.063] Build status: STARTED
[09:07:38.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:13:0) after 2m3s
[09:09:41.163] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:13:0)
[09:09:41.179] Build status: STARTED
[09:09:41.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:14:0) after 2m25s
[09:12:06.200] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:14:0)
[09:12:06.216] Build status: STARTED
[09:12:06.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:15:0) after 9m14s
[09:21:20.236] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:15:0)
[09:21:20.261] Build status: STARTED
[09:21:20.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:16:0) after 6m49s
[09:28:09.492] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:16:0)
[09:28:09.515] Build status: STARTED
[09:28:09.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:17:0) after 3m50s
[09:31:59.535] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:17:0)
[09:31:59.587] Build status: STARTED
[09:31:59.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:18:0) after 8m1s
[09:40:00.610] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:18:0)
[09:40:00.637] Build status: STARTED
[09:40:00.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:19:0) after 9m56s
[09:49:56.703] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:19:0)
[09:49:56.739] Build status: STARTED
[09:49:56.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:20:0) after 1m19s
[09:51:15.761] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:20:0)
[09:51:15.839] Build status: STARTED
[09:51:15.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:21:0) after 8m25s
[09:59:40.808] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:21:0)
[09:59:40.827] Build status: STARTED
[09:59:40.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:22:0) after 9m22s
[10:09:02.852] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:22:0)
[10:09:02.870] Build status: STARTED
[10:09:02.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:23:0) after 4m52s
[10:13:54.905] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:23:0)
[10:13:54.921] Build status: STARTED
[10:13:54.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:24:0) after 8m17s
[10:22:12.096] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:24:0)
[10:22:12.113] Build status: STARTED
[10:22:12.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:25:0) after 1m58s
[10:24:10.143] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:25:0)
[10:24:10.173] Build status: STARTED
[10:24:10.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:26:0) after 6m30s
[10:30:40.192] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:26:0)
[10:30:40.215] Build status: STARTED
[10:30:40.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:27:0) after 5m26s
[10:36:06.235] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:27:0)
[10:36:06.265] Build status: STARTED
[10:36:06.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:28:0) after 2m51s
[10:38:57.435] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:28:0)
[10:38:57.452] Build status: STARTED
[10:38:57.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:29:0) after 4m55s
[10:43:52.474] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:29:0)
[10:43:52.498] Build status: STARTED
[10:43:52.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:30:0) after 3m0s
[10:46:52.566] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:30:0)
[10:46:52.585] Build status: STARTED
[10:46:52.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:31:0) after 9m45s
[10:56:37.767] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:31:0)
[10:56:37.782] Build status: STARTED
[10:56:37.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:32:0) after 1m42s
[10:58:19.877] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:32:0)
[10:58:19.943] Build status: STARTED
[10:58:19.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:33:0) after 8m11s
[11:06:30.966] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:33:0)
[11:06:31.040] Build status: STARTED
[11:06:31.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:34:0) after 4m3s
[11:10:34.113] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:34:0)
[11:10:34.158] Build status: STARTED
[11:10:34.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:35:0) after 9m48s
[11:20:22.182] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:35:0)
[11:20:22.198] Build status: STARTED
[11:20:22.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:36:0) after 5m56s
[11:26:18.230] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:36:0)
[11:26:18.247] Build status: STARTED
[11:26:18.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:37:0) after 3m54s
[11:30:12.299] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:37:0)
[11:30:12.319] Build status: STARTED
[11:30:12.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:38:0) after 1m51s
[11:32:03.335] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:38:0)
[11:32:03.360] Build status: STARTED
[11:32:03.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:39:0) after 9m51s
[11:41:54.473] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:39:0)
[11:41:54.494] Build status: STARTED
[11:41:54.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:40:0) after 2m12s
[11:44:06.569] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:40:0)
[11:44:06.591] Build status: STARTED
[11:44:06.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:41:0) after 3m4s
[11:47:10.695] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:41:0)
[11:47:10.740] Build status: STARTED
[11:47:10.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:42:0) after 8m40s
[11:55:50.958] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:42:0)
[11:55:50.972] Build status: STARTED
[11:55:50.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:43:0) after 6m27s
[12:02:17.998] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:43:0)
[12:02:18.012] Build status: STARTED
[12:02:18.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:44:0) after 7m36s
[12:09:54.035] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:44:0)
[12:09:54.109] Build status: STARTED
[12:09:54.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:45:0) after 9m54s
[12:19:48.165] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:45:0)
[12:19:48.184] Build status: STARTED
[12:19:48.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:46:0) after 7m1s
[12:26:49.271] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:46:0)
[12:26:49.291] Build status: STARTED
[12:26:49.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:47:0) after 1m33s
[12:28:22.609] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:47:0)
[12:28:22.626] Build status: STARTED
[12:28:22.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:48:0) after 2m49s
[12:31:11.683] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:48:0)
[12:31:11.704] Build status: STARTED
[12:31:11.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:49:0) after 3m14s
[12:34:26.541] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:49:0)
[12:34:26.555] Build status: STARTED
[12:34:26.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:50:0) after 2m34s
[12:37:00.582] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:50:0)
[12:37:00.639] Build status: STARTED
[12:37:00.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:51:0) after 6m28s
[12:43:28.856] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:51:0)
[12:43:28.883] Build status: STARTED
[12:43:28.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:52:0) after 2m5s
[12:45:34.167] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:52:0)
[12:45:34.182] Build status: STARTED
[12:45:34.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:53:0) after 8m27s
[12:54:01.227] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:53:0)
[12:54:01.245] Build status: STARTED
[12:54:01.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:54:0) after 9m54s
[13:03:55.249] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:54:0)
[13:03:55.266] Build status: STARTED
[13:03:55.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:55:0) after 5m49s
[13:09:44.280] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:55:0)
[13:09:44.306] Build status: STARTED
[13:09:44.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:56:0) after 2m2s
[13:11:46.385] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:56:0)
[13:11:46.422] Build status: STARTED
[13:11:46.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:57:0) after 9m7s
[13:20:53.441] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:57:0)
[13:20:53.459] Build status: STARTED
[13:20:53.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:58:0) after 3m50s
[13:24:43.486] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:58:0)
[13:24:43.510] Build status: STARTED
[13:24:43.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:59:0) after 2m55s
[13:27:38.531] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:59:0)
[13:27:38.554] Build status: STARTED
[13:27:38.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:60:0) after 4m34s
[13:32:12.587] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:60:0)
[13:32:12.602] Build status: STARTED
[13:32:12.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:61:0) after 7m53s
[13:40:05.733] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:61:0)
[13:40:05.751] Build status: STARTED
[13:40:05.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:62:0) after 7m58s
[13:48:03.777] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:62:0)
[13:48:03.798] Build status: STARTED
[13:48:03.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:63:0) after 6m44s
[13:54:47.817] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:63:0)
[13:54:47.865] Build status: STARTED
[13:54:47.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:64:0) after 7m47s
[14:02:34.850] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:64:0)
[14:02:34.864] Build status: STARTED
[14:02:34.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8884779853108357760:65:0) after 4m21s
[14:05:35.153] Received PubSub notification, asking Buildbucket for the build status
[14:05:35.167] Build:
{
"id": "8719349790737102305",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 35287,
"createdBy": "project:chromium",
"createTime": "2025-03-26T08:17:51.019448140Z",
"startTime": "2025-03-26T08:18:34.867111577Z",
"endTime": "2025-03-26T14:05:34.693753707Z",
"updateTime": "2025-03-26T14:05:34.693753707Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4b2db29401f954b897e96a9886e93de645a9a287",
"ref": "refs/heads/main"
}
},
"canary": true
}
[14:05:35.167] Invocation finished in 5h47m45.793408192s with status FAILED