[00:28:50.964] New invocation is queued and will start shortly
[00:28:52.233] Starting the invocation (attempt 1)
[00:28:52.259] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/790a3a3f4703a1add32b3a18ae2c63539a23bfb3"
[00:28:52.259] Popped gitiles commit info from properties and tags
[00:28:52.259] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:28:52.261] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:28:52.261] Buildbucket request:
{
"requestId": "8887074282546283680",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "790a3a3f4703a1add32b3a18ae2c63539a23bfb3",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8887074282546283680"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:28:53.058] Scheduled build:
{
"id": "8721644220317291201",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 34837,
"createdBy": "project:chromium",
"createTime": "2025-03-01T00:28:52.458156470Z",
"updateTime": "2025-03-01T00:28:52.458156470Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "790a3a3f4703a1add32b3a18ae2c63539a23bfb3",
"ref": "refs/heads/main"
}
},
"canary": true
}
[00:28:53.058] Task URL: https://cr-buildbucket.appspot.com/build/8721644220317291201
[00:28:53.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:2:0) after 5m34s
[00:28:53.186] Received PubSub notification, asking Buildbucket for the build status
[00:28:53.217] Build status: SCHEDULED
[00:28:56.193] Received PubSub notification, asking Buildbucket for the build status
[00:28:56.220] Build status: STARTED
[00:34:27.087] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:2:0)
[00:34:27.109] Build status: STARTED
[00:34:27.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:5:0) after 7m55s
[00:42:22.146] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:5:0)
[00:42:22.236] Build status: STARTED
[00:42:22.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:6:0) after 7m30s
[00:49:52.286] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:6:0)
[00:49:52.307] Build status: STARTED
[00:49:52.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:7:0) after 6m13s
[00:56:05.383] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:7:0)
[00:56:05.420] Build status: STARTED
[00:56:05.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:8:0) after 2m40s
[00:58:45.442] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:8:0)
[00:58:45.469] Build status: STARTED
[00:58:45.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:9:0) after 3m35s
[01:02:20.508] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:9:0)
[01:02:20.533] Build status: STARTED
[01:02:20.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:10:0) after 6m42s
[01:09:02.567] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:10:0)
[01:09:02.610] Build status: STARTED
[01:09:02.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:11:0) after 6m24s
[01:15:26.729] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:11:0)
[01:15:26.746] Build status: STARTED
[01:15:26.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:12:0) after 7m23s
[01:22:49.941] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:12:0)
[01:22:49.960] Build status: STARTED
[01:22:49.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:13:0) after 5m3s
[01:27:52.973] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:13:0)
[01:27:52.990] Build status: STARTED
[01:27:52.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:14:0) after 6m16s
[01:34:09.019] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:14:0)
[01:34:09.040] Build status: STARTED
[01:34:09.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:15:0) after 8m13s
[01:42:22.069] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:15:0)
[01:42:22.083] Build status: STARTED
[01:42:22.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:16:0) after 6m26s
[01:48:48.118] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:16:0)
[01:48:48.134] Build status: STARTED
[01:48:48.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:17:0) after 1m33s
[01:50:21.266] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:17:0)
[01:50:21.327] Build status: STARTED
[01:50:21.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:18:0) after 8m37s
[01:58:58.423] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:18:0)
[01:58:58.441] Build status: STARTED
[01:58:58.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:19:0) after 9m5s
[02:08:03.634] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:19:0)
[02:08:03.650] Build status: STARTED
[02:08:03.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:20:0) after 8m20s
[02:16:23.687] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:20:0)
[02:16:23.710] Build status: STARTED
[02:16:23.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:21:0) after 4m55s
[02:21:18.807] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:21:0)
[02:21:18.820] Build status: STARTED
[02:21:18.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:22:0) after 5m42s
[02:27:00.837] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:22:0)
[02:27:00.854] Build status: STARTED
[02:27:00.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:23:0) after 3m22s
[02:30:22.959] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:23:0)
[02:30:22.982] Build status: STARTED
[02:30:22.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:24:0) after 6m54s
[02:37:17.153] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:24:0)
[02:37:17.170] Build status: STARTED
[02:37:17.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:25:0) after 2m9s
[02:39:26.207] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:25:0)
[02:39:26.231] Build status: STARTED
[02:39:26.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:26:0) after 5m18s
[02:44:44.281] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:26:0)
[02:44:44.302] Build status: STARTED
[02:44:44.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:27:0) after 6m4s
[02:50:48.355] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:27:0)
[02:50:48.373] Build status: STARTED
[02:50:48.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:28:0) after 3m46s
[02:54:34.397] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:28:0)
[02:54:34.415] Build status: STARTED
[02:54:34.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:29:0) after 6m26s
[03:01:00.442] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:29:0)
[03:01:00.456] Build status: STARTED
[03:01:00.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:30:0) after 4m26s
[03:05:26.542] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:30:0)
[03:05:26.559] Build status: STARTED
[03:05:26.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:31:0) after 2m2s
[03:07:28.617] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:31:0)
[03:07:28.647] Build status: STARTED
[03:07:28.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:32:0) after 2m16s
[03:09:44.681] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:32:0)
[03:09:44.700] Build status: STARTED
[03:09:44.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:33:0) after 4m30s
[03:14:14.732] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:33:0)
[03:14:14.806] Build status: STARTED
[03:14:14.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:34:0) after 5m13s
[03:19:27.822] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:34:0)
[03:19:27.841] Build status: STARTED
[03:19:27.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:35:0) after 6m37s
[03:26:04.871] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:35:0)
[03:26:04.937] Build status: STARTED
[03:26:04.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:36:0) after 9m56s
[03:36:00.968] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:36:0)
[03:36:00.988] Build status: STARTED
[03:36:00.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:37:0) after 7m17s
[03:43:18.068] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:37:0)
[03:43:18.091] Build status: STARTED
[03:43:18.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:38:0) after 1m37s
[03:44:55.113] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:38:0)
[03:44:55.129] Build status: STARTED
[03:44:55.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:39:0) after 6m45s
[03:51:40.196] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:39:0)
[03:51:40.239] Build status: STARTED
[03:51:40.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:40:0) after 5m4s
[03:56:44.366] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:40:0)
[03:56:44.387] Build status: STARTED
[03:56:44.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:41:0) after 7m7s
[04:03:51.429] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:41:0)
[04:03:51.453] Build status: STARTED
[04:03:51.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:42:0) after 1m19s
[04:05:10.577] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:42:0)
[04:05:10.762] Build status: STARTED
[04:05:10.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:43:0) after 4m37s
[04:09:47.788] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:43:0)
[04:09:47.809] Build status: STARTED
[04:09:47.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:44:0) after 3m48s
[04:13:35.906] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:44:0)
[04:13:35.923] Build status: STARTED
[04:13:35.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:45:0) after 4m15s
[04:17:50.960] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:45:0)
[04:17:50.984] Build status: STARTED
[04:17:50.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:46:0) after 1m34s
[04:19:25.034] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:46:0)
[04:19:25.051] Build status: STARTED
[04:19:25.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:47:0) after 2m52s
[04:22:17.071] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:47:0)
[04:22:17.083] Build status: STARTED
[04:22:17.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:48:0) after 3m30s
[04:25:47.084] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:48:0)
[04:25:47.102] Build status: STARTED
[04:25:47.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:49:0) after 9m43s
[04:35:30.128] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:49:0)
[04:35:30.142] Build status: STARTED
[04:35:30.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:50:0) after 1m9s
[04:36:39.173] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:50:0)
[04:36:39.192] Build status: STARTED
[04:36:39.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:51:0) after 9m40s
[04:46:19.662] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:51:0)
[04:46:19.685] Build status: STARTED
[04:46:19.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:52:0) after 2m45s
[04:49:04.726] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:52:0)
[04:49:04.743] Build status: STARTED
[04:49:04.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:53:0) after 7m10s
[04:56:14.789] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:53:0)
[04:56:14.804] Build status: STARTED
[04:56:14.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:54:0) after 8m31s
[05:04:46.327] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:54:0)
[05:04:46.347] Build status: STARTED
[05:04:46.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:55:0) after 4m13s
[05:08:59.698] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:55:0)
[05:08:59.715] Build status: STARTED
[05:08:59.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:56:0) after 9m50s
[05:18:49.771] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:56:0)
[05:18:49.789] Build status: STARTED
[05:18:49.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:57:0) after 7m28s
[05:26:17.996] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:57:0)
[05:26:18.012] Build status: STARTED
[05:26:18.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:58:0) after 6m59s
[05:33:17.096] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:58:0)
[05:33:17.118] Build status: STARTED
[05:33:17.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:59:0) after 1m10s
[05:34:27.195] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:59:0)
[05:34:27.210] Build status: STARTED
[05:34:27.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:60:0) after 6m21s
[05:40:48.235] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:60:0)
[05:40:48.252] Build status: STARTED
[05:40:48.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8887074282546283680:61:0) after 8m4s
[05:47:29.692] Received PubSub notification, asking Buildbucket for the build status
[05:47:29.711] Build:
{
"id": "8721644220317291201",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 34837,
"createdBy": "project:chromium",
"createTime": "2025-03-01T00:28:52.458156470Z",
"startTime": "2025-03-01T00:28:56.008466768Z",
"endTime": "2025-03-01T05:47:29.400798535Z",
"updateTime": "2025-03-01T05:47:29.400798535Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "790a3a3f4703a1add32b3a18ae2c63539a23bfb3",
"ref": "refs/heads/main"
}
},
"canary": true
}
[05:47:29.711] Invocation finished in 5h18m38.76122664s with status FAILED