[03:18:06.097] New invocation is queued and will start shortly
[03:18:07.192] Starting the invocation (attempt 1)
[03:18:07.215] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/61199193340babe2b0dd2ea5f5b3bbbdbd986263"
[03:18:07.215] Popped gitiles commit info from properties and tags
[03:18:07.215] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:18:07.215] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:18:07.216] Buildbucket request:
{
"requestId": "8851006041481262544",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "61199193340babe2b0dd2ea5f5b3bbbdbd986263",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851006041481262544"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:18:07.888] Scheduled build:
{
"id": "8685575979584697681",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 39600,
"createdBy": "project:chromium",
"createTime": "2026-04-03T03:18:07.283527615Z",
"updateTime": "2026-04-03T03:18:07.283527615Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "61199193340babe2b0dd2ea5f5b3bbbdbd986263",
"ref": "refs/heads/main"
}
},
"canary": true
}
[03:18:07.888] Task URL: https://cr-buildbucket.appspot.com/build/8685575979584697681
[03:18:07.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:2:0) after 4m1s
[03:18:08.793] Received PubSub notification, asking Buildbucket for the build status
[03:18:08.818] Build status: SCHEDULED
[03:18:51.370] Received PubSub notification, asking Buildbucket for the build status
[03:18:51.386] Build status: STARTED
[03:22:08.956] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:2:0)
[03:22:09.035] Build status: STARTED
[03:22:09.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:5:0) after 5m0s
[03:27:09.055] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:5:0)
[03:27:09.073] Build status: STARTED
[03:27:09.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:6:0) after 5m49s
[03:32:58.108] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:6:0)
[03:32:58.126] Build status: STARTED
[03:32:58.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:7:0) after 2m29s
[03:35:27.162] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:7:0)
[03:35:27.178] Build status: STARTED
[03:35:27.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:8:0) after 8m38s
[03:44:05.214] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:8:0)
[03:44:05.231] Build status: STARTED
[03:44:05.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:9:0) after 7m24s
[03:51:29.423] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:9:0)
[03:51:29.440] Build status: STARTED
[03:51:29.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:10:0) after 1m27s
[03:52:56.459] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:10:0)
[03:52:56.477] Build status: STARTED
[03:52:56.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:11:0) after 8m43s
[04:01:39.494] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:11:0)
[04:01:39.519] Build status: STARTED
[04:01:39.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:12:0) after 1m50s
[04:03:29.591] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:12:0)
[04:03:29.611] Build status: STARTED
[04:03:29.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:13:0) after 2m41s
[04:06:10.626] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:13:0)
[04:06:10.645] Build status: STARTED
[04:06:10.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:14:0) after 4m31s
[04:10:41.663] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:14:0)
[04:10:41.677] Build status: STARTED
[04:10:41.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:15:0) after 1m11s
[04:11:52.659] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:15:0)
[04:11:52.673] Build status: STARTED
[04:11:52.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:16:0) after 1m4s
[04:12:56.755] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:16:0)
[04:12:56.774] Build status: STARTED
[04:12:56.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:17:0) after 8m7s
[04:21:03.788] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:17:0)
[04:21:03.809] Build status: STARTED
[04:21:03.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:18:0) after 4m0s
[04:25:03.875] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:18:0)
[04:25:03.899] Build status: STARTED
[04:25:03.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:19:0) after 1m32s
[04:26:35.948] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:19:0)
[04:26:35.968] Build status: STARTED
[04:26:35.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:20:0) after 9m5s
[04:35:41.117] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:20:0)
[04:35:41.135] Build status: STARTED
[04:35:41.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:21:0) after 4m7s
[04:39:48.165] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:21:0)
[04:39:48.189] Build status: STARTED
[04:39:48.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:22:0) after 9m7s
[04:48:55.256] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:22:0)
[04:48:55.281] Build status: STARTED
[04:48:55.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:23:0) after 8m12s
[04:57:07.343] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:23:0)
[04:57:07.384] Build status: STARTED
[04:57:07.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:24:0) after 4m44s
[05:01:51.983] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:24:0)
[05:01:52.032] Build status: STARTED
[05:01:52.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:25:0) after 8m3s
[05:09:55.047] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:25:0)
[05:09:55.065] Build status: STARTED
[05:09:55.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:26:0) after 3m5s
[05:13:00.077] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:26:0)
[05:13:00.094] Build status: STARTED
[05:13:00.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:27:0) after 4m51s
[05:17:51.528] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:27:0)
[05:17:51.624] Build status: STARTED
[05:17:51.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:28:0) after 3m59s
[05:21:50.614] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:28:0)
[05:21:50.690] Build status: STARTED
[05:21:50.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:29:0) after 7m17s
[05:29:07.710] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:29:0)
[05:29:07.730] Build status: STARTED
[05:29:07.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:30:0) after 4m27s
[05:33:34.744] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:30:0)
[05:33:34.824] Build status: STARTED
[05:33:34.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:31:0) after 8m33s
[05:42:07.803] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:31:0)
[05:42:07.822] Build status: STARTED
[05:42:07.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:32:0) after 1m21s
[05:43:28.836] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:32:0)
[05:43:28.851] Build status: STARTED
[05:43:28.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:33:0) after 9m9s
[05:52:37.926] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:33:0)
[05:52:38.029] Build status: STARTED
[05:52:38.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:34:0) after 2m21s
[05:54:59.056] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:34:0)
[05:54:59.116] Build status: STARTED
[05:54:59.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:35:0) after 2m24s
[05:57:23.120] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:35:0)
[05:57:23.144] Build status: STARTED
[05:57:23.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:36:0) after 3m8s
[06:00:31.146] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:36:0)
[06:00:31.165] Build status: STARTED
[06:00:31.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:37:0) after 5m16s
[06:05:47.234] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:37:0)
[06:05:47.287] Build status: STARTED
[06:05:47.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:38:0) after 8m11s
[06:13:58.303] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:38:0)
[06:13:58.320] Build status: STARTED
[06:13:58.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:39:0) after 7m2s
[06:21:00.337] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:39:0)
[06:21:00.354] Build status: STARTED
[06:21:00.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:40:0) after 6m2s
[06:27:02.415] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:40:0)
[06:27:02.442] Build status: STARTED
[06:27:02.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:41:0) after 4m17s
[06:31:19.462] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:41:0)
[06:31:19.480] Build status: STARTED
[06:31:19.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8851006041481262544:42:0) after 7m21s
[06:33:42.231] Received PubSub notification, asking Buildbucket for the build status
[06:33:42.248] Build:
{
"id": "8685575979584697681",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 39600,
"createdBy": "project:chromium",
"createTime": "2026-04-03T03:18:07.283527615Z",
"startTime": "2026-04-03T03:18:51.166201587Z",
"endTime": "2026-04-03T06:33:41.621320342Z",
"updateTime": "2026-04-03T06:33:41.621320342Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "61199193340babe2b0dd2ea5f5b3bbbdbd986263",
"ref": "refs/heads/main"
}
},
"canary": true
}
[06:33:42.248] Invocation finished in 3h15m36.157799138s with status FAILED