[12:08:09.808] New invocation is queued and will start shortly
[12:08:10.893] Starting the invocation (attempt 1)
[12:08:10.919] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/1bf4e3cca7af626b61573be69880b1bf953e7fa6"
[12:08:10.919] Popped gitiles commit info from properties and tags
[12:08:10.919] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[12:08:10.919] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[12:08:10.919] Buildbucket request:
{
"requestId": "8874980888976643520",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1bf4e3cca7af626b61573be69880b1bf953e7fa6",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8874980888976643520"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[12:08:11.404] Scheduled build:
{
"id": "8709550827095892369",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 35994,
"createdBy": "project:chromium",
"createTime": "2025-07-12T12:08:10.971427169Z",
"updateTime": "2025-07-12T12:08:10.971427169Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1bf4e3cca7af626b61573be69880b1bf953e7fa6",
"ref": "refs/heads/main"
}
}
}
[12:08:11.404] Task URL: https://cr-buildbucket.appspot.com/build/8709550827095892369
[12:08:11.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:2:0) after 9m28s
[12:08:58.568] Received PubSub notification, asking Buildbucket for the build status
[12:08:58.600] Build status: STARTED
[12:09:27.928] Received PubSub notification, asking Buildbucket for the build status
[12:09:27.957] Build status: STARTED
[12:17:39.531] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:2:0)
[12:17:39.563] Build status: STARTED
[12:17:39.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:5:0) after 3m59s
[12:21:39.134] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:5:0)
[12:21:39.161] Build status: STARTED
[12:21:39.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:6:0) after 4m53s
[12:26:32.280] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:6:0)
[12:26:32.307] Build status: STARTED
[12:26:32.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:7:0) after 4m58s
[12:31:30.333] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:7:0)
[12:31:30.360] Build status: STARTED
[12:31:30.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:8:0) after 8m31s
[12:40:01.430] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:8:0)
[12:40:01.461] Build status: STARTED
[12:40:01.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:9:0) after 6m16s
[12:46:17.487] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:9:0)
[12:46:17.551] Build status: STARTED
[12:46:17.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:10:0) after 7m19s
[12:53:36.591] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:10:0)
[12:53:36.627] Build status: STARTED
[12:53:36.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:11:0) after 5m19s
[12:58:55.611] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:11:0)
[12:58:55.637] Build status: STARTED
[12:58:55.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:12:0) after 4m36s
[13:03:31.758] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:12:0)
[13:03:31.821] Build status: STARTED
[13:03:31.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:13:0) after 2m38s
[13:06:09.844] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:13:0)
[13:06:09.873] Build status: STARTED
[13:06:09.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:14:0) after 1m32s
[13:07:41.850] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:14:0)
[13:07:41.870] Build status: STARTED
[13:07:41.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:15:0) after 7m19s
[13:15:01.215] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:15:0)
[13:15:01.275] Build status: STARTED
[13:15:01.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:16:0) after 2m45s
[13:17:46.298] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:16:0)
[13:17:46.313] Build status: STARTED
[13:17:46.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:17:0) after 1m33s
[13:19:19.333] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:17:0)
[13:19:19.357] Build status: STARTED
[13:19:19.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:18:0) after 1m26s
[13:20:45.427] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:18:0)
[13:20:45.503] Build status: STARTED
[13:20:45.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:19:0) after 6m41s
[13:27:26.520] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:19:0)
[13:27:26.540] Build status: STARTED
[13:27:26.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:20:0) after 1m5s
[13:28:31.562] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:20:0)
[13:28:31.578] Build status: STARTED
[13:28:31.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:21:0) after 8m48s
[13:37:19.619] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:21:0)
[13:37:19.635] Build status: STARTED
[13:37:19.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:22:0) after 1m15s
[13:38:34.641] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:22:0)
[13:38:34.659] Build status: STARTED
[13:38:34.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:23:0) after 8m16s
[13:46:50.649] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:23:0)
[13:46:50.665] Build status: STARTED
[13:46:50.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:24:0) after 9m16s
[13:56:06.723] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:24:0)
[13:56:06.777] Build status: STARTED
[13:56:06.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:25:0) after 6m36s
[14:02:42.799] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:25:0)
[14:02:42.817] Build status: STARTED
[14:02:42.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:26:0) after 5m51s
[14:08:33.842] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:26:0)
[14:08:33.939] Build status: STARTED
[14:08:33.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:27:0) after 4m3s
[14:12:36.937] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:27:0)
[14:12:37.032] Build status: STARTED
[14:12:37.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:28:0) after 2m41s
[14:15:18.182] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:28:0)
[14:15:18.209] Build status: STARTED
[14:15:18.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:29:0) after 4m16s
[14:19:34.328] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:29:0)
[14:19:34.349] Build status: STARTED
[14:19:34.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:30:0) after 2m8s
[14:21:42.374] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:30:0)
[14:21:42.399] Build status: STARTED
[14:21:42.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:31:0) after 6m46s
[14:28:28.434] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:31:0)
[14:28:28.458] Build status: STARTED
[14:28:28.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:32:0) after 2m58s
[14:31:26.575] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:32:0)
[14:31:26.734] Build status: STARTED
[14:31:26.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:33:0) after 3m7s
[14:34:33.883] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:33:0)
[14:34:33.903] Build status: STARTED
[14:34:33.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:34:0) after 6m26s
[14:41:00.058] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:34:0)
[14:41:00.150] Build status: STARTED
[14:41:00.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:35:0) after 6m15s
[14:47:15.170] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:35:0)
[14:47:15.190] Build status: STARTED
[14:47:15.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:36:0) after 4m53s
[14:52:08.265] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:36:0)
[14:52:08.329] Build status: STARTED
[14:52:08.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:37:0) after 8m15s
[15:00:23.367] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:37:0)
[15:00:23.424] Build status: STARTED
[15:00:23.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:38:0) after 4m51s
[15:05:14.450] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:38:0)
[15:05:14.466] Build status: STARTED
[15:05:14.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:39:0) after 5m36s
[15:10:50.611] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:39:0)
[15:10:50.626] Build status: STARTED
[15:10:50.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:40:0) after 1m11s
[15:12:01.799] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:40:0)
[15:12:01.909] Build status: STARTED
[15:12:01.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:41:0) after 8m42s
[15:20:43.882] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:41:0)
[15:20:43.899] Build status: STARTED
[15:20:43.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:42:0) after 8m55s
[15:29:38.916] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:42:0)
[15:29:38.956] Build status: STARTED
[15:29:38.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:43:0) after 1m31s
[15:31:10.068] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:43:0)
[15:31:10.086] Build status: STARTED
[15:31:10.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:44:0) after 2m27s
[15:33:37.182] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:44:0)
[15:33:37.261] Build status: STARTED
[15:33:37.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:45:0) after 7m12s
[15:40:49.335] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:45:0)
[15:40:49.350] Build status: STARTED
[15:40:49.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:46:0) after 6m20s
[15:47:09.441] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:46:0)
[15:47:09.457] Build status: STARTED
[15:47:09.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:47:0) after 7m59s
[15:55:08.495] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:47:0)
[15:55:08.523] Build status: STARTED
[15:55:08.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:48:0) after 6m26s
[16:01:34.556] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:48:0)
[16:01:34.623] Build status: STARTED
[16:01:34.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:49:0) after 2m3s
[16:03:37.655] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:49:0)
[16:03:37.677] Build status: STARTED
[16:03:37.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:50:0) after 1m38s
[16:05:15.695] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:50:0)
[16:05:15.714] Build status: STARTED
[16:05:15.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:51:0) after 1m36s
[16:06:51.739] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:51:0)
[16:06:51.757] Build status: STARTED
[16:06:51.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:52:0) after 4m54s
[16:11:45.783] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:52:0)
[16:11:45.814] Build status: STARTED
[16:11:45.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:53:0) after 3m59s
[16:15:44.928] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:53:0)
[16:15:44.946] Build status: STARTED
[16:15:44.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:54:0) after 7m4s
[16:22:48.961] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:54:0)
[16:22:49.002] Build status: STARTED
[16:22:49.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:55:0) after 5m47s
[16:28:36.024] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:55:0)
[16:28:36.043] Build status: STARTED
[16:28:36.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:56:0) after 7m47s
[16:36:23.061] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:56:0)
[16:36:23.083] Build status: STARTED
[16:36:23.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:57:0) after 1m22s
[16:37:45.101] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:57:0)
[16:37:45.117] Build status: STARTED
[16:37:45.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8874980888976643520:58:0) after 2m59s
[16:38:06.855] Received PubSub notification, asking Buildbucket for the build status
[16:38:06.878] Build:
{
"id": "8709550827095892369",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 35994,
"createdBy": "project:chromium",
"createTime": "2025-07-12T12:08:10.971427169Z",
"startTime": "2025-07-12T12:08:40.046567250Z",
"endTime": "2025-07-12T16:38:06.471648397Z",
"updateTime": "2025-07-12T16:38:06.471648397Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1bf4e3cca7af626b61573be69880b1bf953e7fa6",
"ref": "refs/heads/main"
}
}
}
[16:38:06.878] Invocation finished in 4h29m57.084265118s with status FAILED