[19:58:38.699] New invocation is queued and will start shortly
[19:58:39.841] Starting the invocation (attempt 1)
[19:58:39.866] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/bf618f3fddd90943141a24fde4fe9dc85a4108a0"
[19:58:39.866] Popped gitiles commit info from properties and tags
[19:58:39.866] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:58:39.866] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:58:39.866] Buildbucket request:
{
"requestId": "8902764557522904912",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bf618f3fddd90943141a24fde4fe9dc85a4108a0",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8902764557522904912"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:58:40.487] Scheduled build:
{
"id": "8737334495532900593",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 31449,
"createdBy": "project:chromium",
"createTime": "2024-09-08T19:58:39.967899724Z",
"updateTime": "2024-09-08T19:58:39.967899724Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bf618f3fddd90943141a24fde4fe9dc85a4108a0",
"ref": "refs/heads/main"
}
},
"canary": true
}
[19:58:40.487] Task URL: https://cr-buildbucket.appspot.com/build/8737334495532900593
[19:58:40.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:2:0) after 7m56s
[19:58:41.415] Received PubSub notification, asking Buildbucket for the build status
[19:58:41.432] Build status: SCHEDULED
[19:58:44.640] Received PubSub notification, asking Buildbucket for the build status
[19:58:44.728] Build status: STARTED
[20:06:36.819] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:2:0)
[20:06:36.902] Build status: STARTED
[20:06:36.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:5:0) after 8m11s
[20:14:48.016] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:5:0)
[20:14:48.043] Build status: STARTED
[20:14:48.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:6:0) after 6m32s
[20:21:20.187] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:6:0)
[20:21:20.225] Build status: STARTED
[20:21:20.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:7:0) after 6m34s
[20:27:54.243] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:7:0)
[20:27:54.260] Build status: STARTED
[20:27:54.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:8:0) after 6m35s
[20:34:29.276] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:8:0)
[20:34:29.295] Build status: STARTED
[20:34:29.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:9:0) after 4m8s
[20:38:37.405] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:9:0)
[20:38:37.467] Build status: STARTED
[20:38:37.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:10:0) after 1m2s
[20:39:39.499] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:10:0)
[20:39:39.521] Build status: STARTED
[20:39:39.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:11:0) after 4m14s
[20:43:53.734] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:11:0)
[20:43:53.754] Build status: STARTED
[20:43:53.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:12:0) after 4m5s
[20:47:58.800] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:12:0)
[20:47:58.824] Build status: STARTED
[20:47:58.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:13:0) after 5m6s
[20:53:04.808] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:13:0)
[20:53:04.825] Build status: STARTED
[20:53:04.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:14:0) after 5m34s
[20:58:38.838] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:14:0)
[20:58:38.863] Build status: STARTED
[20:58:38.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:15:0) after 7m13s
[21:05:51.886] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:15:0)
[21:05:51.907] Build status: STARTED
[21:05:51.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:16:0) after 5m11s
[21:11:03.023] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:16:0)
[21:11:03.063] Build status: STARTED
[21:11:03.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:17:0) after 7m51s
[21:18:54.078] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:17:0)
[21:18:54.095] Build status: STARTED
[21:18:54.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:18:0) after 8m48s
[21:27:42.217] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:18:0)
[21:27:42.237] Build status: STARTED
[21:27:42.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:19:0) after 3m23s
[21:31:05.432] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:19:0)
[21:31:05.448] Build status: STARTED
[21:31:05.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:20:0) after 4m47s
[21:35:52.466] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:20:0)
[21:35:52.520] Build status: STARTED
[21:35:52.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:21:0) after 7m49s
[21:43:41.538] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:21:0)
[21:43:41.557] Build status: STARTED
[21:43:41.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:22:0) after 1m0s
[21:44:41.608] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:22:0)
[21:44:41.626] Build status: STARTED
[21:44:41.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:23:0) after 7m41s
[21:52:22.714] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:23:0)
[21:52:22.733] Build status: STARTED
[21:52:22.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:24:0) after 2m17s
[21:54:39.762] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:24:0)
[21:54:39.780] Build status: STARTED
[21:54:39.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:25:0) after 1m39s
[21:56:18.796] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:25:0)
[21:56:18.812] Build status: STARTED
[21:56:18.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:26:0) after 7m42s
[22:04:00.838] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:26:0)
[22:04:00.868] Build status: STARTED
[22:04:00.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:27:0) after 1m41s
[22:05:41.900] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:27:0)
[22:05:41.923] Build status: STARTED
[22:05:41.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:28:0) after 4m41s
[22:10:22.944] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:28:0)
[22:10:23.064] Build status: STARTED
[22:10:23.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:29:0) after 1m16s
[22:11:39.050] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:29:0)
[22:11:39.068] Build status: STARTED
[22:11:39.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:30:0) after 5m15s
[22:16:54.106] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:30:0)
[22:16:54.195] Build status: STARTED
[22:16:54.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:31:0) after 9m14s
[22:26:08.216] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:31:0)
[22:26:08.279] Build status: STARTED
[22:26:08.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:32:0) after 9m34s
[22:35:42.554] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:32:0)
[22:35:42.589] Build status: STARTED
[22:35:42.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:33:0) after 1m44s
[22:37:26.603] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:33:0)
[22:37:26.620] Build status: STARTED
[22:37:26.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:34:0) after 9m32s
[22:46:58.889] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:34:0)
[22:46:58.913] Build status: STARTED
[22:46:58.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:35:0) after 6m6s
[22:53:04.935] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:35:0)
[22:53:04.956] Build status: STARTED
[22:53:04.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:36:0) after 1m18s
[22:54:23.036] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:36:0)
[22:54:23.053] Build status: STARTED
[22:54:23.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:37:0) after 1m58s
[22:56:21.321] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:37:0)
[22:56:21.338] Build status: STARTED
[22:56:21.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:38:0) after 1m53s
[22:58:14.442] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:38:0)
[22:58:14.458] Build status: STARTED
[22:58:14.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:39:0) after 1m40s
[22:59:54.473] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:39:0)
[22:59:54.486] Build status: STARTED
[22:59:54.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:40:0) after 9m4s
[23:08:58.506] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:40:0)
[23:08:58.546] Build status: STARTED
[23:08:58.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:41:0) after 4m48s
[23:13:46.645] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:41:0)
[23:13:46.663] Build status: STARTED
[23:13:46.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:42:0) after 8m55s
[23:22:42.038] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:42:0)
[23:22:42.055] Build status: STARTED
[23:22:42.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:43:0) after 3m44s
[23:26:26.070] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:43:0)
[23:26:26.087] Build status: STARTED
[23:26:26.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:44:0) after 6m53s
[23:33:19.196] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:44:0)
[23:33:19.214] Build status: STARTED
[23:33:19.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:45:0) after 1m34s
[23:34:53.244] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:45:0)
[23:34:53.336] Build status: STARTED
[23:34:53.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:46:0) after 7m41s
[23:42:34.353] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:46:0)
[23:42:34.409] Build status: STARTED
[23:42:34.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:47:0) after 4m31s
[23:47:05.561] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:47:0)
[23:47:05.580] Build status: STARTED
[23:47:05.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:48:0) after 5m41s
[23:52:46.802] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:48:0)
[23:52:46.836] Build status: STARTED
[23:52:46.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:49:0) after 7m37s
[00:00:23.948] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:49:0)
[00:00:23.962] Build status: STARTED
[00:00:23.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:50:0) after 4m30s
[00:04:53.985] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:50:0)
[00:04:54.005] Build status: STARTED
[00:04:54.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:51:0) after 6m31s
[00:11:25.027] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:51:0)
[00:11:25.050] Build status: STARTED
[00:11:25.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:52:0) after 2m19s
[00:13:44.163] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:52:0)
[00:13:44.197] Build status: STARTED
[00:13:44.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:53:0) after 1m29s
[00:15:13.213] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:53:0)
[00:15:13.235] Build status: STARTED
[00:15:13.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:54:0) after 3m35s
[00:18:48.396] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:54:0)
[00:18:48.416] Build status: STARTED
[00:18:48.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:55:0) after 3m46s
[00:22:34.433] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:55:0)
[00:22:34.450] Build status: STARTED
[00:22:34.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:56:0) after 6m45s
[00:29:19.575] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:56:0)
[00:29:19.589] Build status: STARTED
[00:29:19.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:57:0) after 1m15s
[00:30:34.619] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:57:0)
[00:30:34.636] Build status: STARTED
[00:30:34.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:58:0) after 8m36s
[00:39:10.739] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:58:0)
[00:39:10.757] Build status: STARTED
[00:39:10.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:59:0) after 6m50s
[00:46:00.990] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:59:0)
[00:46:01.010] Build status: STARTED
[00:46:01.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:60:0) after 3m16s
[00:49:17.278] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:60:0)
[00:49:17.300] Build status: STARTED
[00:49:17.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:61:0) after 9m11s
[00:58:28.544] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:61:0)
[00:58:28.560] Build status: STARTED
[00:58:28.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:62:0) after 5m28s
[01:03:56.703] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:62:0)
[01:03:56.724] Build status: STARTED
[01:03:56.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:63:0) after 7m35s
[01:11:31.750] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:63:0)
[01:11:31.765] Build status: STARTED
[01:11:31.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:64:0) after 2m4s
[01:13:35.854] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:64:0)
[01:13:35.910] Build status: STARTED
[01:13:35.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:65:0) after 7m15s
[01:20:51.024] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:65:0)
[01:20:51.040] Build status: STARTED
[01:20:51.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:66:0) after 3m31s
[01:24:22.221] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:66:0)
[01:24:22.240] Build status: STARTED
[01:24:22.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:67:0) after 7m9s
[01:31:31.362] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:67:0)
[01:31:31.422] Build status: STARTED
[01:31:31.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8902764557522904912:68:0) after 7m30s
[01:36:20.682] Received PubSub notification, asking Buildbucket for the build status
[01:36:20.735] Build:
{
"id": "8737334495532900593",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 31449,
"createdBy": "project:chromium",
"createTime": "2024-09-08T19:58:39.967899724Z",
"startTime": "2024-09-08T19:58:44.273952893Z",
"endTime": "2024-09-09T01:36:20.376789278Z",
"updateTime": "2024-09-09T01:36:20.376789278Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bf618f3fddd90943141a24fde4fe9dc85a4108a0",
"ref": "refs/heads/main"
}
},
"canary": true
}
[01:36:20.735] Invocation finished in 5h37m42.049508225s with status FAILED