[16:19:21.010] New invocation is queued and will start shortly
[16:19:22.166] Starting the invocation (attempt 1)
[16:19:22.193] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5b9e7084bf6b7d1ff10209a99f3074c69bfefc05"
[16:19:22.193] Popped gitiles commit info from properties and tags
[16:19:22.193] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:19:22.193] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:19:22.193] Buildbucket request:
{
"requestId": "8913559393353687776",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5b9e7084bf6b7d1ff10209a99f3074c69bfefc05",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8913559393353687776"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:19:22.778] Scheduled build:
{
"id": "8748129331407246113",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 30809,
"createdBy": "project:chromium",
"createTime": "2024-05-12T16:19:22.244615452Z",
"updateTime": "2024-05-12T16:19:22.244615452Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5b9e7084bf6b7d1ff10209a99f3074c69bfefc05",
"ref": "refs/heads/main"
}
},
"canary": true
}
[16:19:22.778] Task URL: https://cr-buildbucket.appspot.com/build/8748129331407246113
[16:19:22.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:2:0) after 8m38s
[16:19:23.153] Received PubSub notification, asking Buildbucket for the build status
[16:19:23.172] Build status: SCHEDULED
[16:19:28.529] Received PubSub notification, asking Buildbucket for the build status
[16:19:28.545] Build status: STARTED
[16:28:00.807] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:2:0)
[16:28:00.839] Build status: STARTED
[16:28:00.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:5:0) after 3m19s
[16:31:19.854] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:5:0)
[16:31:19.878] Build status: STARTED
[16:31:19.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:6:0) after 8m25s
[16:39:44.919] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:6:0)
[16:39:44.942] Build status: STARTED
[16:39:44.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:7:0) after 2m42s
[16:42:27.099] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:7:0)
[16:42:27.128] Build status: STARTED
[16:42:27.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:8:0) after 1m26s
[16:43:53.147] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:8:0)
[16:43:53.231] Build status: STARTED
[16:43:53.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:9:0) after 5m36s
[16:49:29.248] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:9:0)
[16:49:29.271] Build status: STARTED
[16:49:29.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:10:0) after 6m44s
[16:56:13.293] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:10:0)
[16:56:13.314] Build status: STARTED
[16:56:13.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:11:0) after 6m5s
[17:02:18.335] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:11:0)
[17:02:18.351] Build status: STARTED
[17:02:18.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:12:0) after 8m46s
[17:11:04.455] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:12:0)
[17:11:04.533] Build status: STARTED
[17:11:04.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:13:0) after 8m10s
[17:19:14.604] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:13:0)
[17:19:14.627] Build status: STARTED
[17:19:14.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:14:0) after 7m38s
[17:26:52.655] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:14:0)
[17:26:52.676] Build status: STARTED
[17:26:52.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:15:0) after 3m14s
[17:30:06.693] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:15:0)
[17:30:06.724] Build status: STARTED
[17:30:06.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:16:0) after 8m54s
[17:39:00.746] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:16:0)
[17:39:00.769] Build status: STARTED
[17:39:00.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:17:0) after 3m15s
[17:42:15.784] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:17:0)
[17:42:15.809] Build status: STARTED
[17:42:15.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:18:0) after 2m46s
[17:45:01.842] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:18:0)
[17:45:01.877] Build status: STARTED
[17:45:01.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:19:0) after 5m55s
[17:50:56.894] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:19:0)
[17:50:56.914] Build status: STARTED
[17:50:56.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:20:0) after 9m24s
[18:00:20.955] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:20:0)
[18:00:20.981] Build status: STARTED
[18:00:20.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:21:0) after 4m16s
[18:04:37.016] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:21:0)
[18:04:37.047] Build status: STARTED
[18:04:37.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:22:0) after 1m29s
[18:06:06.072] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:22:0)
[18:06:06.144] Build status: STARTED
[18:06:06.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:23:0) after 9m21s
[18:15:27.158] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:23:0)
[18:15:27.181] Build status: STARTED
[18:15:27.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:24:0) after 4m28s
[18:19:55.297] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:24:0)
[18:19:55.315] Build status: STARTED
[18:19:55.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:25:0) after 9m54s
[18:29:49.332] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:25:0)
[18:29:49.356] Build status: STARTED
[18:29:49.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:26:0) after 3m36s
[18:33:25.572] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:26:0)
[18:33:25.593] Build status: STARTED
[18:33:25.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:27:0) after 8m23s
[18:41:48.594] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:27:0)
[18:41:48.613] Build status: STARTED
[18:41:48.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:28:0) after 2m3s
[18:43:51.642] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:28:0)
[18:43:51.664] Build status: STARTED
[18:43:51.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:29:0) after 4m21s
[18:48:12.706] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:29:0)
[18:48:12.868] Build status: STARTED
[18:48:12.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:30:0) after 6m9s
[18:54:22.010] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:30:0)
[18:54:22.031] Build status: STARTED
[18:54:22.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:31:0) after 6m9s
[19:00:31.051] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:31:0)
[19:00:31.080] Build status: STARTED
[19:00:31.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:32:0) after 6m30s
[19:07:01.134] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:32:0)
[19:07:01.218] Build status: STARTED
[19:07:01.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:33:0) after 5m9s
[19:12:10.234] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:33:0)
[19:12:10.263] Build status: STARTED
[19:12:10.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:34:0) after 6m54s
[19:19:04.286] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:34:0)
[19:19:04.306] Build status: STARTED
[19:19:04.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:35:0) after 1m25s
[19:20:29.322] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:35:0)
[19:20:29.347] Build status: STARTED
[19:20:29.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:36:0) after 1m40s
[19:22:09.361] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:36:0)
[19:22:09.382] Build status: STARTED
[19:22:09.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:37:0) after 6m7s
[19:28:16.401] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:37:0)
[19:28:16.420] Build status: STARTED
[19:28:16.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:38:0) after 4m32s
[19:32:48.440] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:38:0)
[19:32:48.498] Build status: STARTED
[19:32:48.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:39:0) after 1m34s
[19:34:22.587] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:39:0)
[19:34:22.607] Build status: STARTED
[19:34:22.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:40:0) after 2m59s
[19:37:21.737] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:40:0)
[19:37:21.784] Build status: STARTED
[19:37:21.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:41:0) after 9m59s
[19:47:20.804] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:41:0)
[19:47:20.935] Build status: STARTED
[19:47:20.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:42:0) after 7m41s
[19:55:01.958] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:42:0)
[19:55:01.978] Build status: STARTED
[19:55:01.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:43:0) after 1m45s
[19:56:46.992] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:43:0)
[19:56:47.058] Build status: STARTED
[19:56:47.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:44:0) after 4m54s
[20:01:41.074] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:44:0)
[20:01:41.222] Build status: STARTED
[20:01:41.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:45:0) after 5m27s
[20:07:08.245] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:45:0)
[20:07:08.265] Build status: STARTED
[20:07:08.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:46:0) after 1m26s
[20:08:34.285] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:46:0)
[20:08:34.348] Build status: STARTED
[20:08:34.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:47:0) after 7m12s
[20:15:46.369] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:47:0)
[20:15:46.389] Build status: STARTED
[20:15:46.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:48:0) after 5m48s
[20:21:34.407] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:48:0)
[20:21:34.607] Build status: STARTED
[20:21:34.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:49:0) after 2m17s
[20:23:51.622] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:49:0)
[20:23:51.703] Build status: STARTED
[20:23:51.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:50:0) after 5m55s
[20:29:46.903] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:50:0)
[20:29:46.921] Build status: STARTED
[20:29:46.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:51:0) after 8m39s
[20:38:26.034] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:51:0)
[20:38:26.084] Build status: STARTED
[20:38:26.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:52:0) after 9m52s
[20:48:18.101] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:52:0)
[20:48:18.126] Build status: STARTED
[20:48:18.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:53:0) after 9m58s
[20:58:16.293] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:53:0)
[20:58:16.319] Build status: STARTED
[20:58:16.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:54:0) after 9m50s
[21:08:06.387] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:54:0)
[21:08:06.491] Build status: STARTED
[21:08:06.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:55:0) after 5m33s
[21:13:39.688] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:55:0)
[21:13:39.866] Build status: STARTED
[21:13:39.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:56:0) after 1m56s
[21:15:35.883] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:56:0)
[21:15:35.901] Build status: STARTED
[21:15:35.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:57:0) after 8m40s
[21:24:15.922] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:57:0)
[21:24:15.946] Build status: STARTED
[21:24:15.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:58:0) after 7m52s
[21:32:07.973] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:58:0)
[21:32:07.992] Build status: STARTED
[21:32:07.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:59:0) after 6m19s
[21:38:27.249] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:59:0)
[21:38:27.264] Build status: STARTED
[21:38:27.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8913559393353687776:60:0) after 4m46s
[21:42:40.639] Received PubSub notification, asking Buildbucket for the build status
[21:42:40.699] Build:
{
"id": "8748129331407246113",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 30809,
"createdBy": "project:chromium",
"createTime": "2024-05-12T16:19:22.244615452Z",
"startTime": "2024-05-12T16:19:28.250195897Z",
"endTime": "2024-05-12T21:41:43.369982603Z",
"updateTime": "2024-05-12T21:41:43.369982603Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5b9e7084bf6b7d1ff10209a99f3074c69bfefc05",
"ref": "refs/heads/main"
}
},
"canary": true
}
[21:42:40.699] Invocation finished in 5h23m19.694898158s with status FAILED