[10:04:46.947] New invocation is queued and will start shortly
[10:04:48.085] Starting the invocation (attempt 1)
[10:04:48.113] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/708266bdcf84e85296c51db1f1c2dfb22b3942ec"
[10:04:48.113] Popped gitiles commit info from properties and tags
[10:04:48.113] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:04:48.113] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:04:48.113] Buildbucket request:
{
"requestId": "8938950109719932464",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "708266bdcf84e85296c51db1f1c2dfb22b3942ec",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8938950109719932464"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:04:48.678] Scheduled build:
{
"id": "8773520047772626817",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 29303,
"createdBy": "project:chromium",
"createTime": "2023-08-06T10:04:48.171712207Z",
"updateTime": "2023-08-06T10:04:48.171712207Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "708266bdcf84e85296c51db1f1c2dfb22b3942ec",
"ref": "refs/heads/main"
}
},
"canary": true
}
[10:04:48.678] Task URL: https://cr-buildbucket.appspot.com/build/8773520047772626817
[10:04:48.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:2:0) after 8m29s
[10:04:49.584] Received PubSub notification, asking Buildbucket for the build status
[10:04:49.617] Build status: SCHEDULED
[10:09:11.889] Received PubSub notification, asking Buildbucket for the build status
[10:09:11.928] Build status: STARTED
[10:13:17.702] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:2:0)
[10:13:17.720] Build status: STARTED
[10:13:17.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:5:0) after 2m16s
[10:15:33.767] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:5:0)
[10:15:33.781] Build status: STARTED
[10:15:33.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:6:0) after 7m27s
[10:23:00.865] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:6:0)
[10:23:00.898] Build status: STARTED
[10:23:00.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:7:0) after 5m17s
[10:28:17.929] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:7:0)
[10:28:17.954] Build status: STARTED
[10:28:17.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:8:0) after 8m34s
[10:36:51.972] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:8:0)
[10:36:51.994] Build status: STARTED
[10:36:51.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:9:0) after 4m25s
[10:41:17.138] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:9:0)
[10:41:17.156] Build status: STARTED
[10:41:17.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:10:0) after 3m36s
[10:44:53.196] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:10:0)
[10:44:53.230] Build status: STARTED
[10:44:53.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:11:0) after 6m7s
[10:51:00.244] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:11:0)
[10:51:00.271] Build status: STARTED
[10:51:00.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:12:0) after 6m27s
[10:57:27.360] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:12:0)
[10:57:27.378] Build status: STARTED
[10:57:27.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:13:0) after 6m58s
[11:04:25.537] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:13:0)
[11:04:25.570] Build status: STARTED
[11:04:25.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:14:0) after 7m23s
[11:11:48.596] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:14:0)
[11:11:48.629] Build status: STARTED
[11:11:48.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:15:0) after 5m3s
[11:16:51.666] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:15:0)
[11:16:51.683] Build status: STARTED
[11:16:51.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:16:0) after 3m6s
[11:19:57.699] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:16:0)
[11:19:57.730] Build status: STARTED
[11:19:57.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:17:0) after 7m39s
[11:27:36.801] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:17:0)
[11:27:36.847] Build status: STARTED
[11:27:36.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:18:0) after 5m42s
[11:33:18.873] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:18:0)
[11:33:18.931] Build status: STARTED
[11:33:18.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:19:0) after 9m1s
[11:42:19.954] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:19:0)
[11:42:20.044] Build status: STARTED
[11:42:20.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:20:0) after 6m20s
[11:48:40.165] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:20:0)
[11:48:40.184] Build status: STARTED
[11:48:40.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:21:0) after 4m23s
[11:53:03.205] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:21:0)
[11:53:03.226] Build status: STARTED
[11:53:03.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:22:0) after 2m23s
[11:55:26.353] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:22:0)
[11:55:26.371] Build status: STARTED
[11:55:26.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:23:0) after 7m46s
[12:03:12.386] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:23:0)
[12:03:12.418] Build status: STARTED
[12:03:12.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:24:0) after 5m36s
[12:08:48.504] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:24:0)
[12:08:48.523] Build status: STARTED
[12:08:48.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:25:0) after 3m50s
[12:12:38.591] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:25:0)
[12:12:38.617] Build status: STARTED
[12:12:38.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:26:0) after 3m53s
[12:16:31.637] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:26:0)
[12:16:31.655] Build status: STARTED
[12:16:31.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:27:0) after 2m27s
[12:18:58.669] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:27:0)
[12:18:58.687] Build status: STARTED
[12:18:58.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:28:0) after 7m16s
[12:26:14.809] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:28:0)
[12:26:14.866] Build status: STARTED
[12:26:14.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:29:0) after 8m25s
[12:34:39.870] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:29:0)
[12:34:39.894] Build status: STARTED
[12:34:39.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:30:0) after 8m9s
[12:42:48.907] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:30:0)
[12:42:48.925] Build status: STARTED
[12:42:48.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:31:0) after 8m17s
[12:51:05.940] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:31:0)
[12:51:05.969] Build status: STARTED
[12:51:05.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:32:0) after 8m4s
[12:59:10.113] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:32:0)
[12:59:10.152] Build status: STARTED
[12:59:10.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:33:0) after 5m35s
[13:04:45.226] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:33:0)
[13:04:45.266] Build status: STARTED
[13:04:45.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:34:0) after 2m27s
[13:07:12.495] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:34:0)
[13:07:12.519] Build status: STARTED
[13:07:12.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:35:0) after 2m59s
[13:10:11.998] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:35:0)
[13:10:12.018] Build status: STARTED
[13:10:12.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:36:0) after 2m9s
[13:12:21.456] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:36:0)
[13:12:21.478] Build status: STARTED
[13:12:21.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:37:0) after 8m30s
[13:20:51.726] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:37:0)
[13:20:51.746] Build status: STARTED
[13:20:51.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:38:0) after 5m9s
[13:26:00.880] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:38:0)
[13:26:00.902] Build status: STARTED
[13:26:00.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:39:0) after 1m18s
[13:27:19.234] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:39:0)
[13:27:19.270] Build status: STARTED
[13:27:19.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:40:0) after 2m40s
[13:29:59.356] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:40:0)
[13:29:59.372] Build status: STARTED
[13:29:59.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:41:0) after 9m48s
[13:39:47.734] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:41:0)
[13:39:47.843] Build status: STARTED
[13:39:47.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:42:0) after 8m38s
[13:48:25.993] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:42:0)
[13:48:26.059] Build status: STARTED
[13:48:26.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:43:0) after 6m56s
[13:55:22.127] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:43:0)
[13:55:22.166] Build status: STARTED
[13:55:22.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:44:0) after 3m24s
[13:58:46.185] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:44:0)
[13:58:46.205] Build status: STARTED
[13:58:46.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:45:0) after 2m38s
[14:01:24.221] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:45:0)
[14:01:24.246] Build status: STARTED
[14:01:24.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:46:0) after 4m33s
[14:05:57.263] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:46:0)
[14:05:57.281] Build status: STARTED
[14:05:57.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:47:0) after 3m13s
[14:09:10.506] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:47:0)
[14:09:10.522] Build status: STARTED
[14:09:10.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:48:0) after 7m7s
[14:16:17.541] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:48:0)
[14:16:17.612] Build status: STARTED
[14:16:17.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:49:0) after 1m28s
[14:17:45.713] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:49:0)
[14:17:45.737] Build status: STARTED
[14:17:45.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:50:0) after 2m22s
[14:20:07.879] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:50:0)
[14:20:07.898] Build status: STARTED
[14:20:07.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:51:0) after 8m43s
[14:28:50.922] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:51:0)
[14:28:50.940] Build status: STARTED
[14:28:50.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:52:0) after 8m58s
[14:37:48.985] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:52:0)
[14:37:49.003] Build status: STARTED
[14:37:49.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:53:0) after 8m34s
[14:46:23.225] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:53:0)
[14:46:23.243] Build status: STARTED
[14:46:23.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:54:0) after 3m46s
[14:50:09.778] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:54:0)
[14:50:09.802] Build status: STARTED
[14:50:09.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:55:0) after 1m6s
[14:51:15.819] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:55:0)
[14:51:15.835] Build status: STARTED
[14:51:15.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:56:0) after 2m42s
[14:53:58.034] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:56:0)
[14:53:58.051] Build status: STARTED
[14:53:58.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:57:0) after 2m5s
[14:56:03.174] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:57:0)
[14:56:03.238] Build status: STARTED
[14:56:03.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:58:0) after 1m40s
[14:57:43.467] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:58:0)
[14:57:43.488] Build status: STARTED
[14:57:43.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8938950109719932464:59:0) after 6m10s
[14:59:17.579] Received PubSub notification, asking Buildbucket for the build status
[14:59:17.595] Build:
{
"id": "8773520047772626817",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 29303,
"createdBy": "project:chromium",
"createTime": "2023-08-06T10:04:48.171712207Z",
"startTime": "2023-08-06T10:09:11.198029Z",
"endTime": "2023-08-06T14:59:17.413241539Z",
"updateTime": "2023-08-06T14:59:17.413241539Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "708266bdcf84e85296c51db1f1c2dfb22b3942ec",
"ref": "refs/heads/main"
}
},
"canary": true
}
[14:59:17.595] Invocation finished in 4h54m30.664727085s with status FAILED