[23:13:16.152] New invocation is queued and will start shortly
[23:13:17.218] Starting the invocation (attempt 1)
[23:13:17.256] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/591e2ea83fac1140e5540f0ed032f7aefe633573"
[23:13:17.256] Popped gitiles commit info from properties and tags
[23:13:17.256] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:13:17.257] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:13:17.257] Buildbucket request:
{
"requestId": "8926851105883074208",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "591e2ea83fac1140e5540f0ed032f7aefe633573",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8926851105883074208"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:13:17.842] Scheduled build:
{
"id": "8761421043989936273",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 29801,
"createdBy": "project:chromium",
"createTime": "2023-12-17T23:13:17.333202176Z",
"updateTime": "2023-12-17T23:13:17.333202176Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "591e2ea83fac1140e5540f0ed032f7aefe633573",
"ref": "refs/heads/main"
}
}
}
[23:13:17.842] Task URL: https://cr-buildbucket.appspot.com/build/8761421043989936273
[23:13:17.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:2:0) after 4m10s
[23:13:19.749] Received PubSub notification, asking Buildbucket for the build status
[23:13:19.832] Build status: SCHEDULED
[23:13:42.061] Received PubSub notification, asking Buildbucket for the build status
[23:13:42.087] Build status: STARTED
[23:17:28.159] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:2:0)
[23:17:28.191] Build status: STARTED
[23:17:28.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:5:0) after 1m25s
[23:18:53.928] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:5:0)
[23:18:53.944] Build status: STARTED
[23:18:53.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:6:0) after 9m11s
[23:28:05.060] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:6:0)
[23:28:05.090] Build status: STARTED
[23:28:05.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:7:0) after 7m28s
[23:35:33.108] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:7:0)
[23:35:33.125] Build status: STARTED
[23:35:33.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:8:0) after 1m24s
[23:36:57.156] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:8:0)
[23:36:57.178] Build status: STARTED
[23:36:57.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:9:0) after 1m46s
[23:38:43.193] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:9:0)
[23:38:43.231] Build status: STARTED
[23:38:43.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:10:0) after 5m7s
[23:43:50.246] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:10:0)
[23:43:50.263] Build status: STARTED
[23:43:50.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:11:0) after 5m2s
[23:48:52.303] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:11:0)
[23:48:52.337] Build status: STARTED
[23:48:52.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:12:0) after 5m48s
[23:54:40.404] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:12:0)
[23:54:40.424] Build status: STARTED
[23:54:40.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:13:0) after 1m40s
[23:56:20.498] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:13:0)
[23:56:20.520] Build status: STARTED
[23:56:20.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:14:0) after 4m29s
[00:00:49.537] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:14:0)
[00:00:49.576] Build status: STARTED
[00:00:49.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:15:0) after 6m3s
[00:06:52.600] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:15:0)
[00:06:52.617] Build status: STARTED
[00:06:52.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:16:0) after 9m19s
[00:16:11.642] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:16:0)
[00:16:11.665] Build status: STARTED
[00:16:11.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:17:0) after 5m51s
[00:22:02.691] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:17:0)
[00:22:02.709] Build status: STARTED
[00:22:02.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:18:0) after 2m31s
[00:24:33.728] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:18:0)
[00:24:33.760] Build status: STARTED
[00:24:33.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:19:0) after 4m47s
[00:29:20.971] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:19:0)
[00:29:21.014] Build status: STARTED
[00:29:21.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:20:0) after 9m17s
[00:38:38.128] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:20:0)
[00:38:38.151] Build status: STARTED
[00:38:38.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:21:0) after 8m14s
[00:46:52.177] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:21:0)
[00:46:52.200] Build status: STARTED
[00:46:52.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:22:0) after 5m3s
[00:51:55.296] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:22:0)
[00:51:55.318] Build status: STARTED
[00:51:55.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:23:0) after 3m29s
[00:55:24.354] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:23:0)
[00:55:24.373] Build status: STARTED
[00:55:24.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:24:0) after 6m0s
[01:01:24.674] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:24:0)
[01:01:24.706] Build status: STARTED
[01:01:24.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:25:0) after 8m4s
[01:09:28.860] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:25:0)
[01:09:28.884] Build status: STARTED
[01:09:28.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:26:0) after 4m13s
[01:13:42.050] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:26:0)
[01:13:42.067] Build status: STARTED
[01:13:42.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:27:0) after 4m8s
[01:17:50.086] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:27:0)
[01:17:50.113] Build status: STARTED
[01:17:50.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:28:0) after 6m19s
[01:24:09.204] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:28:0)
[01:24:09.272] Build status: STARTED
[01:24:09.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:29:0) after 1m57s
[01:26:06.310] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:29:0)
[01:26:06.329] Build status: STARTED
[01:26:06.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:30:0) after 9m41s
[01:35:47.406] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:30:0)
[01:35:47.428] Build status: STARTED
[01:35:47.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:31:0) after 8m38s
[01:44:25.595] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:31:0)
[01:44:25.789] Build status: STARTED
[01:44:25.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:32:0) after 6m54s
[01:51:19.845] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:32:0)
[01:51:19.882] Build status: STARTED
[01:51:19.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:33:0) after 6m42s
[01:58:01.899] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:33:0)
[01:58:01.963] Build status: STARTED
[01:58:01.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:34:0) after 1m44s
[01:59:45.978] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:34:0)
[01:59:46.064] Build status: STARTED
[01:59:46.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:35:0) after 8m6s
[02:07:52.211] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:35:0)
[02:07:52.235] Build status: STARTED
[02:07:52.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:36:0) after 5m8s
[02:13:00.354] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:36:0)
[02:13:00.395] Build status: STARTED
[02:13:00.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:37:0) after 4m7s
[02:17:07.504] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:37:0)
[02:17:07.525] Build status: STARTED
[02:17:07.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:38:0) after 6m59s
[02:24:07.188] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:38:0)
[02:24:07.265] Build status: STARTED
[02:24:07.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:39:0) after 1m42s
[02:25:49.281] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:39:0)
[02:25:49.301] Build status: STARTED
[02:25:49.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:40:0) after 7m25s
[02:33:14.391] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:40:0)
[02:33:14.422] Build status: STARTED
[02:33:14.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:41:0) after 6m58s
[02:40:12.394] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:41:0)
[02:40:12.429] Build status: STARTED
[02:40:12.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:42:0) after 6m58s
[02:47:10.537] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:42:0)
[02:47:10.558] Build status: STARTED
[02:47:10.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:43:0) after 7m1s
[02:54:11.572] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:43:0)
[02:54:11.589] Build status: STARTED
[02:54:11.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:44:0) after 2m45s
[02:56:56.608] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:44:0)
[02:56:56.663] Build status: STARTED
[02:56:56.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:45:0) after 8m33s
[03:05:29.683] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:45:0)
[03:05:29.704] Build status: STARTED
[03:05:29.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:46:0) after 5m35s
[03:11:04.746] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:46:0)
[03:11:04.800] Build status: STARTED
[03:11:04.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:47:0) after 2m19s
[03:13:23.780] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:47:0)
[03:13:23.798] Build status: STARTED
[03:13:23.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:48:0) after 9m18s
[03:22:41.860] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:48:0)
[03:22:41.879] Build status: STARTED
[03:22:41.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:49:0) after 4m54s
[03:27:35.899] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:49:0)
[03:27:35.999] Build status: STARTED
[03:27:35.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:50:0) after 6m4s
[03:33:40.135] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:50:0)
[03:33:40.161] Build status: STARTED
[03:33:40.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:51:0) after 7m19s
[03:40:59.179] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:51:0)
[03:40:59.268] Build status: STARTED
[03:40:59.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:52:0) after 8m49s
[03:49:48.289] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:52:0)
[03:49:48.307] Build status: STARTED
[03:49:48.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:53:0) after 2m38s
[03:52:26.362] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:53:0)
[03:52:26.381] Build status: STARTED
[03:52:26.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:54:0) after 6m50s
[03:59:16.399] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:54:0)
[03:59:16.427] Build status: STARTED
[03:59:16.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:55:0) after 3m25s
[04:02:41.453] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:55:0)
[04:02:41.650] Build status: STARTED
[04:02:41.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8926851105883074208:56:0) after 7m9s
[04:04:04.942] Received PubSub notification, asking Buildbucket for the build status
[04:04:04.963] Build:
{
"id": "8761421043989936273",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 29801,
"createdBy": "project:chromium",
"createTime": "2023-12-17T23:13:17.333202176Z",
"startTime": "2023-12-17T23:13:41.755441847Z",
"endTime": "2023-12-18T04:04:03.880324Z",
"updateTime": "2023-12-18T04:04:03.880324Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "591e2ea83fac1140e5540f0ed032f7aefe633573",
"ref": "refs/heads/main"
}
}
}
[04:04:04.963] Invocation finished in 4h50m48.818716897s with status FAILED