[03:03:42.320] New invocation is queued and will start shortly
[03:03:43.520] Starting the invocation (attempt 1)
[03:03:43.554] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a9ddaafdec9ab8ca2ee0598b77114948a8c1dd5d"
[03:03:43.554] Popped gitiles commit info from properties and tags
[03:03:43.554] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:03:43.554] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:03:43.554] Buildbucket request:
{
"requestId": "8998227017625321648",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a9ddaafdec9ab8ca2ee0598b77114948a8c1dd5d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8998227017625321648"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:03:44.245] Scheduled build:
{
"id": "8832796955601806961",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 25724,
"createdBy": "project:chromium",
"createTime": "2021-10-21T03:03:43.619310498Z",
"updateTime": "2021-10-21T03:03:44.056682536Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a9ddaafdec9ab8ca2ee0598b77114948a8c1dd5d",
"ref": "refs/heads/main"
}
}
}
[03:03:44.245] Task URL: https://cr-buildbucket.appspot.com/build/8832796955601806961
[03:03:44.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:2:0) after 2m18s
[03:06:02.373] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:2:0)
[03:06:02.409] Build status: SCHEDULED
[03:06:02.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:3:0) after 4m48s
[03:10:50.437] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:3:0)
[03:10:50.485] Build status: SCHEDULED
[03:10:50.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:4:0) after 7m47s
[03:15:04.931] Received PubSub notification, asking Buildbucket for the build status
[03:15:05.068] Build status: STARTED
[03:18:37.528] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:4:0)
[03:18:37.564] Build status: STARTED
[03:18:37.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:6:0) after 8m27s
[03:27:04.547] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:6:0)
[03:27:04.580] Build status: STARTED
[03:27:04.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:7:0) after 1m55s
[03:28:59.614] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:7:0)
[03:28:59.650] Build status: STARTED
[03:28:59.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:8:0) after 5m39s
[03:34:38.693] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:8:0)
[03:34:38.737] Build status: STARTED
[03:34:38.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:9:0) after 5m42s
[03:40:20.794] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:9:0)
[03:40:20.826] Build status: STARTED
[03:40:20.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:10:0) after 4m9s
[03:44:29.850] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:10:0)
[03:44:29.879] Build status: STARTED
[03:44:29.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:11:0) after 8m36s
[03:53:05.971] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:11:0)
[03:53:06.008] Build status: STARTED
[03:53:06.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:12:0) after 9m54s
[04:03:00.079] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:12:0)
[04:03:00.118] Build status: STARTED
[04:03:00.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:13:0) after 1m55s
[04:04:55.147] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:13:0)
[04:04:55.180] Build status: STARTED
[04:04:55.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:14:0) after 5m45s
[04:10:40.253] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:14:0)
[04:10:40.287] Build status: STARTED
[04:10:40.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:15:0) after 7m45s
[04:18:25.367] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:15:0)
[04:18:25.396] Build status: STARTED
[04:18:25.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:16:0) after 7m17s
[04:25:42.528] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:16:0)
[04:25:42.559] Build status: STARTED
[04:25:42.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:17:0) after 6m12s
[04:31:54.685] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:17:0)
[04:31:54.729] Build status: STARTED
[04:31:54.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:18:0) after 1m54s
[04:33:48.751] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:18:0)
[04:33:48.779] Build status: STARTED
[04:33:48.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:19:0) after 6m53s
[04:40:41.872] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:19:0)
[04:40:41.900] Build status: STARTED
[04:40:41.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:20:0) after 4m34s
[04:45:15.888] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:20:0)
[04:45:15.919] Build status: STARTED
[04:45:15.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:21:0) after 2m57s
[04:48:12.956] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:21:0)
[04:48:12.986] Build status: STARTED
[04:48:12.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:22:0) after 4m40s
[04:52:53.012] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:22:0)
[04:52:53.096] Build status: STARTED
[04:52:53.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:23:0) after 3m25s
[04:56:18.284] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:23:0)
[04:56:18.317] Build status: STARTED
[04:56:18.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:24:0) after 6m17s
[05:02:35.369] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:24:0)
[05:02:35.404] Build status: STARTED
[05:02:35.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:25:0) after 5m21s
[05:07:56.541] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:25:0)
[05:07:56.573] Build status: STARTED
[05:07:56.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:26:0) after 1m1s
[05:08:57.672] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:26:0)
[05:08:57.706] Build status: STARTED
[05:08:57.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:27:0) after 9m24s
[05:18:21.737] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:27:0)
[05:18:21.984] Build status: STARTED
[05:18:21.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:28:0) after 7m19s
[05:25:41.023] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:28:0)
[05:25:41.052] Build status: STARTED
[05:25:41.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:29:0) after 7m9s
[05:32:50.247] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:29:0)
[05:32:50.275] Build status: STARTED
[05:32:50.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:30:0) after 7m56s
[05:40:46.303] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:30:0)
[05:40:46.333] Build status: STARTED
[05:40:46.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:31:0) after 5m14s
[05:46:00.688] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:31:0)
[05:46:00.718] Build status: STARTED
[05:46:00.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:32:0) after 6m5s
[05:52:05.743] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:32:0)
[05:52:05.772] Build status: STARTED
[05:52:05.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:33:0) after 9m50s
[06:01:55.804] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:33:0)
[06:01:55.835] Build status: STARTED
[06:01:55.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:34:0) after 8m58s
[06:10:54.106] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:34:0)
[06:10:54.135] Build status: STARTED
[06:10:54.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:35:0) after 5m26s
[06:16:20.279] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:35:0)
[06:16:20.307] Build status: STARTED
[06:16:20.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:36:0) after 9m29s
[06:25:49.527] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:36:0)
[06:25:49.573] Build status: STARTED
[06:25:49.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:37:0) after 3m24s
[06:29:13.599] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:37:0)
[06:29:13.632] Build status: STARTED
[06:29:13.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:38:0) after 3m3s
[06:32:16.667] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:38:0)
[06:32:16.699] Build status: STARTED
[06:32:16.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:39:0) after 5m4s
[06:37:20.807] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:39:0)
[06:37:20.859] Build status: STARTED
[06:37:20.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:40:0) after 5m41s
[06:43:02.016] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:40:0)
[06:43:02.078] Build status: STARTED
[06:43:02.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:41:0) after 8m21s
[06:51:23.292] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:41:0)
[06:51:23.431] Build status: STARTED
[06:51:23.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:42:0) after 8m47s
[07:00:10.634] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:42:0)
[07:00:10.666] Build status: STARTED
[07:00:10.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:43:0) after 5m54s
[07:06:04.694] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:43:0)
[07:06:04.856] Build status: STARTED
[07:06:04.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:44:0) after 2m9s
[07:08:14.014] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:44:0)
[07:08:14.052] Build status: STARTED
[07:08:14.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:45:0) after 2m23s
[07:10:37.083] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:45:0)
[07:10:37.214] Build status: STARTED
[07:10:37.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:46:0) after 4m34s
[07:15:11.285] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:46:0)
[07:15:11.317] Build status: STARTED
[07:15:11.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:47:0) after 7m35s
[07:22:46.470] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:47:0)
[07:22:46.508] Build status: STARTED
[07:22:46.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:48:0) after 2m5s
[07:24:51.534] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:48:0)
[07:24:51.562] Build status: STARTED
[07:24:51.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:49:0) after 4m3s
[07:28:54.594] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:49:0)
[07:28:54.625] Build status: STARTED
[07:28:54.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:50:0) after 7m37s
[07:36:31.691] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:50:0)
[07:36:31.736] Build status: STARTED
[07:36:31.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:51:0) after 1m37s
[07:38:09.197] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:51:0)
[07:38:09.368] Build status: STARTED
[07:38:09.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:52:0) after 9m52s
[07:48:01.463] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:52:0)
[07:48:01.501] Build status: STARTED
[07:48:01.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:53:0) after 4m7s
[07:52:08.569] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:53:0)
[07:52:08.750] Build status: STARTED
[07:52:08.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:54:0) after 7m40s
[07:59:48.781] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:54:0)
[07:59:48.813] Build status: STARTED
[07:59:48.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:55:0) after 4m21s
[08:04:10.049] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:55:0)
[08:04:10.080] Build status: STARTED
[08:04:10.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:56:0) after 3m42s
[08:07:52.382] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:56:0)
[08:07:52.414] Build status: STARTED
[08:07:52.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:57:0) after 4m43s
[08:12:35.441] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:57:0)
[08:12:35.489] Build status: STARTED
[08:12:35.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:58:0) after 1m23s
[08:13:58.813] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:58:0)
[08:13:58.966] Build status: STARTED
[08:13:58.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:59:0) after 6m53s
[08:20:52.203] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:59:0)
[08:20:52.356] Build status: STARTED
[08:20:52.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:60:0) after 2m26s
[08:23:18.394] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:60:0)
[08:23:18.429] Build status: STARTED
[08:23:18.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:61:0) after 7m31s
[08:30:49.468] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:61:0)
[08:30:49.506] Build status: STARTED
[08:30:49.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:62:0) after 8m10s
[08:38:59.790] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:62:0)
[08:38:59.829] Build status: STARTED
[08:38:59.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:63:0) after 5m32s
[08:44:31.874] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:63:0)
[08:44:31.907] Build status: STARTED
[08:44:31.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:64:0) after 9m40s
[08:54:12.142] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:64:0)
[08:54:12.222] Build status: STARTED
[08:54:12.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:65:0) after 5m10s
[08:59:22.348] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:65:0)
[08:59:22.379] Build status: STARTED
[08:59:22.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:66:0) after 9m18s
[09:08:40.425] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:66:0)
[09:08:40.452] Build status: STARTED
[09:08:40.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:67:0) after 3m48s
[09:12:28.485] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:67:0)
[09:12:28.549] Build status: STARTED
[09:12:28.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:68:0) after 1m23s
[09:13:51.756] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:68:0)
[09:13:51.800] Build status: STARTED
[09:13:51.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:69:0) after 3m39s
[09:17:30.805] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:69:0)
[09:17:30.846] Build status: STARTED
[09:17:30.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:70:0) after 2m7s
[09:19:38.030] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:70:0)
[09:19:38.075] Build status: STARTED
[09:19:38.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:71:0) after 5m32s
[09:25:10.910] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:71:0)
[09:25:10.957] Build status: STARTED
[09:25:10.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:72:0) after 5m27s
[09:30:38.712] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:72:0)
[09:30:38.796] Build status: STARTED
[09:30:38.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:73:0) after 3m58s
[09:34:36.828] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:73:0)
[09:34:36.862] Build status: STARTED
[09:34:36.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:74:0) after 7m7s
[09:41:44.009] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:74:0)
[09:41:44.098] Build status: STARTED
[09:41:44.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:75:0) after 6m48s
[09:48:32.242] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:75:0)
[09:48:32.276] Build status: STARTED
[09:48:32.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:76:0) after 6m42s
[09:55:14.303] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:76:0)
[09:55:14.335] Build status: STARTED
[09:55:14.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:77:0) after 5m27s
[10:00:41.364] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:77:0)
[10:00:41.399] Build status: STARTED
[10:00:41.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:78:0) after 8m40s
[10:09:21.427] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:78:0)
[10:09:21.674] Build status: STARTED
[10:09:21.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:79:0) after 7m10s
[10:16:32.354] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:79:0)
[10:16:32.390] Build status: STARTED
[10:16:32.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:80:0) after 4m44s
[10:21:16.619] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:80:0)
[10:21:16.706] Build status: STARTED
[10:21:16.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:81:0) after 3m53s
[10:25:09.936] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:81:0)
[10:25:09.995] Build status: STARTED
[10:25:09.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:82:0) after 7m39s
[10:32:49.058] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:82:0)
[10:32:49.091] Build status: STARTED
[10:32:49.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:83:0) after 1m46s
[10:34:35.270] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:83:0)
[10:34:35.308] Build status: STARTED
[10:34:35.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:84:0) after 7m28s
[10:42:03.332] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:84:0)
[10:42:03.398] Build status: STARTED
[10:42:03.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:85:0) after 6m26s
[10:48:29.536] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:85:0)
[10:48:29.611] Build status: STARTED
[10:48:29.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:86:0) after 2m28s
[10:50:57.960] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:86:0)
[10:50:58.157] Build status: STARTED
[10:50:58.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:87:0) after 5m8s
[10:56:06.243] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:87:0)
[10:56:06.273] Build status: STARTED
[10:56:06.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:88:0) after 5m12s
[11:01:18.305] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:88:0)
[11:01:18.333] Build status: STARTED
[11:01:18.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:89:0) after 2m9s
[11:03:27.471] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:89:0)
[11:03:27.507] Build status: STARTED
[11:03:27.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:90:0) after 6m11s
[11:09:38.544] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:90:0)
[11:09:38.635] Build status: STARTED
[11:09:38.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:91:0) after 4m39s
[11:14:17.774] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:91:0)
[11:14:17.814] Build status: STARTED
[11:14:17.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:92:0) after 9m31s
[11:23:49.017] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:92:0)
[11:23:49.047] Build status: STARTED
[11:23:49.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:93:0) after 7m33s
[11:31:22.177] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:93:0)
[11:31:22.208] Build status: STARTED
[11:31:22.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:94:0) after 7m55s
[11:39:17.240] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:94:0)
[11:39:17.275] Build status: STARTED
[11:39:17.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:95:0) after 2m32s
[11:41:49.425] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:95:0)
[11:41:49.464] Build status: STARTED
[11:41:49.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:96:0) after 1m13s
[11:43:02.707] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:96:0)
[11:43:02.743] Build status: STARTED
[11:43:02.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:97:0) after 4m32s
[11:47:34.807] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:97:0)
[11:47:34.839] Build status: STARTED
[11:47:34.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:98:0) after 2m54s
[11:50:28.872] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:98:0)
[11:50:28.908] Build status: STARTED
[11:50:28.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:99:0) after 7m32s
[11:58:00.987] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:99:0)
[11:58:01.016] Build status: STARTED
[11:58:01.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:100:0) after 7m36s
[12:05:37.122] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:100:0)
[12:05:37.242] Build status: STARTED
[12:05:37.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:101:0) after 8m7s
[12:13:44.591] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:101:0)
[12:13:44.628] Build status: STARTED
[12:13:44.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:102:0) after 2m18s
[12:16:02.757] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:102:0)
[12:16:02.793] Build status: STARTED
[12:16:02.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:103:0) after 3m13s
[12:19:15.886] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:103:0)
[12:19:15.989] Build status: STARTED
[12:19:15.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:104:0) after 9m2s
[12:28:18.271] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:104:0)
[12:28:18.307] Build status: STARTED
[12:28:18.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:105:0) after 2m39s
[12:30:57.440] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:105:0)
[12:30:57.474] Build status: STARTED
[12:30:57.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:106:0) after 4m0s
[12:34:57.523] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:106:0)
[12:34:57.556] Build status: STARTED
[12:34:57.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:107:0) after 4m42s
[12:39:39.585] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:107:0)
[12:39:39.735] Build status: STARTED
[12:39:39.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:108:0) after 6m56s
[12:46:35.785] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:108:0)
[12:46:35.820] Build status: STARTED
[12:46:35.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:109:0) after 1m23s
[12:47:59.049] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:109:0)
[12:47:59.085] Build status: STARTED
[12:47:59.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:110:0) after 7m28s
[12:55:27.119] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:110:0)
[12:55:27.152] Build status: STARTED
[12:55:27.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:111:0) after 5m12s
[13:00:39.287] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:111:0)
[13:00:39.321] Build status: STARTED
[13:00:39.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:112:0) after 2m47s
[13:03:26.493] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:112:0)
[13:03:26.527] Build status: STARTED
[13:03:26.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:113:0) after 4m5s
[13:07:31.935] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:113:0)
[13:07:31.965] Build status: STARTED
[13:07:31.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:114:0) after 3m52s
[13:11:24.100] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:114:0)
[13:11:24.171] Build status: STARTED
[13:11:24.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:115:0) after 1m24s
[13:12:48.338] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:115:0)
[13:12:48.391] Build status: STARTED
[13:12:48.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:116:0) after 1m27s
[13:14:15.461] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:116:0)
[13:14:15.567] Build status: STARTED
[13:14:15.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:117:0) after 3m51s
[13:18:06.733] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:117:0)
[13:18:06.855] Build status: STARTED
[13:18:06.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8998227017625321648:118:0) after 7m17s
[13:23:14.414] Received PubSub notification, asking Buildbucket for the build status
[13:23:14.471] Build:
{
"id": "8832796955601806961",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 25724,
"createdBy": "project:chromium",
"createTime": "2021-10-21T03:03:43.619310498Z",
"startTime": "2021-10-21T03:15:03.620195Z",
"endTime": "2021-10-21T13:23:13.750855745Z",
"updateTime": "2021-10-21T13:23:13.751205731Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a9ddaafdec9ab8ca2ee0598b77114948a8c1dd5d",
"ref": "refs/heads/main"
}
}
}
[13:23:14.471] Invocation finished in 10h19m32.16588146s with status FAILED