[01:31:25.063] New invocation is queued and will start shortly
[01:31:27.018] Starting the invocation (attempt 1)
[01:31:27.071] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/363b5c71b5a1b1db3879d5f70094b06890535d51"
[01:31:27.071] Popped gitiles commit info from properties and tags
[01:31:27.071] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:31:27.071] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:31:27.071] Buildbucket request:
{
"requestId": "8990803872616885152",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "363b5c71b5a1b1db3879d5f70094b06890535d51",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8990803872616885152"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:31:27.664] Scheduled build:
{
"id": "8825373809770132129",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26417,
"createdBy": "project:chromium",
"createTime": "2022-01-11T01:31:27.145950666Z",
"updateTime": "2022-01-11T01:31:27.145950666Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "363b5c71b5a1b1db3879d5f70094b06890535d51",
"ref": "refs/heads/main"
}
}
}
[01:31:27.664] Task URL: https://cr-buildbucket.appspot.com/build/8825373809770132129
[01:31:27.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:2:0) after 5m9s
[01:36:36.779] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:2:0)
[01:36:36.865] Build status: SCHEDULED
[01:36:36.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:3:0) after 4m54s
[01:41:31.020] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:3:0)
[01:41:31.040] Build status: SCHEDULED
[01:41:31.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:4:0) after 9m34s
[01:50:19.602] Received PubSub notification, asking Buildbucket for the build status
[01:50:19.695] Build status: STARTED
[01:51:05.072] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:4:0)
[01:51:05.147] Build status: STARTED
[01:51:05.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:6:0) after 1m37s
[01:52:42.182] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:6:0)
[01:52:42.237] Build status: STARTED
[01:52:42.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:7:0) after 6m9s
[01:58:51.264] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:7:0)
[01:58:51.296] Build status: STARTED
[01:58:51.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:8:0) after 1m7s
[01:59:58.700] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:8:0)
[01:59:58.748] Build status: STARTED
[01:59:58.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:9:0) after 5m16s
[02:05:14.905] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:9:0)
[02:05:14.938] Build status: STARTED
[02:05:14.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:10:0) after 5m57s
[02:11:11.975] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:10:0)
[02:11:12.020] Build status: STARTED
[02:11:12.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:11:0) after 4m0s
[02:15:12.020] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:11:0)
[02:15:12.046] Build status: STARTED
[02:15:12.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:12:0) after 4m48s
[02:20:00.038] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:12:0)
[02:20:00.228] Build status: STARTED
[02:20:00.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:13:0) after 3m0s
[02:23:00.401] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:13:0)
[02:23:00.578] Build status: STARTED
[02:23:00.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:14:0) after 1m53s
[02:24:53.608] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:14:0)
[02:24:53.632] Build status: STARTED
[02:24:53.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:15:0) after 6m10s
[02:31:03.801] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:15:0)
[02:31:03.825] Build status: STARTED
[02:31:03.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:16:0) after 9m56s
[02:41:00.243] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:16:0)
[02:41:00.267] Build status: STARTED
[02:41:00.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:17:0) after 1m23s
[02:42:23.380] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:17:0)
[02:42:23.416] Build status: STARTED
[02:42:23.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:18:0) after 8m40s
[02:51:03.432] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:18:0)
[02:51:03.563] Build status: STARTED
[02:51:03.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:19:0) after 5m33s
[02:56:36.915] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:19:0)
[02:56:36.946] Build status: STARTED
[02:56:36.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:20:0) after 3m14s
[02:59:50.975] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:20:0)
[02:59:51.013] Build status: STARTED
[02:59:51.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:21:0) after 5m34s
[03:05:25.103] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:21:0)
[03:05:25.126] Build status: STARTED
[03:05:25.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:22:0) after 2m46s
[03:08:11.519] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:22:0)
[03:08:11.552] Build status: STARTED
[03:08:11.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:23:0) after 5m18s
[03:13:29.547] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:23:0)
[03:13:29.595] Build status: STARTED
[03:13:29.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:24:0) after 4m6s
[03:17:35.964] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:24:0)
[03:17:35.986] Build status: STARTED
[03:17:35.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:25:0) after 4m14s
[03:21:50.091] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:25:0)
[03:21:50.113] Build status: STARTED
[03:21:50.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:26:0) after 1m1s
[03:22:51.421] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:26:0)
[03:22:51.466] Build status: STARTED
[03:22:51.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:27:0) after 4m53s
[03:27:44.492] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:27:0)
[03:27:44.529] Build status: STARTED
[03:27:44.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:28:0) after 2m47s
[03:30:31.687] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:28:0)
[03:30:31.713] Build status: STARTED
[03:30:31.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:29:0) after 8m46s
[03:39:17.792] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:29:0)
[03:39:17.813] Build status: STARTED
[03:39:17.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:30:0) after 2m40s
[03:41:57.838] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:30:0)
[03:41:57.868] Build status: STARTED
[03:41:57.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:31:0) after 1m38s
[03:43:35.900] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:31:0)
[03:43:35.947] Build status: STARTED
[03:43:35.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:32:0) after 3m13s
[03:46:49.332] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:32:0)
[03:46:49.367] Build status: STARTED
[03:46:49.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:33:0) after 3m57s
[03:50:46.569] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:33:0)
[03:50:46.590] Build status: STARTED
[03:50:46.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:34:0) after 2m26s
[03:53:12.670] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:34:0)
[03:53:12.723] Build status: STARTED
[03:53:12.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:35:0) after 5m6s
[03:58:18.854] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:35:0)
[03:58:18.875] Build status: STARTED
[03:58:18.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:36:0) after 2m3s
[04:00:21.954] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:36:0)
[04:00:22.016] Build status: STARTED
[04:00:22.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:37:0) after 9m21s
[04:09:43.077] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:37:0)
[04:09:43.101] Build status: STARTED
[04:09:43.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:38:0) after 9m22s
[04:19:05.455] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:38:0)
[04:19:05.657] Build status: STARTED
[04:19:05.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:39:0) after 6m24s
[04:25:29.839] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:39:0)
[04:25:29.873] Build status: STARTED
[04:25:29.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:40:0) after 5m28s
[04:30:58.041] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:40:0)
[04:30:58.073] Build status: STARTED
[04:30:58.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:41:0) after 9m14s
[04:40:12.157] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:41:0)
[04:40:12.182] Build status: STARTED
[04:40:12.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:42:0) after 3m4s
[04:43:16.503] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:42:0)
[04:43:16.540] Build status: STARTED
[04:43:16.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:43:0) after 4m19s
[04:47:35.567] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:43:0)
[04:47:35.597] Build status: STARTED
[04:47:35.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:44:0) after 2m43s
[04:50:18.627] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:44:0)
[04:50:18.647] Build status: STARTED
[04:50:18.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:45:0) after 6m8s
[04:56:26.955] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:45:0)
[04:56:26.973] Build status: STARTED
[04:56:26.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:46:0) after 7m3s
[05:03:30.000] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:46:0)
[05:03:30.027] Build status: STARTED
[05:03:30.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:47:0) after 8m58s
[05:12:28.116] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:47:0)
[05:12:28.143] Build status: STARTED
[05:12:28.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:48:0) after 9m52s
[05:22:20.426] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:48:0)
[05:22:20.446] Build status: STARTED
[05:22:20.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:49:0) after 3m32s
[05:25:52.573] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:49:0)
[05:25:52.593] Build status: STARTED
[05:25:52.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:50:0) after 5m27s
[05:31:19.634] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:50:0)
[05:31:19.654] Build status: STARTED
[05:31:19.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:51:0) after 3m33s
[05:34:52.700] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:51:0)
[05:34:52.723] Build status: STARTED
[05:34:52.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:52:0) after 4m0s
[05:38:52.864] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:52:0)
[05:38:52.881] Build status: STARTED
[05:38:52.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:53:0) after 9m25s
[05:48:17.908] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:53:0)
[05:48:17.950] Build status: STARTED
[05:48:17.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:54:0) after 9m42s
[05:57:59.980] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:54:0)
[05:58:00.002] Build status: STARTED
[05:58:00.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:55:0) after 4m29s
[06:02:29.032] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:55:0)
[06:02:29.070] Build status: STARTED
[06:02:29.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:56:0) after 7m31s
[06:10:00.265] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:56:0)
[06:10:00.286] Build status: STARTED
[06:10:00.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:57:0) after 4m15s
[06:14:15.586] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:57:0)
[06:14:15.616] Build status: STARTED
[06:14:15.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:58:0) after 2m18s
[06:16:33.675] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:58:0)
[06:16:33.698] Build status: STARTED
[06:16:33.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:59:0) after 3m43s
[06:20:17.251] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:59:0)
[06:20:17.273] Build status: STARTED
[06:20:17.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:60:0) after 6m14s
[06:26:31.412] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:60:0)
[06:26:31.432] Build status: STARTED
[06:26:31.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:61:0) after 2m58s
[06:29:29.767] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:61:0)
[06:29:29.799] Build status: STARTED
[06:29:29.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:62:0) after 1m57s
[06:31:26.827] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:62:0)
[06:31:26.852] Build status: STARTED
[06:31:26.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:63:0) after 6m16s
[06:37:42.837] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:63:0)
[06:37:42.888] Build status: STARTED
[06:37:42.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:64:0) after 1m2s
[06:38:45.131] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:64:0)
[06:38:45.179] Build status: STARTED
[06:38:45.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:65:0) after 5m50s
[06:44:35.241] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:65:0)
[06:44:35.280] Build status: STARTED
[06:44:35.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:66:0) after 7m10s
[06:51:45.406] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:66:0)
[06:51:45.466] Build status: STARTED
[06:51:45.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:67:0) after 4m46s
[06:56:31.616] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:67:0)
[06:56:31.647] Build status: STARTED
[06:56:31.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:68:0) after 2m6s
[06:58:37.713] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:68:0)
[06:58:37.746] Build status: STARTED
[06:58:37.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:69:0) after 7m13s
[07:05:50.852] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:69:0)
[07:05:50.874] Build status: STARTED
[07:05:50.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:70:0) after 8m31s
[07:14:22.032] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:70:0)
[07:14:22.136] Build status: STARTED
[07:14:22.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:71:0) after 9m4s
[07:23:26.553] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:71:0)
[07:23:26.583] Build status: STARTED
[07:23:26.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:72:0) after 4m8s
[07:27:34.695] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:72:0)
[07:27:34.727] Build status: STARTED
[07:27:34.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:73:0) after 9m46s
[07:37:20.755] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:73:0)
[07:37:20.777] Build status: STARTED
[07:37:20.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:74:0) after 2m2s
[07:39:22.803] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:74:0)
[07:39:22.848] Build status: STARTED
[07:39:22.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:75:0) after 9m48s
[07:49:10.881] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:75:0)
[07:49:10.947] Build status: STARTED
[07:49:10.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:76:0) after 3m43s
[07:52:53.984] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:76:0)
[07:52:54.004] Build status: STARTED
[07:52:54.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:77:0) after 9m4s
[08:01:58.040] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:77:0)
[08:01:58.075] Build status: STARTED
[08:01:58.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:78:0) after 1m13s
[08:03:11.252] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:78:0)
[08:03:11.284] Build status: STARTED
[08:03:11.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:79:0) after 6m8s
[08:09:19.370] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:79:0)
[08:09:19.399] Build status: STARTED
[08:09:19.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:80:0) after 3m33s
[08:12:52.425] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:80:0)
[08:12:52.444] Build status: STARTED
[08:12:52.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:81:0) after 4m57s
[08:17:49.765] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:81:0)
[08:17:49.784] Build status: STARTED
[08:17:49.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:82:0) after 8m45s
[08:26:35.025] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:82:0)
[08:26:35.054] Build status: STARTED
[08:26:35.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:83:0) after 9m40s
[08:36:15.466] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:83:0)
[08:36:15.635] Build status: STARTED
[08:36:15.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:84:0) after 7m28s
[08:43:43.663] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:84:0)
[08:43:43.681] Build status: STARTED
[08:43:43.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:85:0) after 4m9s
[08:47:52.683] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:85:0)
[08:47:52.702] Build status: STARTED
[08:47:52.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:86:0) after 7m28s
[08:55:20.815] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:86:0)
[08:55:20.846] Build status: STARTED
[08:55:20.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:87:0) after 6m5s
[09:01:26.041] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:87:0)
[09:01:26.069] Build status: STARTED
[09:01:26.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:88:0) after 3m12s
[09:04:38.132] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:88:0)
[09:04:38.168] Build status: STARTED
[09:04:38.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:89:0) after 7m36s
[09:12:14.201] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:89:0)
[09:12:14.236] Build status: STARTED
[09:12:14.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:90:0) after 5m0s
[09:17:14.265] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:90:0)
[09:17:14.301] Build status: STARTED
[09:17:14.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:91:0) after 2m17s
[09:19:31.351] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:91:0)
[09:19:31.381] Build status: STARTED
[09:19:31.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:92:0) after 5m11s
[09:24:42.410] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:92:0)
[09:24:42.429] Build status: STARTED
[09:24:42.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:93:0) after 1m46s
[09:26:28.456] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:93:0)
[09:26:28.494] Build status: STARTED
[09:26:28.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:94:0) after 2m22s
[09:28:50.530] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:94:0)
[09:28:50.587] Build status: STARTED
[09:28:50.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:95:0) after 6m31s
[09:35:21.618] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:95:0)
[09:35:21.638] Build status: STARTED
[09:35:21.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:96:0) after 6m7s
[09:41:28.687] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:96:0)
[09:41:28.707] Build status: STARTED
[09:41:28.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:97:0) after 3m32s
[09:45:00.761] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:97:0)
[09:45:00.795] Build status: STARTED
[09:45:00.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:98:0) after 4m21s
[09:49:21.828] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:98:0)
[09:49:21.845] Build status: STARTED
[09:49:21.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:99:0) after 9m33s
[09:58:54.900] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:99:0)
[09:58:54.949] Build status: STARTED
[09:58:54.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:100:0) after 3m35s
[10:02:29.994] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:100:0)
[10:02:30.019] Build status: STARTED
[10:02:30.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:101:0) after 9m38s
[10:12:08.092] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:101:0)
[10:12:08.129] Build status: STARTED
[10:12:08.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:102:0) after 2m6s
[10:14:14.160] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:102:0)
[10:14:14.185] Build status: STARTED
[10:14:14.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:103:0) after 9m33s
[10:23:47.275] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:103:0)
[10:23:47.347] Build status: STARTED
[10:23:47.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:104:0) after 2m56s
[10:26:43.487] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:104:0)
[10:26:43.571] Build status: STARTED
[10:26:43.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:105:0) after 6m3s
[10:32:46.692] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:105:0)
[10:32:46.712] Build status: STARTED
[10:32:46.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:106:0) after 3m10s
[10:35:56.855] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:106:0)
[10:35:56.886] Build status: STARTED
[10:35:56.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:107:0) after 5m27s
[10:41:23.918] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:107:0)
[10:41:23.954] Build status: STARTED
[10:41:23.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:108:0) after 1m56s
[10:43:20.261] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:108:0)
[10:43:20.296] Build status: STARTED
[10:43:20.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:109:0) after 4m47s
[10:48:07.325] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:109:0)
[10:48:07.369] Build status: STARTED
[10:48:07.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:110:0) after 2m16s
[10:50:23.402] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:110:0)
[10:50:23.668] Build status: STARTED
[10:50:23.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:111:0) after 8m12s
[10:58:35.700] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:111:0)
[10:58:35.771] Build status: STARTED
[10:58:35.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:112:0) after 2m45s
[11:01:20.802] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:112:0)
[11:01:20.844] Build status: STARTED
[11:01:20.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:113:0) after 7m5s
[11:08:25.900] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:113:0)
[11:08:25.957] Build status: STARTED
[11:08:25.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:114:0) after 1m1s
[11:09:26.992] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:114:0)
[11:09:27.013] Build status: STARTED
[11:09:27.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:115:0) after 8m54s
[11:18:21.152] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:115:0)
[11:18:21.183] Build status: STARTED
[11:18:21.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:116:0) after 5m30s
[11:23:51.686] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:116:0)
[11:23:51.766] Build status: STARTED
[11:23:51.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:117:0) after 8m13s
[11:32:04.814] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:117:0)
[11:32:04.891] Build status: STARTED
[11:32:04.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:118:0) after 2m25s
[11:34:29.921] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:118:0)
[11:34:29.962] Build status: STARTED
[11:34:29.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:119:0) after 8m17s
[11:42:46.992] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:119:0)
[11:42:47.035] Build status: STARTED
[11:42:47.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:120:0) after 1m31s
[11:44:18.206] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:120:0)
[11:44:18.227] Build status: STARTED
[11:44:18.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:121:0) after 9m9s
[11:53:27.311] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:121:0)
[11:53:27.330] Build status: STARTED
[11:53:27.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:122:0) after 6m0s
[11:59:27.793] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:122:0)
[11:59:27.845] Build status: STARTED
[11:59:27.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:123:0) after 5m4s
[12:04:31.890] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:123:0)
[12:04:31.929] Build status: STARTED
[12:04:31.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:124:0) after 8m31s
[12:13:02.960] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:124:0)
[12:13:02.983] Build status: STARTED
[12:13:02.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:125:0) after 6m22s
[12:19:25.129] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:125:0)
[12:19:25.200] Build status: STARTED
[12:19:25.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:126:0) after 6m40s
[12:26:05.329] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:126:0)
[12:26:05.350] Build status: STARTED
[12:26:05.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:127:0) after 7m25s
[12:33:30.387] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:127:0)
[12:33:30.421] Build status: STARTED
[12:33:30.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:128:0) after 8m13s
[12:41:43.490] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:128:0)
[12:41:43.558] Build status: STARTED
[12:41:43.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:129:0) after 3m43s
[12:45:26.590] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:129:0)
[12:45:26.613] Build status: STARTED
[12:45:26.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8990803872616885152:130:0) after 8m54s
[12:50:19.658] Received PubSub notification, asking Buildbucket for the build status
[12:50:19.691] Build:
{
"id": "8825373809770132129",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 26417,
"createdBy": "project:chromium",
"createTime": "2022-01-11T01:31:27.145950666Z",
"startTime": "2022-01-11T01:50:18.972002Z",
"endTime": "2022-01-11T12:50:18.386115885Z",
"updateTime": "2022-01-11T12:50:18.386115885Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "363b5c71b5a1b1db3879d5f70094b06890535d51",
"ref": "refs/heads/main"
}
}
}
[12:50:19.691] Invocation finished in 11h18m54.644665887s with status FAILED