[13:49:16.984] New invocation is queued and will start shortly
[13:49:18.182] Starting the invocation (attempt 1)
[13:49:18.215] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2a7fbc53fdef4617d9878d9556fdb9a1e4052ccf"
[13:49:18.215] Popped gitiles commit info from properties and tags
[13:49:18.215] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:49:18.215] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:49:18.215] Buildbucket request:
{
"requestId": "8958686124036133760",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2a7fbc53fdef4617d9878d9556fdb9a1e4052ccf",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8958686124036133760"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:49:18.627] Scheduled build:
{
"id": "8793256062004752193",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 28580,
"createdBy": "project:chromium",
"createTime": "2022-12-31T13:49:18.290078551Z",
"updateTime": "2022-12-31T13:49:18.290078551Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2a7fbc53fdef4617d9878d9556fdb9a1e4052ccf",
"ref": "refs/heads/main"
}
},
"canary": true
}
[13:49:18.627] Task URL: https://cr-buildbucket.appspot.com/build/8793256062004752193
[13:49:18.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:2:0) after 1m41s
[13:50:59.642] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:2:0)
[13:50:59.674] Build status: SCHEDULED
[13:50:59.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:3:0) after 8m12s
[13:58:52.918] Received PubSub notification, asking Buildbucket for the build status
[13:58:53.011] Build status: STARTED
[13:59:11.706] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:3:0)
[13:59:11.724] Build status: STARTED
[13:59:11.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:5:0) after 8m7s
[14:07:18.915] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:5:0)
[14:07:18.942] Build status: STARTED
[14:07:18.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:6:0) after 2m57s
[14:10:15.951] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:6:0)
[14:10:15.980] Build status: STARTED
[14:10:15.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:7:0) after 5m9s
[14:15:25.256] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:7:0)
[14:15:25.298] Build status: STARTED
[14:15:25.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:8:0) after 7m37s
[14:23:02.322] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:8:0)
[14:23:02.344] Build status: STARTED
[14:23:02.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:9:0) after 8m2s
[14:31:04.369] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:9:0)
[14:31:04.392] Build status: STARTED
[14:31:04.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:10:0) after 7m28s
[14:38:32.481] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:10:0)
[14:38:32.504] Build status: STARTED
[14:38:32.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:11:0) after 2m12s
[14:40:44.525] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:11:0)
[14:40:44.545] Build status: STARTED
[14:40:44.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:12:0) after 1m35s
[14:42:19.637] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:12:0)
[14:42:19.702] Build status: STARTED
[14:42:19.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:13:0) after 3m23s
[14:45:42.736] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:13:0)
[14:45:42.765] Build status: STARTED
[14:45:42.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:14:0) after 7m43s
[14:53:25.927] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:14:0)
[14:53:25.948] Build status: STARTED
[14:53:25.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:15:0) after 7m59s
[15:01:24.971] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:15:0)
[15:01:24.999] Build status: STARTED
[15:01:24.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:16:0) after 6m40s
[15:08:05.019] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:16:0)
[15:08:05.040] Build status: STARTED
[15:08:05.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:17:0) after 9m41s
[15:17:46.149] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:17:0)
[15:17:46.187] Build status: STARTED
[15:17:46.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:18:0) after 6m2s
[15:23:48.216] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:18:0)
[15:23:48.239] Build status: STARTED
[15:23:48.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:19:0) after 4m53s
[15:28:41.373] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:19:0)
[15:28:41.395] Build status: STARTED
[15:28:41.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:20:0) after 1m34s
[15:30:15.420] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:20:0)
[15:30:15.462] Build status: STARTED
[15:30:15.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:21:0) after 2m26s
[15:32:41.509] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:21:0)
[15:32:41.540] Build status: STARTED
[15:32:41.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:22:0) after 8m16s
[15:40:57.585] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:22:0)
[15:40:57.608] Build status: STARTED
[15:40:57.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:23:0) after 7m15s
[15:48:12.628] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:23:0)
[15:48:12.647] Build status: STARTED
[15:48:12.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:24:0) after 2m50s
[15:51:02.745] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:24:0)
[15:51:02.772] Build status: STARTED
[15:51:02.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:25:0) after 8m58s
[16:00:00.902] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:25:0)
[16:00:00.955] Build status: STARTED
[16:00:00.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:26:0) after 9m27s
[16:09:28.031] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:26:0)
[16:09:28.053] Build status: STARTED
[16:09:28.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:27:0) after 1m15s
[16:10:43.073] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:27:0)
[16:10:43.138] Build status: STARTED
[16:10:43.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:28:0) after 1m24s
[16:12:07.166] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:28:0)
[16:12:07.189] Build status: STARTED
[16:12:07.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:29:0) after 2m37s
[16:14:44.283] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:29:0)
[16:14:44.304] Build status: STARTED
[16:14:44.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:30:0) after 5m7s
[16:19:51.425] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:30:0)
[16:19:51.444] Build status: STARTED
[16:19:51.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:31:0) after 3m17s
[16:23:08.471] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:31:0)
[16:23:08.494] Build status: STARTED
[16:23:08.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:32:0) after 7m49s
[16:30:57.523] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:32:0)
[16:30:57.544] Build status: STARTED
[16:30:57.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:33:0) after 3m53s
[16:34:50.566] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:33:0)
[16:34:50.600] Build status: STARTED
[16:34:50.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:34:0) after 7m42s
[16:42:32.623] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:34:0)
[16:42:32.651] Build status: STARTED
[16:42:32.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:35:0) after 6m27s
[16:48:59.668] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:35:0)
[16:48:59.692] Build status: STARTED
[16:48:59.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:36:0) after 1m20s
[16:50:19.864] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:36:0)
[16:50:19.885] Build status: STARTED
[16:50:19.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:37:0) after 9m20s
[16:59:39.995] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:37:0)
[16:59:40.027] Build status: STARTED
[16:59:40.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:38:0) after 2m46s
[17:02:26.315] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:38:0)
[17:02:26.341] Build status: STARTED
[17:02:26.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:39:0) after 8m48s
[17:11:14.346] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:39:0)
[17:11:14.374] Build status: STARTED
[17:11:14.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:40:0) after 9m36s
[17:20:50.492] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:40:0)
[17:20:50.524] Build status: STARTED
[17:20:50.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:41:0) after 3m26s
[17:24:16.809] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:41:0)
[17:24:16.828] Build status: STARTED
[17:24:16.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:42:0) after 3m51s
[17:28:07.900] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:42:0)
[17:28:07.926] Build status: STARTED
[17:28:07.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:43:0) after 5m24s
[17:33:31.999] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:43:0)
[17:33:32.018] Build status: STARTED
[17:33:32.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:44:0) after 7m5s
[17:40:37.340] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:44:0)
[17:40:37.371] Build status: STARTED
[17:40:37.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:45:0) after 5m19s
[17:45:56.391] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:45:0)
[17:45:56.414] Build status: STARTED
[17:45:56.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:46:0) after 2m25s
[17:48:21.432] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:46:0)
[17:48:21.452] Build status: STARTED
[17:48:21.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:47:0) after 5m38s
[17:53:59.654] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:47:0)
[17:53:59.679] Build status: STARTED
[17:53:59.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:48:0) after 7m33s
[18:01:32.697] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:48:0)
[18:01:32.723] Build status: STARTED
[18:01:32.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:49:0) after 6m43s
[18:08:15.900] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:49:0)
[18:08:15.920] Build status: STARTED
[18:08:15.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:50:0) after 6m56s
[18:15:11.941] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:50:0)
[18:15:11.995] Build status: STARTED
[18:15:11.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:51:0) after 6m27s
[18:21:39.013] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:51:0)
[18:21:39.066] Build status: STARTED
[18:21:39.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:52:0) after 4m53s
[18:26:32.087] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:52:0)
[18:26:32.112] Build status: STARTED
[18:26:32.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:53:0) after 2m17s
[18:28:49.132] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:53:0)
[18:28:49.151] Build status: STARTED
[18:28:49.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:54:0) after 1m1s
[18:29:50.176] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:54:0)
[18:29:50.206] Build status: STARTED
[18:29:50.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:55:0) after 1m38s
[18:31:28.226] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:55:0)
[18:31:28.263] Build status: STARTED
[18:31:28.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:56:0) after 9m40s
[18:41:09.009] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:56:0)
[18:41:09.032] Build status: STARTED
[18:41:09.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:57:0) after 2m21s
[18:43:30.055] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:57:0)
[18:43:30.077] Build status: STARTED
[18:43:30.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:58:0) after 2m9s
[18:45:39.104] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:58:0)
[18:45:39.138] Build status: STARTED
[18:45:39.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:59:0) after 6m55s
[18:52:34.696] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:59:0)
[18:52:34.718] Build status: STARTED
[18:52:34.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:60:0) after 3m30s
[18:56:04.995] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:60:0)
[18:56:05.047] Build status: STARTED
[18:56:05.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:61:0) after 7m47s
[19:03:52.129] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:61:0)
[19:03:52.152] Build status: STARTED
[19:03:52.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:62:0) after 8m23s
[19:12:15.181] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:62:0)
[19:12:15.203] Build status: STARTED
[19:12:15.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:63:0) after 3m48s
[19:16:03.348] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:63:0)
[19:16:03.412] Build status: STARTED
[19:16:03.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:64:0) after 3m13s
[19:19:16.418] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:64:0)
[19:19:16.440] Build status: STARTED
[19:19:16.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:65:0) after 6m11s
[19:25:27.497] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:65:0)
[19:25:27.523] Build status: STARTED
[19:25:27.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:66:0) after 5m29s
[19:30:56.556] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:66:0)
[19:30:56.578] Build status: STARTED
[19:30:56.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:67:0) after 9m41s
[19:40:37.639] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:67:0)
[19:40:37.659] Build status: STARTED
[19:40:37.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:68:0) after 6m5s
[19:46:42.689] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:68:0)
[19:46:42.710] Build status: STARTED
[19:46:42.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:69:0) after 3m38s
[19:50:20.731] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:69:0)
[19:50:20.757] Build status: STARTED
[19:50:20.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:70:0) after 2m51s
[19:53:12.045] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:70:0)
[19:53:12.095] Build status: STARTED
[19:53:12.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:71:0) after 8m49s
[20:02:01.352] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:71:0)
[20:02:01.374] Build status: STARTED
[20:02:01.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:72:0) after 4m44s
[20:06:45.408] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:72:0)
[20:06:45.442] Build status: STARTED
[20:06:45.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:73:0) after 1m29s
[20:08:14.465] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:73:0)
[20:08:14.489] Build status: STARTED
[20:08:14.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:74:0) after 2m35s
[20:10:49.516] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:74:0)
[20:10:49.543] Build status: STARTED
[20:10:49.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:75:0) after 2m52s
[20:13:41.668] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:75:0)
[20:13:41.696] Build status: STARTED
[20:13:41.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:76:0) after 8m59s
[20:22:40.773] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:76:0)
[20:22:40.794] Build status: STARTED
[20:22:40.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:77:0) after 8m7s
[20:30:48.224] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:77:0)
[20:30:48.244] Build status: STARTED
[20:30:48.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:78:0) after 1m3s
[20:31:51.294] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:78:0)
[20:31:51.315] Build status: STARTED
[20:31:51.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:79:0) after 3m45s
[20:35:36.343] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:79:0)
[20:35:36.361] Build status: STARTED
[20:35:36.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:80:0) after 4m0s
[20:39:36.477] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:80:0)
[20:39:36.499] Build status: STARTED
[20:39:36.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:81:0) after 9m24s
[20:49:00.640] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:81:0)
[20:49:00.662] Build status: STARTED
[20:49:00.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:82:0) after 2m55s
[20:51:55.877] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:82:0)
[20:51:55.924] Build status: STARTED
[20:51:55.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:83:0) after 1m18s
[20:53:14.150] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:83:0)
[20:53:14.171] Build status: STARTED
[20:53:14.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:84:0) after 7m29s
[21:00:43.224] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:84:0)
[21:00:43.251] Build status: STARTED
[21:00:43.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:85:0) after 4m43s
[21:05:26.287] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:85:0)
[21:05:26.316] Build status: STARTED
[21:05:26.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:86:0) after 1m42s
[21:07:08.336] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:86:0)
[21:07:08.465] Build status: STARTED
[21:07:08.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:87:0) after 3m42s
[21:10:50.563] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:87:0)
[21:10:50.586] Build status: STARTED
[21:10:50.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:88:0) after 7m45s
[21:18:35.794] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:88:0)
[21:18:35.844] Build status: STARTED
[21:18:35.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:89:0) after 5m31s
[21:24:06.872] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:89:0)
[21:24:06.901] Build status: STARTED
[21:24:06.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:90:0) after 1m53s
[21:26:00.772] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:90:0)
[21:26:00.792] Build status: STARTED
[21:26:00.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:91:0) after 4m35s
[21:30:36.263] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:91:0)
[21:30:36.422] Build status: STARTED
[21:30:36.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:92:0) after 4m34s
[21:35:10.559] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:92:0)
[21:35:10.579] Build status: STARTED
[21:35:10.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:93:0) after 4m3s
[21:39:13.604] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:93:0)
[21:39:13.628] Build status: STARTED
[21:39:13.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:94:0) after 3m25s
[21:42:38.755] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:94:0)
[21:42:38.787] Build status: STARTED
[21:42:38.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:95:0) after 9m48s
[21:52:27.394] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:95:0)
[21:52:27.429] Build status: STARTED
[21:52:27.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:96:0) after 7m22s
[21:59:49.446] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:96:0)
[21:59:49.470] Build status: STARTED
[21:59:49.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:97:0) after 5m38s
[22:05:27.512] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:97:0)
[22:05:27.547] Build status: STARTED
[22:05:27.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:98:0) after 8m48s
[22:14:15.608] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:98:0)
[22:14:15.630] Build status: STARTED
[22:14:15.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:99:0) after 2m29s
[22:16:44.833] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:99:0)
[22:16:44.855] Build status: STARTED
[22:16:44.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:100:0) after 4m35s
[22:21:19.878] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:100:0)
[22:21:19.899] Build status: STARTED
[22:21:19.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:101:0) after 7m49s
[22:29:09.081] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:101:0)
[22:29:09.102] Build status: STARTED
[22:29:09.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:102:0) after 9m49s
[22:38:58.356] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:102:0)
[22:38:58.379] Build status: STARTED
[22:38:58.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:103:0) after 5m47s
[22:44:45.552] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:103:0)
[22:44:45.731] Build status: STARTED
[22:44:45.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:104:0) after 8m46s
[22:53:31.772] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:104:0)
[22:53:31.804] Build status: STARTED
[22:53:31.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:105:0) after 5m4s
[22:58:35.823] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:105:0)
[22:58:35.842] Build status: STARTED
[22:58:35.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:106:0) after 3m16s
[23:01:51.871] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:106:0)
[23:01:51.892] Build status: STARTED
[23:01:51.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:107:0) after 4m26s
[23:06:18.166] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:107:0)
[23:06:18.186] Build status: STARTED
[23:06:18.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:108:0) after 4m6s
[23:10:24.546] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:108:0)
[23:10:24.567] Build status: STARTED
[23:10:24.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:109:0) after 7m42s
[23:18:06.566] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:109:0)
[23:18:06.590] Build status: STARTED
[23:18:06.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:110:0) after 7m21s
[23:25:27.586] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:110:0)
[23:25:27.612] Build status: STARTED
[23:25:27.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:111:0) after 1m35s
[23:27:02.681] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:111:0)
[23:27:02.711] Build status: STARTED
[23:27:02.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:112:0) after 5m11s
[23:32:14.034] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:112:0)
[23:32:14.058] Build status: STARTED
[23:32:14.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:113:0) after 4m38s
[23:36:52.083] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:113:0)
[23:36:52.120] Build status: STARTED
[23:36:52.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:114:0) after 6m51s
[23:43:43.289] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:114:0)
[23:43:43.312] Build status: STARTED
[23:43:43.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:115:0) after 9m33s
[23:53:17.237] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:115:0)
[23:53:17.276] Build status: STARTED
[23:53:17.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:116:0) after 4m24s
[23:57:41.297] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:116:0)
[23:57:41.320] Build status: STARTED
[23:57:41.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:117:0) after 3m12s
[00:00:53.680] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:117:0)
[00:00:53.706] Build status: STARTED
[00:00:53.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:118:0) after 1m34s
[00:02:27.858] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:118:0)
[00:02:27.883] Build status: STARTED
[00:02:27.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:119:0) after 3m33s
[00:06:01.402] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:119:0)
[00:06:01.425] Build status: STARTED
[00:06:01.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:120:0) after 7m40s
[00:13:41.550] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:120:0)
[00:13:41.572] Build status: STARTED
[00:13:41.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:121:0) after 2m35s
[00:16:16.543] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:121:0)
[00:16:16.612] Build status: STARTED
[00:16:16.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:122:0) after 8m18s
[00:24:35.271] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:122:0)
[00:24:35.293] Build status: STARTED
[00:24:35.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:123:0) after 5m28s
[00:30:03.316] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:123:0)
[00:30:03.343] Build status: STARTED
[00:30:03.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:124:0) after 6m25s
[00:36:28.457] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:124:0)
[00:36:28.503] Build status: STARTED
[00:36:28.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:125:0) after 2m58s
[00:39:26.598] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:125:0)
[00:39:26.624] Build status: STARTED
[00:39:26.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:126:0) after 9m2s
[00:48:28.645] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:126:0)
[00:48:28.669] Build status: STARTED
[00:48:28.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:127:0) after 5m25s
[00:53:53.753] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:127:0)
[00:53:53.779] Build status: STARTED
[00:53:53.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:128:0) after 8m44s
[01:02:37.803] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:128:0)
[01:02:37.845] Build status: STARTED
[01:02:37.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:129:0) after 5m30s
[01:08:08.047] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:129:0)
[01:08:08.072] Build status: STARTED
[01:08:08.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:130:0) after 4m51s
[01:12:59.109] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:130:0)
[01:12:59.133] Build status: STARTED
[01:12:59.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:131:0) after 9m23s
[01:22:22.203] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:131:0)
[01:22:22.433] Build status: STARTED
[01:22:22.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:132:0) after 8m40s
[01:31:02.777] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:132:0)
[01:31:02.809] Build status: STARTED
[01:31:02.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:133:0) after 5m24s
[01:36:26.853] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:133:0)
[01:36:26.876] Build status: STARTED
[01:36:26.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:134:0) after 8m59s
[01:45:26.117] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:134:0)
[01:45:26.155] Build status: STARTED
[01:45:26.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:135:0) after 1m33s
[01:46:59.178] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:135:0)
[01:46:59.200] Build status: STARTED
[01:46:59.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:136:0) after 4m1s
[01:51:00.221] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:136:0)
[01:51:00.242] Build status: STARTED
[01:51:00.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:137:0) after 5m4s
[01:56:04.264] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:137:0)
[01:56:04.309] Build status: STARTED
[01:56:04.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:138:0) after 1m54s
[01:57:58.798] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:138:0)
[01:57:58.821] Build status: STARTED
[01:57:58.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:139:0) after 4m3s
[02:02:01.842] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:139:0)
[02:02:01.866] Build status: STARTED
[02:02:01.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:140:0) after 8m11s
[02:10:12.916] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:140:0)
[02:10:12.945] Build status: STARTED
[02:10:12.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:141:0) after 8m52s
[02:19:04.979] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:141:0)
[02:19:05.007] Build status: STARTED
[02:19:05.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:142:0) after 7m50s
[02:26:55.127] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:142:0)
[02:26:55.152] Build status: STARTED
[02:26:55.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:143:0) after 3m4s
[02:29:59.289] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:143:0)
[02:29:59.310] Build status: STARTED
[02:29:59.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:144:0) after 1m56s
[02:31:55.400] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:144:0)
[02:31:55.421] Build status: STARTED
[02:31:55.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:145:0) after 9m6s
[02:41:01.474] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:145:0)
[02:41:01.501] Build status: STARTED
[02:41:01.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:146:0) after 3m39s
[02:44:40.730] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:146:0)
[02:44:40.790] Build status: STARTED
[02:44:40.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:147:0) after 5m2s
[02:49:43.013] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:147:0)
[02:49:43.037] Build status: STARTED
[02:49:43.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:148:0) after 6m50s
[02:56:33.158] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:148:0)
[02:56:33.182] Build status: STARTED
[02:56:33.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:149:0) after 3m11s
[02:59:44.173] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:149:0)
[02:59:44.201] Build status: STARTED
[02:59:44.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:150:0) after 5m34s
[03:05:18.219] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:150:0)
[03:05:18.249] Build status: STARTED
[03:05:18.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:151:0) after 7m21s
[03:12:39.300] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:151:0)
[03:12:39.358] Build status: STARTED
[03:12:39.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:152:0) after 1m31s
[03:14:10.483] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:152:0)
[03:14:10.518] Build status: STARTED
[03:14:10.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:153:0) after 1m41s
[03:15:51.848] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:153:0)
[03:15:51.872] Build status: STARTED
[03:15:51.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:154:0) after 4m30s
[03:20:21.895] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:154:0)
[03:20:21.917] Build status: STARTED
[03:20:21.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:155:0) after 7m44s
[03:28:06.037] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:155:0)
[03:28:06.061] Build status: STARTED
[03:28:06.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:156:0) after 3m28s
[03:31:34.397] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:156:0)
[03:31:34.734] Build status: STARTED
[03:31:34.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:157:0) after 5m42s
[03:37:17.144] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:157:0)
[03:37:17.167] Build status: STARTED
[03:37:17.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:158:0) after 5m4s
[03:42:21.188] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:158:0)
[03:42:21.282] Build status: STARTED
[03:42:21.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:159:0) after 8m59s
[03:51:20.349] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:159:0)
[03:51:20.386] Build status: STARTED
[03:51:20.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:160:0) after 4m3s
[03:55:23.429] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:160:0)
[03:55:23.465] Build status: STARTED
[03:55:23.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:161:0) after 4m47s
[04:00:10.498] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:161:0)
[04:00:10.523] Build status: STARTED
[04:00:10.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:162:0) after 5m33s
[04:05:43.652] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:162:0)
[04:05:43.675] Build status: STARTED
[04:05:43.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8958686124036133760:163:0) after 8m19s
[04:07:05.558] Received PubSub notification, asking Buildbucket for the build status
[04:07:05.580] Build:
{
"id": "8793256062004752193",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 28580,
"createdBy": "project:chromium",
"createTime": "2022-12-31T13:49:18.290078551Z",
"startTime": "2022-12-31T13:58:51.554089Z",
"endTime": "2023-01-01T04:07:04.726402Z",
"updateTime": "2023-01-01T04:07:04.726402Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2a7fbc53fdef4617d9878d9556fdb9a1e4052ccf",
"ref": "refs/heads/main"
}
},
"canary": true
}
[04:07:05.580] Invocation finished in 14h17m48.610795887s with status FAILED