[00:34:42.913] New invocation is queued and will start shortly
[00:34:43.925] Starting the invocation (attempt 1)
[00:34:43.952] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f7d06907f71ca7d0147dcdb8c06998440dff60f2"
[00:34:43.952] Popped gitiles commit info from properties and tags
[00:34:43.952] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:34:43.952] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:34:43.953] Buildbucket request:
{
"requestId": "8920594791070197216",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f7d06907f71ca7d0147dcdb8c06998440dff60f2",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8920594791070197216"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:34:44.531] Scheduled build:
{
"id": "8755164729255050113",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 31198,
"createdBy": "project:chromium",
"createTime": "2024-02-25T00:34:44.011735435Z",
"updateTime": "2024-02-25T00:34:44.011735435Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f7d06907f71ca7d0147dcdb8c06998440dff60f2",
"ref": "refs/heads/main"
}
}
}
[00:34:44.531] Task URL: https://cr-buildbucket.appspot.com/build/8755164729255050113
[00:34:44.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:2:0) after 6m41s
[00:34:44.708] Received PubSub notification, asking Buildbucket for the build status
[00:34:44.742] Build status: SCHEDULED
[00:34:50.629] Received PubSub notification, asking Buildbucket for the build status
[00:34:50.651] Build status: STARTED
[00:41:25.658] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:2:0)
[00:41:25.676] Build status: STARTED
[00:41:25.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:5:0) after 5m25s
[00:46:50.697] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:5:0)
[00:46:50.732] Build status: STARTED
[00:46:50.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:6:0) after 7m8s
[00:53:58.751] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:6:0)
[00:53:58.773] Build status: STARTED
[00:53:58.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:7:0) after 3m41s
[00:57:39.789] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:7:0)
[00:57:39.816] Build status: STARTED
[00:57:39.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:8:0) after 6m5s
[01:03:44.834] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:8:0)
[01:03:44.941] Build status: STARTED
[01:03:44.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:9:0) after 3m52s
[01:07:36.957] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:9:0)
[01:07:37.007] Build status: STARTED
[01:07:37.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:10:0) after 6m58s
[01:14:35.332] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:10:0)
[01:14:35.366] Build status: STARTED
[01:14:35.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:11:0) after 8m41s
[01:23:16.873] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:11:0)
[01:23:16.894] Build status: STARTED
[01:23:16.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:12:0) after 5m39s
[01:28:56.115] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:12:0)
[01:28:56.142] Build status: STARTED
[01:28:56.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:13:0) after 6m8s
[01:35:04.169] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:13:0)
[01:35:04.207] Build status: STARTED
[01:35:04.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:14:0) after 9m59s
[01:45:03.241] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:14:0)
[01:45:03.265] Build status: STARTED
[01:45:03.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:15:0) after 9m52s
[01:54:55.296] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:15:0)
[01:54:55.313] Build status: STARTED
[01:54:55.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:16:0) after 5m39s
[02:00:34.358] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:16:0)
[02:00:34.375] Build status: STARTED
[02:00:34.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:17:0) after 8m15s
[02:08:49.495] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:17:0)
[02:08:49.514] Build status: STARTED
[02:08:49.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:18:0) after 8m4s
[02:16:53.536] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:18:0)
[02:16:53.567] Build status: STARTED
[02:16:53.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:19:0) after 4m38s
[02:21:31.773] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:19:0)
[02:21:31.790] Build status: STARTED
[02:21:31.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:20:0) after 5m35s
[02:27:06.910] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:20:0)
[02:27:06.940] Build status: STARTED
[02:27:06.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:21:0) after 8m2s
[02:35:09.034] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:21:0)
[02:35:09.054] Build status: STARTED
[02:35:09.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:22:0) after 8m14s
[02:43:23.205] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:22:0)
[02:43:23.247] Build status: STARTED
[02:43:23.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:23:0) after 2m19s
[02:45:42.275] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:23:0)
[02:45:42.290] Build status: STARTED
[02:45:42.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:24:0) after 5m8s
[02:50:50.384] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:24:0)
[02:50:50.404] Build status: STARTED
[02:50:50.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:25:0) after 1m13s
[02:52:03.573] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:25:0)
[02:52:03.604] Build status: STARTED
[02:52:03.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:26:0) after 5m24s
[02:57:27.625] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:26:0)
[02:57:27.705] Build status: STARTED
[02:57:27.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:27:0) after 3m51s
[03:01:18.774] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:27:0)
[03:01:18.797] Build status: STARTED
[03:01:18.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:28:0) after 6m23s
[03:07:41.772] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:28:0)
[03:07:41.790] Build status: STARTED
[03:07:41.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:29:0) after 2m31s
[03:10:12.856] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:29:0)
[03:10:12.894] Build status: STARTED
[03:10:12.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:30:0) after 4m52s
[03:15:05.048] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:30:0)
[03:15:05.075] Build status: STARTED
[03:15:05.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:31:0) after 1m55s
[03:17:00.161] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:31:0)
[03:17:00.318] Build status: STARTED
[03:17:00.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:32:0) after 9m54s
[03:26:54.420] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:32:0)
[03:26:54.439] Build status: STARTED
[03:26:54.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:33:0) after 7m33s
[03:34:27.547] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:33:0)
[03:34:27.563] Build status: STARTED
[03:34:27.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:34:0) after 5m14s
[03:39:41.648] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:34:0)
[03:39:41.671] Build status: STARTED
[03:39:41.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:35:0) after 1m25s
[03:41:06.689] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:35:0)
[03:41:06.705] Build status: STARTED
[03:41:06.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:36:0) after 1m2s
[03:42:08.869] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:36:0)
[03:42:08.945] Build status: STARTED
[03:42:08.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:37:0) after 6m7s
[03:48:15.951] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:37:0)
[03:48:15.973] Build status: STARTED
[03:48:15.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:38:0) after 2m38s
[03:50:54.200] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:38:0)
[03:50:54.224] Build status: STARTED
[03:50:54.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:39:0) after 3m11s
[03:54:05.243] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:39:0)
[03:54:05.266] Build status: STARTED
[03:54:05.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:40:0) after 3m17s
[03:57:22.294] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:40:0)
[03:57:22.379] Build status: STARTED
[03:57:22.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:41:0) after 9m47s
[04:07:09.399] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:41:0)
[04:07:09.417] Build status: STARTED
[04:07:09.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:42:0) after 7m14s
[04:14:23.634] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:42:0)
[04:14:23.653] Build status: STARTED
[04:14:23.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:43:0) after 8m59s
[04:23:22.682] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:43:0)
[04:23:22.709] Build status: STARTED
[04:23:22.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:44:0) after 6m37s
[04:29:59.860] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:44:0)
[04:29:59.894] Build status: STARTED
[04:29:59.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:45:0) after 8m46s
[04:38:45.916] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:45:0)
[04:38:45.936] Build status: STARTED
[04:38:45.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:46:0) after 3m28s
[04:42:13.960] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:46:0)
[04:42:13.985] Build status: STARTED
[04:42:13.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:47:0) after 6m34s
[04:48:48.566] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:47:0)
[04:48:48.587] Build status: STARTED
[04:48:48.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:48:0) after 2m48s
[04:51:36.583] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:48:0)
[04:51:36.599] Build status: STARTED
[04:51:36.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:49:0) after 3m32s
[04:55:08.872] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:49:0)
[04:55:08.889] Build status: STARTED
[04:55:08.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:50:0) after 5m51s
[05:00:59.938] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:50:0)
[05:00:59.973] Build status: STARTED
[05:00:59.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:51:0) after 1m52s
[05:02:51.997] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:51:0)
[05:02:52.020] Build status: STARTED
[05:02:52.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:52:0) after 9m20s
[05:12:12.045] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:52:0)
[05:12:12.064] Build status: STARTED
[05:12:12.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:53:0) after 8m59s
[05:21:11.396] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:53:0)
[05:21:11.416] Build status: STARTED
[05:21:11.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:54:0) after 9m3s
[05:30:14.687] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:54:0)
[05:30:14.755] Build status: STARTED
[05:30:14.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:55:0) after 6m39s
[05:36:53.911] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:55:0)
[05:36:54.117] Build status: STARTED
[05:36:54.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:56:0) after 7m9s
[05:44:03.138] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:56:0)
[05:44:03.170] Build status: STARTED
[05:44:03.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:57:0) after 5m30s
[05:49:33.408] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:57:0)
[05:49:33.426] Build status: STARTED
[05:49:33.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:58:0) after 7m32s
[05:57:05.444] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:58:0)
[05:57:05.466] Build status: STARTED
[05:57:05.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:59:0) after 7m12s
[06:04:17.507] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:59:0)
[06:04:17.559] Build status: STARTED
[06:04:17.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:60:0) after 2m8s
[06:06:25.596] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:60:0)
[06:06:25.622] Build status: STARTED
[06:06:25.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:61:0) after 8m23s
[06:14:48.719] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:61:0)
[06:14:48.743] Build status: STARTED
[06:14:48.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:62:0) after 9m41s
[06:24:29.998] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:62:0)
[06:24:30.038] Build status: STARTED
[06:24:30.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:63:0) after 3m35s
[06:28:05.056] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:63:0)
[06:28:05.171] Build status: STARTED
[06:28:05.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:64:0) after 7m55s
[06:36:00.480] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:64:0)
[06:36:00.501] Build status: STARTED
[06:36:00.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:65:0) after 4m1s
[06:40:01.521] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:65:0)
[06:40:01.539] Build status: STARTED
[06:40:01.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:66:0) after 1m8s
[06:41:09.664] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:66:0)
[06:41:09.684] Build status: STARTED
[06:41:09.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:67:0) after 5m52s
[06:47:02.142] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:67:0)
[06:47:02.162] Build status: STARTED
[06:47:02.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:68:0) after 7m7s
[06:54:09.187] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:68:0)
[06:54:09.214] Build status: STARTED
[06:54:09.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:69:0) after 2m53s
[06:57:02.550] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:69:0)
[06:57:02.575] Build status: STARTED
[06:57:02.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:70:0) after 4m42s
[07:01:44.618] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:70:0)
[07:01:44.636] Build status: STARTED
[07:01:44.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:71:0) after 6m1s
[07:07:45.791] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:71:0)
[07:07:45.815] Build status: STARTED
[07:07:45.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:72:0) after 4m52s
[07:12:37.968] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:72:0)
[07:12:37.988] Build status: STARTED
[07:12:37.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:73:0) after 2m4s
[07:14:42.008] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:73:0)
[07:14:42.044] Build status: STARTED
[07:14:42.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:74:0) after 1m7s
[07:15:49.268] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:74:0)
[07:15:49.294] Build status: STARTED
[07:15:49.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:75:0) after 5m53s
[07:21:42.319] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:75:0)
[07:21:42.336] Build status: STARTED
[07:21:42.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:76:0) after 9m7s
[07:30:49.355] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:76:0)
[07:30:49.373] Build status: STARTED
[07:30:49.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:77:0) after 7m38s
[07:38:27.538] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:77:0)
[07:38:27.566] Build status: STARTED
[07:38:27.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:78:0) after 8m22s
[07:46:49.593] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:78:0)
[07:46:49.628] Build status: STARTED
[07:46:49.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:79:0) after 1m21s
[07:48:10.699] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:79:0)
[07:48:10.725] Build status: STARTED
[07:48:10.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:80:0) after 5m21s
[07:53:31.753] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:80:0)
[07:53:31.774] Build status: STARTED
[07:53:31.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:81:0) after 2m1s
[07:55:32.938] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:81:0)
[07:55:32.956] Build status: STARTED
[07:55:32.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:82:0) after 4m11s
[07:59:43.945] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:82:0)
[07:59:43.972] Build status: STARTED
[07:59:43.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:83:0) after 4m23s
[08:04:06.992] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:83:0)
[08:04:07.014] Build status: STARTED
[08:04:07.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:84:0) after 9m46s
[08:13:53.048] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:84:0)
[08:13:53.088] Build status: STARTED
[08:13:53.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:85:0) after 1m59s
[08:15:52.270] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:85:0)
[08:15:52.293] Build status: STARTED
[08:15:52.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:86:0) after 2m11s
[08:18:03.385] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:86:0)
[08:18:03.407] Build status: STARTED
[08:18:03.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:87:0) after 5m15s
[08:23:18.431] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:87:0)
[08:23:18.453] Build status: STARTED
[08:23:18.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:88:0) after 4m44s
[08:28:02.625] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:88:0)
[08:28:02.659] Build status: STARTED
[08:28:02.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:89:0) after 6m28s
[08:34:30.678] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:89:0)
[08:34:30.697] Build status: STARTED
[08:34:30.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:90:0) after 6m54s
[08:41:24.729] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:90:0)
[08:41:24.753] Build status: STARTED
[08:41:24.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:91:0) after 8m38s
[08:50:02.810] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:91:0)
[08:50:02.893] Build status: STARTED
[08:50:02.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:92:0) after 4m26s
[08:54:28.922] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:92:0)
[08:54:28.955] Build status: STARTED
[08:54:28.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:93:0) after 4m47s
[08:59:15.951] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:93:0)
[08:59:15.970] Build status: STARTED
[08:59:15.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:94:0) after 1m59s
[09:01:15.106] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:94:0)
[09:01:15.141] Build status: STARTED
[09:01:15.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:95:0) after 7m26s
[09:08:41.806] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:95:0)
[09:08:41.835] Build status: STARTED
[09:08:41.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:96:0) after 7m28s
[09:16:10.033] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:96:0)
[09:16:10.053] Build status: STARTED
[09:16:10.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:97:0) after 7m57s
[09:24:07.547] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:97:0)
[09:24:07.567] Build status: STARTED
[09:24:07.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:98:0) after 9m6s
[09:33:13.735] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:98:0)
[09:33:14.011] Build status: STARTED
[09:33:14.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:99:0) after 8m24s
[09:41:38.072] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:99:0)
[09:41:38.093] Build status: STARTED
[09:41:38.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:100:0) after 3m49s
[09:45:27.125] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:100:0)
[09:45:27.149] Build status: STARTED
[09:45:27.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:101:0) after 7m25s
[09:52:52.175] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:101:0)
[09:52:52.206] Build status: STARTED
[09:52:52.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:102:0) after 4m20s
[09:57:12.245] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:102:0)
[09:57:12.260] Build status: STARTED
[09:57:12.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:103:0) after 1m23s
[09:58:35.282] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:103:0)
[09:58:35.301] Build status: STARTED
[09:58:35.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:104:0) after 4m28s
[10:03:03.400] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:104:0)
[10:03:03.442] Build status: STARTED
[10:03:03.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:105:0) after 4m57s
[10:08:00.461] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:105:0)
[10:08:00.479] Build status: STARTED
[10:08:00.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:106:0) after 6m19s
[10:14:19.497] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:106:0)
[10:14:19.579] Build status: STARTED
[10:14:19.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:107:0) after 7m54s
[10:22:13.596] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:107:0)
[10:22:13.637] Build status: STARTED
[10:22:13.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:108:0) after 4m52s
[10:27:05.720] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:108:0)
[10:27:05.739] Build status: STARTED
[10:27:05.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:109:0) after 1m2s
[10:28:07.769] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:109:0)
[10:28:07.815] Build status: STARTED
[10:28:07.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:110:0) after 9m34s
[10:37:41.837] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:110:0)
[10:37:41.857] Build status: STARTED
[10:37:41.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:111:0) after 3m56s
[10:41:37.876] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:111:0)
[10:41:37.906] Build status: STARTED
[10:41:37.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:112:0) after 2m51s
[10:44:29.304] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:112:0)
[10:44:29.330] Build status: STARTED
[10:44:29.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:113:0) after 5m59s
[10:50:28.378] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:113:0)
[10:50:28.444] Build status: STARTED
[10:50:28.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:114:0) after 8m19s
[10:58:47.469] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:114:0)
[10:58:47.491] Build status: STARTED
[10:58:47.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:115:0) after 5m12s
[11:03:59.472] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:115:0)
[11:03:59.512] Build status: STARTED
[11:03:59.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:116:0) after 4m25s
[11:08:24.538] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:116:0)
[11:08:24.588] Build status: STARTED
[11:08:24.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:117:0) after 5m24s
[11:13:48.729] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:117:0)
[11:13:48.748] Build status: STARTED
[11:13:48.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:118:0) after 8m47s
[11:22:35.832] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:118:0)
[11:22:35.859] Build status: STARTED
[11:22:35.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:119:0) after 2m6s
[11:24:41.879] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:119:0)
[11:24:41.901] Build status: STARTED
[11:24:41.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:120:0) after 5m52s
[11:30:34.196] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:120:0)
[11:30:34.216] Build status: STARTED
[11:30:34.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:121:0) after 2m52s
[11:33:26.239] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:121:0)
[11:33:26.278] Build status: STARTED
[11:33:26.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:122:0) after 6m43s
[11:40:09.313] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:122:0)
[11:40:09.602] Build status: STARTED
[11:40:09.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:123:0) after 5m35s
[11:45:44.628] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:123:0)
[11:45:44.646] Build status: STARTED
[11:45:44.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:124:0) after 1m43s
[11:47:27.677] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:124:0)
[11:47:27.699] Build status: STARTED
[11:47:27.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:125:0) after 2m35s
[11:50:02.752] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:125:0)
[11:50:02.774] Build status: STARTED
[11:50:02.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:126:0) after 5m21s
[11:55:23.799] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:126:0)
[11:55:23.848] Build status: STARTED
[11:55:23.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:127:0) after 9m56s
[12:05:19.907] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:127:0)
[12:05:19.929] Build status: STARTED
[12:05:19.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:128:0) after 6m49s
[12:12:09.465] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:128:0)
[12:12:09.484] Build status: STARTED
[12:12:09.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:129:0) after 9m23s
[12:21:32.548] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:129:0)
[12:21:32.568] Build status: STARTED
[12:21:32.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:130:0) after 1m24s
[12:22:56.801] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:130:0)
[12:22:56.819] Build status: STARTED
[12:22:56.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:131:0) after 4m13s
[12:27:09.840] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:131:0)
[12:27:09.859] Build status: STARTED
[12:27:09.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:132:0) after 1m39s
[12:28:48.881] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:132:0)
[12:28:48.914] Build status: STARTED
[12:28:48.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:133:0) after 4m44s
[12:33:32.938] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:133:0)
[12:33:32.958] Build status: STARTED
[12:33:32.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:134:0) after 9m39s
[12:43:11.979] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:134:0)
[12:43:12.003] Build status: STARTED
[12:43:12.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:135:0) after 3m0s
[12:46:12.026] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:135:0)
[12:46:12.047] Build status: STARTED
[12:46:12.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:136:0) after 4m32s
[12:50:44.070] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:136:0)
[12:50:44.091] Build status: STARTED
[12:50:44.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:137:0) after 6m24s
[12:57:08.120] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:137:0)
[12:57:08.140] Build status: STARTED
[12:57:08.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:138:0) after 6m32s
[13:03:40.162] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:138:0)
[13:03:40.186] Build status: STARTED
[13:03:40.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:139:0) after 2m19s
[13:05:59.224] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:139:0)
[13:05:59.255] Build status: STARTED
[13:05:59.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:140:0) after 8m36s
[13:14:35.276] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:140:0)
[13:14:35.302] Build status: STARTED
[13:14:35.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:141:0) after 9m54s
[13:24:29.320] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:141:0)
[13:24:29.340] Build status: STARTED
[13:24:29.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:142:0) after 5m7s
[13:29:36.582] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:142:0)
[13:29:36.606] Build status: STARTED
[13:29:36.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:143:0) after 1m5s
[13:30:41.640] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:143:0)
[13:30:41.783] Build status: STARTED
[13:30:41.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:144:0) after 3m11s
[13:33:52.804] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:144:0)
[13:33:52.824] Build status: STARTED
[13:33:52.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:145:0) after 3m1s
[13:36:54.030] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:145:0)
[13:36:54.048] Build status: STARTED
[13:36:54.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:146:0) after 3m43s
[13:40:37.325] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:146:0)
[13:40:37.346] Build status: STARTED
[13:40:37.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:147:0) after 7m26s
[13:48:03.372] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:147:0)
[13:48:03.396] Build status: STARTED
[13:48:03.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:148:0) after 7m21s
[13:55:24.425] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:148:0)
[13:55:24.447] Build status: STARTED
[13:55:24.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:149:0) after 9m0s
[14:04:24.794] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:149:0)
[14:04:24.824] Build status: STARTED
[14:04:24.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:150:0) after 5m16s
[14:09:40.848] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:150:0)
[14:09:40.910] Build status: STARTED
[14:09:40.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:151:0) after 6m43s
[14:16:23.996] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:151:0)
[14:16:24.049] Build status: STARTED
[14:16:24.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:152:0) after 3m3s
[14:19:27.479] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:152:0)
[14:19:27.536] Build status: STARTED
[14:19:27.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:153:0) after 2m33s
[14:22:00.863] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:153:0)
[14:22:00.897] Build status: STARTED
[14:22:00.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:154:0) after 7m17s
[14:29:18.485] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:154:0)
[14:29:18.507] Build status: STARTED
[14:29:18.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:155:0) after 7m31s
[14:36:49.556] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:155:0)
[14:36:49.589] Build status: STARTED
[14:36:49.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:156:0) after 4m26s
[14:41:15.651] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:156:0)
[14:41:15.668] Build status: STARTED
[14:41:15.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:157:0) after 8m11s
[14:49:27.002] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:157:0)
[14:49:27.025] Build status: STARTED
[14:49:27.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:158:0) after 2m21s
[14:51:48.109] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:158:0)
[14:51:48.173] Build status: STARTED
[14:51:48.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:159:0) after 2m49s
[14:54:37.406] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:159:0)
[14:54:37.432] Build status: STARTED
[14:54:37.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:160:0) after 1m51s
[14:56:28.535] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:160:0)
[14:56:28.591] Build status: STARTED
[14:56:28.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:161:0) after 3m39s
[15:00:07.735] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:161:0)
[15:00:07.757] Build status: STARTED
[15:00:07.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:162:0) after 2m59s
[15:03:06.803] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:162:0)
[15:03:06.823] Build status: STARTED
[15:03:06.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:163:0) after 9m22s
[15:12:28.823] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:163:0)
[15:12:28.844] Build status: STARTED
[15:12:28.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:164:0) after 4m36s
[15:17:04.878] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:164:0)
[15:17:04.899] Build status: STARTED
[15:17:04.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:165:0) after 4m6s
[15:21:10.929] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:165:0)
[15:21:10.951] Build status: STARTED
[15:21:10.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:166:0) after 2m41s
[15:23:52.028] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:166:0)
[15:23:52.048] Build status: STARTED
[15:23:52.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:167:0) after 7m9s
[15:31:01.216] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:167:0)
[15:31:01.239] Build status: STARTED
[15:31:01.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:168:0) after 2m9s
[15:33:10.277] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:168:0)
[15:33:10.330] Build status: STARTED
[15:33:10.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:169:0) after 5m46s
[15:38:56.357] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:169:0)
[15:38:56.375] Build status: STARTED
[15:38:56.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:170:0) after 1m39s
[15:40:35.498] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:170:0)
[15:40:35.518] Build status: STARTED
[15:40:35.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:171:0) after 2m22s
[15:42:58.421] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:171:0)
[15:42:58.448] Build status: STARTED
[15:42:58.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:172:0) after 5m14s
[15:48:12.473] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:172:0)
[15:48:12.496] Build status: STARTED
[15:48:12.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:173:0) after 5m56s
[15:54:08.635] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:173:0)
[15:54:08.658] Build status: STARTED
[15:54:08.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:174:0) after 8m58s
[16:03:06.699] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:174:0)
[16:03:06.768] Build status: STARTED
[16:03:06.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:175:0) after 4m39s
[16:07:45.797] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:175:0)
[16:07:45.827] Build status: STARTED
[16:07:45.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:176:0) after 3m10s
[16:10:55.858] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:176:0)
[16:10:55.884] Build status: STARTED
[16:10:55.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:177:0) after 8m22s
[16:19:18.010] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:177:0)
[16:19:18.027] Build status: STARTED
[16:19:18.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:178:0) after 8m6s
[16:27:24.060] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:178:0)
[16:27:24.086] Build status: STARTED
[16:27:24.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:179:0) after 2m29s
[16:29:53.106] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:179:0)
[16:29:53.420] Build status: STARTED
[16:29:53.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:180:0) after 4m19s
[16:34:12.544] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:180:0)
[16:34:12.584] Build status: STARTED
[16:34:12.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:181:0) after 2m12s
[16:36:24.608] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:181:0)
[16:36:24.627] Build status: STARTED
[16:36:24.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:182:0) after 2m1s
[16:38:25.716] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:182:0)
[16:38:25.733] Build status: STARTED
[16:38:25.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:183:0) after 2m19s
[16:40:44.843] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:183:0)
[16:40:44.862] Build status: STARTED
[16:40:44.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:184:0) after 4m34s
[16:45:18.885] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:184:0)
[16:45:18.917] Build status: STARTED
[16:45:18.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:185:0) after 3m38s
[16:48:56.940] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:185:0)
[16:48:56.957] Build status: STARTED
[16:48:56.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:186:0) after 4m28s
[16:53:24.974] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:186:0)
[16:53:25.087] Build status: STARTED
[16:53:25.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:187:0) after 6m26s
[16:59:51.112] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:187:0)
[16:59:51.188] Build status: STARTED
[16:59:51.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:188:0) after 8m58s
[17:08:49.210] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:188:0)
[17:08:49.233] Build status: STARTED
[17:08:49.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:189:0) after 8m31s
[17:17:20.261] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:189:0)
[17:17:20.280] Build status: STARTED
[17:17:20.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:190:0) after 3m4s
[17:20:24.452] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:190:0)
[17:20:24.472] Build status: STARTED
[17:20:24.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:191:0) after 7m41s
[17:28:05.495] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:191:0)
[17:28:05.514] Build status: STARTED
[17:28:05.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:192:0) after 7m36s
[17:35:41.636] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:192:0)
[17:35:41.656] Build status: STARTED
[17:35:41.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:193:0) after 6m34s
[17:42:15.683] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:193:0)
[17:42:15.699] Build status: STARTED
[17:42:15.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:194:0) after 5m11s
[17:47:26.723] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:194:0)
[17:47:26.768] Build status: STARTED
[17:47:26.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:195:0) after 1m57s
[17:49:23.794] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:195:0)
[17:49:23.814] Build status: STARTED
[17:49:23.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:196:0) after 8m48s
[17:58:11.942] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:196:0)
[17:58:11.961] Build status: STARTED
[17:58:11.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:197:0) after 7m32s
[18:05:44.137] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:197:0)
[18:05:44.171] Build status: STARTED
[18:05:44.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:198:0) after 7m1s
[18:12:45.224] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:198:0)
[18:12:45.243] Build status: STARTED
[18:12:45.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:199:0) after 9m7s
[18:21:52.377] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:199:0)
[18:21:52.406] Build status: STARTED
[18:21:52.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:200:0) after 7m49s
[18:29:41.425] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:200:0)
[18:29:41.448] Build status: STARTED
[18:29:41.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:201:0) after 7m37s
[18:37:18.503] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:201:0)
[18:37:18.526] Build status: STARTED
[18:37:18.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:202:0) after 8m3s
[18:45:21.587] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:202:0)
[18:45:21.605] Build status: STARTED
[18:45:21.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:203:0) after 4m15s
[18:49:36.965] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:203:0)
[18:49:36.985] Build status: STARTED
[18:49:36.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:204:0) after 5m39s
[18:55:16.112] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:204:0)
[18:55:16.135] Build status: STARTED
[18:55:16.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:205:0) after 6m55s
[19:02:11.161] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:205:0)
[19:02:11.183] Build status: STARTED
[19:02:11.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:206:0) after 8m34s
[19:10:45.214] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:206:0)
[19:10:45.231] Build status: STARTED
[19:10:45.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:207:0) after 4m15s
[19:15:00.415] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:207:0)
[19:15:00.450] Build status: STARTED
[19:15:00.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:208:0) after 4m6s
[19:19:06.554] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:208:0)
[19:19:06.571] Build status: STARTED
[19:19:06.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:209:0) after 3m57s
[19:23:03.609] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:209:0)
[19:23:03.644] Build status: STARTED
[19:23:03.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:210:0) after 4m53s
[19:27:56.780] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:210:0)
[19:27:56.807] Build status: STARTED
[19:27:56.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:211:0) after 6m42s
[19:34:38.835] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:211:0)
[19:34:38.864] Build status: STARTED
[19:34:38.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:212:0) after 5m29s
[19:40:07.993] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:212:0)
[19:40:08.020] Build status: STARTED
[19:40:08.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:213:0) after 3m21s
[19:43:29.055] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:213:0)
[19:43:29.074] Build status: STARTED
[19:43:29.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:214:0) after 7m2s
[19:50:31.102] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:214:0)
[19:50:31.130] Build status: STARTED
[19:50:31.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:215:0) after 6m19s
[19:56:50.277] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:215:0)
[19:56:50.387] Build status: STARTED
[19:56:50.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:216:0) after 1m55s
[19:58:45.420] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:216:0)
[19:58:45.451] Build status: STARTED
[19:58:45.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:217:0) after 6m14s
[20:04:59.536] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:217:0)
[20:04:59.555] Build status: STARTED
[20:04:59.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:218:0) after 7m20s
[20:12:19.576] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:218:0)
[20:12:19.709] Build status: STARTED
[20:12:19.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:219:0) after 7m0s
[20:19:20.103] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:219:0)
[20:19:20.123] Build status: STARTED
[20:19:20.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:220:0) after 4m1s
[20:23:21.145] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:220:0)
[20:23:21.184] Build status: STARTED
[20:23:21.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:221:0) after 5m7s
[20:28:28.207] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:221:0)
[20:28:28.256] Build status: STARTED
[20:28:28.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:222:0) after 3m31s
[20:31:59.277] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:222:0)
[20:31:59.305] Build status: STARTED
[20:31:59.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:223:0) after 5m29s
[20:37:28.327] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:223:0)
[20:37:28.383] Build status: STARTED
[20:37:28.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8920594791070197216:224:0) after 8m55s
[20:37:46.755] Received PubSub notification, asking Buildbucket for the build status
[20:37:46.795] Build:
{
"id": "8755164729255050113",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 31198,
"createdBy": "project:chromium",
"createTime": "2024-02-25T00:34:44.011735435Z",
"startTime": "2024-02-25T00:34:50.289476403Z",
"endTime": "2024-02-25T20:37:46.284130Z",
"updateTime": "2024-02-25T20:37:46.284130Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f7d06907f71ca7d0147dcdb8c06998440dff60f2",
"ref": "refs/heads/main"
}
}
}
[20:37:46.795] Invocation finished in 20h3m3.89853427s with status FAILED