[19:50:47.454] New invocation is queued and will start shortly
[19:50:48.833] Starting the invocation (attempt 1)
[19:50:48.868] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/091f8abf85df221a98b8a5a75360b9cf1f6a9979"
[19:50:48.868] Popped gitiles commit info from properties and tags
[19:50:48.868] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:50:48.868] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:50:48.868] Buildbucket request:
{
"requestId": "8930215932487819920",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "091f8abf85df221a98b8a5a75360b9cf1f6a9979",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8930215932487819920"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:50:49.482] Scheduled build:
{
"id": "8764785870256690305",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 30760,
"createdBy": "project:chromium",
"createTime": "2023-11-10T19:50:48.943998301Z",
"updateTime": "2023-11-10T19:50:48.943998301Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "091f8abf85df221a98b8a5a75360b9cf1f6a9979",
"ref": "refs/heads/main"
}
}
}
[19:50:49.482] Task URL: https://cr-buildbucket.appspot.com/build/8764785870256690305
[19:50:49.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:2:0) after 8m12s
[19:50:50.514] Received PubSub notification, asking Buildbucket for the build status
[19:50:50.538] Build status: STARTED
[19:50:50.936] Received PubSub notification, asking Buildbucket for the build status
[19:50:50.960] Build status: STARTED
[19:59:01.564] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:2:0)
[19:59:01.661] Build status: STARTED
[19:59:01.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:5:0) after 5m8s
[20:04:09.694] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:5:0)
[20:04:09.717] Build status: STARTED
[20:04:09.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:6:0) after 3m51s
[20:08:00.765] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:6:0)
[20:08:00.791] Build status: STARTED
[20:08:00.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:7:0) after 4m1s
[20:12:01.831] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:7:0)
[20:12:01.858] Build status: STARTED
[20:12:01.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:8:0) after 2m42s
[20:14:43.900] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:8:0)
[20:14:43.924] Build status: STARTED
[20:14:43.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:9:0) after 3m0s
[20:17:43.974] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:9:0)
[20:17:43.999] Build status: STARTED
[20:17:43.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:10:0) after 1m46s
[20:19:29.986] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:10:0)
[20:19:30.004] Build status: STARTED
[20:19:30.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:11:0) after 1m52s
[20:21:22.077] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:11:0)
[20:21:22.095] Build status: STARTED
[20:21:22.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:12:0) after 9m9s
[20:30:31.145] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:12:0)
[20:30:31.164] Build status: STARTED
[20:30:31.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:13:0) after 9m10s
[20:39:41.192] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:13:0)
[20:39:41.268] Build status: STARTED
[20:39:41.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:14:0) after 8m18s
[20:47:59.367] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:14:0)
[20:47:59.468] Build status: STARTED
[20:47:59.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:15:0) after 5m25s
[20:53:24.523] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:15:0)
[20:53:24.583] Build status: STARTED
[20:53:24.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:16:0) after 6m19s
[20:59:43.637] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:16:0)
[20:59:43.658] Build status: STARTED
[20:59:43.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:17:0) after 9m5s
[21:08:48.699] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:17:0)
[21:08:48.724] Build status: STARTED
[21:08:48.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:18:0) after 3m13s
[21:12:01.770] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:18:0)
[21:12:01.871] Build status: STARTED
[21:12:01.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:19:0) after 9m32s
[21:21:33.998] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:19:0)
[21:21:34.019] Build status: STARTED
[21:21:34.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:20:0) after 7m32s
[21:29:06.307] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:20:0)
[21:29:06.327] Build status: STARTED
[21:29:06.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:21:0) after 2m19s
[21:31:25.358] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:21:0)
[21:31:25.381] Build status: STARTED
[21:31:25.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:22:0) after 5m15s
[21:36:40.467] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:22:0)
[21:36:40.534] Build status: STARTED
[21:36:40.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:23:0) after 4m14s
[21:40:54.685] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:23:0)
[21:40:54.709] Build status: STARTED
[21:40:54.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:24:0) after 8m26s
[21:49:20.745] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:24:0)
[21:49:20.767] Build status: STARTED
[21:49:20.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:25:0) after 9m33s
[21:58:53.805] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:25:0)
[21:58:53.823] Build status: STARTED
[21:58:53.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:26:0) after 3m6s
[22:02:00.148] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:26:0)
[22:02:00.169] Build status: STARTED
[22:02:00.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:27:0) after 3m8s
[22:05:08.292] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:27:0)
[22:05:08.319] Build status: STARTED
[22:05:08.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:28:0) after 1m14s
[22:06:22.355] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:28:0)
[22:06:22.416] Build status: STARTED
[22:06:22.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:29:0) after 9m34s
[22:15:56.528] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:29:0)
[22:15:56.570] Build status: STARTED
[22:15:56.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:30:0) after 5m0s
[22:20:56.608] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:30:0)
[22:20:56.685] Build status: STARTED
[22:20:56.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:31:0) after 8m32s
[22:29:28.720] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:31:0)
[22:29:28.738] Build status: STARTED
[22:29:28.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:32:0) after 4m16s
[22:33:44.776] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:32:0)
[22:33:44.805] Build status: STARTED
[22:33:44.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:33:0) after 1m38s
[22:35:22.858] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:33:0)
[22:35:22.875] Build status: STARTED
[22:35:22.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:34:0) after 4m6s
[22:39:28.891] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:34:0)
[22:39:28.923] Build status: STARTED
[22:39:28.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:35:0) after 4m55s
[22:44:24.418] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:35:0)
[22:44:24.479] Build status: STARTED
[22:44:24.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:36:0) after 7m24s
[22:51:48.758] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:36:0)
[22:51:48.827] Build status: STARTED
[22:51:48.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:37:0) after 8m50s
[23:00:38.868] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:37:0)
[23:00:38.891] Build status: STARTED
[23:00:38.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:38:0) after 7m25s
[23:08:03.993] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:38:0)
[23:08:04.010] Build status: STARTED
[23:08:04.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:39:0) after 3m17s
[23:11:21.042] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:39:0)
[23:11:21.063] Build status: STARTED
[23:11:21.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:40:0) after 7m2s
[23:18:23.165] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:40:0)
[23:18:23.215] Build status: STARTED
[23:18:23.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:41:0) after 2m33s
[23:20:56.257] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:41:0)
[23:20:56.296] Build status: STARTED
[23:20:56.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:42:0) after 8m17s
[23:29:13.330] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:42:0)
[23:29:13.358] Build status: STARTED
[23:29:13.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:43:0) after 1m56s
[23:31:09.406] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:43:0)
[23:31:09.472] Build status: STARTED
[23:31:09.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:44:0) after 2m2s
[23:33:11.527] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:44:0)
[23:33:11.552] Build status: STARTED
[23:33:11.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:45:0) after 7m49s
[23:41:00.600] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:45:0)
[23:41:00.687] Build status: STARTED
[23:41:00.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:46:0) after 5m53s
[23:46:53.669] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:46:0)
[23:46:53.688] Build status: STARTED
[23:46:53.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:47:0) after 4m22s
[23:51:15.716] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:47:0)
[23:51:15.743] Build status: STARTED
[23:51:15.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:48:0) after 3m44s
[23:54:59.841] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:48:0)
[23:54:59.866] Build status: STARTED
[23:54:59.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:49:0) after 9m56s
[00:04:56.005] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:49:0)
[00:04:56.046] Build status: STARTED
[00:04:56.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:50:0) after 7m48s
[00:12:44.080] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:50:0)
[00:12:44.104] Build status: STARTED
[00:12:44.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:51:0) after 6m14s
[00:18:58.157] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:51:0)
[00:18:58.189] Build status: STARTED
[00:18:58.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:52:0) after 9m8s
[00:28:06.628] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:52:0)
[00:28:06.656] Build status: STARTED
[00:28:06.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:53:0) after 4m49s
[00:32:55.687] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:53:0)
[00:32:55.713] Build status: STARTED
[00:32:55.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:54:0) after 8m27s
[00:41:22.907] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:54:0)
[00:41:22.932] Build status: STARTED
[00:41:22.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:55:0) after 9m39s
[00:51:02.016] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:55:0)
[00:51:02.116] Build status: STARTED
[00:51:02.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:56:0) after 6m52s
[00:57:54.438] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:56:0)
[00:57:54.461] Build status: STARTED
[00:57:54.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:57:0) after 2m46s
[01:00:41.368] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:57:0)
[01:00:41.409] Build status: STARTED
[01:00:41.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:58:0) after 5m51s
[01:06:32.617] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:58:0)
[01:06:32.653] Build status: STARTED
[01:06:32.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:59:0) after 2m53s
[01:09:25.695] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:59:0)
[01:09:25.741] Build status: STARTED
[01:09:25.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:60:0) after 2m43s
[01:12:08.942] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:60:0)
[01:12:08.992] Build status: STARTED
[01:12:08.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:61:0) after 6m40s
[01:18:49.087] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:61:0)
[01:18:49.134] Build status: STARTED
[01:18:49.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:62:0) after 9m30s
[01:28:19.167] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:62:0)
[01:28:19.187] Build status: STARTED
[01:28:19.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:63:0) after 4m28s
[01:32:47.324] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:63:0)
[01:32:47.348] Build status: STARTED
[01:32:47.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:64:0) after 4m22s
[01:37:09.463] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:64:0)
[01:37:09.482] Build status: STARTED
[01:37:09.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:65:0) after 2m34s
[01:39:43.516] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:65:0)
[01:39:43.598] Build status: STARTED
[01:39:43.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:66:0) after 3m55s
[01:43:38.596] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:66:0)
[01:43:38.622] Build status: STARTED
[01:43:38.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:67:0) after 1m46s
[01:45:24.653] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:67:0)
[01:45:24.677] Build status: STARTED
[01:45:24.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:68:0) after 8m11s
[01:53:35.762] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:68:0)
[01:53:35.823] Build status: STARTED
[01:53:35.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:69:0) after 8m42s
[02:02:17.910] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:69:0)
[02:02:17.928] Build status: STARTED
[02:02:17.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:70:0) after 3m51s
[02:06:09.135] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:70:0)
[02:06:09.168] Build status: STARTED
[02:06:09.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:71:0) after 1m14s
[02:07:23.213] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:71:0)
[02:07:23.239] Build status: STARTED
[02:07:23.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:72:0) after 6m8s
[02:13:31.277] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:72:0)
[02:13:31.375] Build status: STARTED
[02:13:31.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:73:0) after 5m39s
[02:19:10.598] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:73:0)
[02:19:10.623] Build status: STARTED
[02:19:10.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:74:0) after 4m26s
[02:23:36.771] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:74:0)
[02:23:36.829] Build status: STARTED
[02:23:36.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:75:0) after 4m20s
[02:27:56.934] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:75:0)
[02:27:56.956] Build status: STARTED
[02:27:56.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:76:0) after 8m11s
[02:36:08.005] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:76:0)
[02:36:08.025] Build status: STARTED
[02:36:08.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:77:0) after 9m49s
[02:45:57.242] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:77:0)
[02:45:57.270] Build status: STARTED
[02:45:57.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:78:0) after 9m15s
[02:55:12.488] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:78:0)
[02:55:12.525] Build status: STARTED
[02:55:12.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:79:0) after 5m52s
[03:01:04.586] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:79:0)
[03:01:04.628] Build status: STARTED
[03:01:04.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:80:0) after 7m23s
[03:08:27.777] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:80:0)
[03:08:27.816] Build status: STARTED
[03:08:27.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:81:0) after 5m24s
[03:13:51.863] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:81:0)
[03:13:51.892] Build status: STARTED
[03:13:51.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:82:0) after 9m38s
[03:23:29.967] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:82:0)
[03:23:29.996] Build status: STARTED
[03:23:29.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:83:0) after 8m33s
[03:32:03.131] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:83:0)
[03:32:03.154] Build status: STARTED
[03:32:03.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:84:0) after 2m36s
[03:34:39.355] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:84:0)
[03:34:39.378] Build status: STARTED
[03:34:39.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:85:0) after 9m2s
[03:43:41.417] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:85:0)
[03:43:41.441] Build status: STARTED
[03:43:41.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:86:0) after 2m36s
[03:46:17.521] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:86:0)
[03:46:17.544] Build status: STARTED
[03:46:17.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:87:0) after 9m37s
[03:55:54.582] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:87:0)
[03:55:54.603] Build status: STARTED
[03:55:54.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:88:0) after 4m38s
[04:00:32.635] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:88:0)
[04:00:32.656] Build status: STARTED
[04:00:32.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:89:0) after 6m2s
[04:06:34.695] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:89:0)
[04:06:34.725] Build status: STARTED
[04:06:34.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:90:0) after 6m44s
[04:13:18.821] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:90:0)
[04:13:18.840] Build status: STARTED
[04:13:18.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:91:0) after 9m27s
[04:22:45.934] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:91:0)
[04:22:45.965] Build status: STARTED
[04:22:45.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:92:0) after 1m4s
[04:23:50.001] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:92:0)
[04:23:50.019] Build status: STARTED
[04:23:50.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:93:0) after 4m2s
[04:27:52.015] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:93:0)
[04:27:52.048] Build status: STARTED
[04:27:52.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:94:0) after 7m16s
[04:35:08.172] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:94:0)
[04:35:08.231] Build status: STARTED
[04:35:08.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:95:0) after 2m14s
[04:37:22.272] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:95:0)
[04:37:22.322] Build status: STARTED
[04:37:22.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:96:0) after 2m12s
[04:39:34.468] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:96:0)
[04:39:34.498] Build status: STARTED
[04:39:34.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:97:0) after 5m29s
[04:45:03.539] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:97:0)
[04:45:03.565] Build status: STARTED
[04:45:03.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:98:0) after 9m23s
[04:54:26.621] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:98:0)
[04:54:26.838] Build status: STARTED
[04:54:26.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:99:0) after 1m38s
[04:56:04.874] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:99:0)
[04:56:04.894] Build status: STARTED
[04:56:04.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:100:0) after 9m36s
[05:05:40.996] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:100:0)
[05:05:41.013] Build status: STARTED
[05:05:41.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:101:0) after 4m22s
[05:10:03.095] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:101:0)
[05:10:03.131] Build status: STARTED
[05:10:03.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:102:0) after 8m22s
[05:18:25.400] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:102:0)
[05:18:25.458] Build status: STARTED
[05:18:25.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:103:0) after 1m38s
[05:20:03.653] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:103:0)
[05:20:03.730] Build status: STARTED
[05:20:03.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:104:0) after 4m28s
[05:24:31.820] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:104:0)
[05:24:31.841] Build status: STARTED
[05:24:31.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:105:0) after 2m56s
[05:27:27.907] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:105:0)
[05:27:27.924] Build status: STARTED
[05:27:27.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:106:0) after 8m13s
[05:35:40.988] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:106:0)
[05:35:41.047] Build status: STARTED
[05:35:41.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:107:0) after 9m58s
[05:45:39.092] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:107:0)
[05:45:39.111] Build status: STARTED
[05:45:39.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:108:0) after 8m12s
[05:53:51.153] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:108:0)
[05:53:51.172] Build status: STARTED
[05:53:51.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:109:0) after 1m39s
[05:55:30.286] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:109:0)
[05:55:30.306] Build status: STARTED
[05:55:30.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:110:0) after 1m21s
[05:56:51.341] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:110:0)
[05:56:51.416] Build status: STARTED
[05:56:51.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:111:0) after 9m14s
[06:06:05.533] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:111:0)
[06:06:05.555] Build status: STARTED
[06:06:05.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:112:0) after 3m33s
[06:09:38.585] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:112:0)
[06:09:38.620] Build status: STARTED
[06:09:38.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:113:0) after 8m42s
[06:18:20.800] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:113:0)
[06:18:20.821] Build status: STARTED
[06:18:20.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:114:0) after 5m21s
[06:23:41.973] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:114:0)
[06:23:42.028] Build status: STARTED
[06:23:42.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:115:0) after 9m38s
[06:33:20.158] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:115:0)
[06:33:20.187] Build status: STARTED
[06:33:20.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:116:0) after 4m51s
[06:38:11.327] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:116:0)
[06:38:11.351] Build status: STARTED
[06:38:11.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:117:0) after 4m52s
[06:43:03.401] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:117:0)
[06:43:03.618] Build status: STARTED
[06:43:03.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:118:0) after 7m34s
[06:50:37.767] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:118:0)
[06:50:37.807] Build status: STARTED
[06:50:37.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:119:0) after 3m26s
[06:54:03.847] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:119:0)
[06:54:03.869] Build status: STARTED
[06:54:03.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:120:0) after 4m33s
[06:58:37.006] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:120:0)
[06:58:37.026] Build status: STARTED
[06:58:37.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:121:0) after 6m10s
[07:04:47.068] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:121:0)
[07:04:47.089] Build status: STARTED
[07:04:47.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:122:0) after 7m3s
[07:11:50.134] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:122:0)
[07:11:50.193] Build status: STARTED
[07:11:50.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:123:0) after 6m57s
[07:18:47.223] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:123:0)
[07:18:47.248] Build status: STARTED
[07:18:47.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:124:0) after 1m44s
[07:20:31.461] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:124:0)
[07:20:31.626] Build status: STARTED
[07:20:31.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:125:0) after 5m35s
[07:26:06.872] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:125:0)
[07:26:06.905] Build status: STARTED
[07:26:06.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:126:0) after 5m37s
[07:31:43.948] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:126:0)
[07:31:43.968] Build status: STARTED
[07:31:43.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:127:0) after 7m6s
[07:38:50.005] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:127:0)
[07:38:50.075] Build status: STARTED
[07:38:50.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:128:0) after 1m25s
[07:40:15.079] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:128:0)
[07:40:15.102] Build status: STARTED
[07:40:15.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:129:0) after 1m39s
[07:41:54.219] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:129:0)
[07:41:54.237] Build status: STARTED
[07:41:54.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:130:0) after 6m57s
[07:48:51.279] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:130:0)
[07:48:51.328] Build status: STARTED
[07:48:51.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:131:0) after 4m9s
[07:53:00.558] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:131:0)
[07:53:00.596] Build status: STARTED
[07:53:00.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:132:0) after 8m21s
[08:01:21.701] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:132:0)
[08:01:21.727] Build status: STARTED
[08:01:21.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:133:0) after 5m13s
[08:06:34.740] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:133:0)
[08:06:34.761] Build status: STARTED
[08:06:34.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:134:0) after 1m54s
[08:08:28.815] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:134:0)
[08:08:28.832] Build status: STARTED
[08:08:28.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:135:0) after 4m56s
[08:13:24.862] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:135:0)
[08:13:24.899] Build status: STARTED
[08:13:24.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:136:0) after 4m17s
[08:17:41.948] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:136:0)
[08:17:41.970] Build status: STARTED
[08:17:41.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:137:0) after 4m50s
[08:22:32.005] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:137:0)
[08:22:32.025] Build status: STARTED
[08:22:32.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:138:0) after 8m6s
[08:30:38.221] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:138:0)
[08:30:38.242] Build status: STARTED
[08:30:38.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:139:0) after 6m29s
[08:37:07.362] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:139:0)
[08:37:07.383] Build status: STARTED
[08:37:07.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:140:0) after 8m57s
[08:46:04.435] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:140:0)
[08:46:04.455] Build status: STARTED
[08:46:04.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:141:0) after 1m39s
[08:47:43.575] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:141:0)
[08:47:43.610] Build status: STARTED
[08:47:43.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:142:0) after 5m6s
[08:52:49.638] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:142:0)
[08:52:49.732] Build status: STARTED
[08:52:49.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:143:0) after 3m48s
[08:56:37.868] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:143:0)
[08:56:37.889] Build status: STARTED
[08:56:37.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:144:0) after 2m35s
[08:59:12.923] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:144:0)
[08:59:12.974] Build status: STARTED
[08:59:12.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:145:0) after 8m25s
[09:07:38.064] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:145:0)
[09:07:38.086] Build status: STARTED
[09:07:38.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:146:0) after 9m2s
[09:16:40.341] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:146:0)
[09:16:40.360] Build status: STARTED
[09:16:40.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:147:0) after 1m9s
[09:17:49.410] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:147:0)
[09:17:49.430] Build status: STARTED
[09:17:49.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:148:0) after 3m5s
[09:20:54.456] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:148:0)
[09:20:54.496] Build status: STARTED
[09:20:54.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:149:0) after 5m13s
[09:26:07.504] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:149:0)
[09:26:07.534] Build status: STARTED
[09:26:07.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:150:0) after 4m39s
[09:30:46.629] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:150:0)
[09:30:46.665] Build status: STARTED
[09:30:46.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:151:0) after 3m33s
[09:34:19.696] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:151:0)
[09:34:19.757] Build status: STARTED
[09:34:19.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:152:0) after 5m55s
[09:40:14.832] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:152:0)
[09:40:14.850] Build status: STARTED
[09:40:14.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:153:0) after 9m17s
[09:49:32.275] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:153:0)
[09:49:32.292] Build status: STARTED
[09:49:32.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:154:0) after 4m12s
[09:53:44.333] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:154:0)
[09:53:44.377] Build status: STARTED
[09:53:44.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:155:0) after 5m4s
[09:58:48.435] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:155:0)
[09:58:48.452] Build status: STARTED
[09:58:48.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:156:0) after 5m40s
[10:04:28.580] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:156:0)
[10:04:28.609] Build status: STARTED
[10:04:28.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:157:0) after 5m34s
[10:10:02.655] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:157:0)
[10:10:02.673] Build status: STARTED
[10:10:02.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:158:0) after 2m17s
[10:12:19.788] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:158:0)
[10:12:19.810] Build status: STARTED
[10:12:19.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:159:0) after 4m10s
[10:16:29.895] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:159:0)
[10:16:29.931] Build status: STARTED
[10:16:29.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:160:0) after 2m0s
[10:18:30.133] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:160:0)
[10:18:30.156] Build status: STARTED
[10:18:30.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:161:0) after 3m28s
[10:21:58.211] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:161:0)
[10:21:58.232] Build status: STARTED
[10:21:58.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:162:0) after 4m9s
[10:26:07.259] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:162:0)
[10:26:07.277] Build status: STARTED
[10:26:07.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:163:0) after 1m30s
[10:27:37.389] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:163:0)
[10:27:37.409] Build status: STARTED
[10:27:37.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:164:0) after 2m33s
[10:30:10.472] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:164:0)
[10:30:10.495] Build status: STARTED
[10:30:10.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:165:0) after 3m41s
[10:33:51.636] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:165:0)
[10:33:51.654] Build status: STARTED
[10:33:51.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:166:0) after 6m27s
[10:40:18.690] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:166:0)
[10:40:18.709] Build status: STARTED
[10:40:18.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:167:0) after 5m1s
[10:45:19.762] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:167:0)
[10:45:19.783] Build status: STARTED
[10:45:19.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:168:0) after 2m52s
[10:48:11.790] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:168:0)
[10:48:11.838] Build status: STARTED
[10:48:11.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:169:0) after 6m29s
[10:54:40.958] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:169:0)
[10:54:40.987] Build status: STARTED
[10:54:40.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:170:0) after 2m17s
[10:56:58.019] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:170:0)
[10:56:58.069] Build status: STARTED
[10:56:58.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:171:0) after 9m28s
[11:06:26.220] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:171:0)
[11:06:26.246] Build status: STARTED
[11:06:26.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:172:0) after 4m12s
[11:10:38.277] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:172:0)
[11:10:38.301] Build status: STARTED
[11:10:38.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:173:0) after 9m49s
[11:20:28.089] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:173:0)
[11:20:28.114] Build status: STARTED
[11:20:28.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:174:0) after 8m43s
[11:29:11.266] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:174:0)
[11:29:11.304] Build status: STARTED
[11:29:11.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:175:0) after 3m1s
[11:32:12.382] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:175:0)
[11:32:12.406] Build status: STARTED
[11:32:12.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:176:0) after 2m56s
[11:35:08.698] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:176:0)
[11:35:08.724] Build status: STARTED
[11:35:08.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:177:0) after 8m9s
[11:43:17.807] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:177:0)
[11:43:17.824] Build status: STARTED
[11:43:17.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:178:0) after 5m6s
[11:48:23.866] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:178:0)
[11:48:23.886] Build status: STARTED
[11:48:23.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:179:0) after 2m25s
[11:50:49.185] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:179:0)
[11:50:49.207] Build status: STARTED
[11:50:49.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:180:0) after 5m24s
[11:56:13.474] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:180:0)
[11:56:13.497] Build status: STARTED
[11:56:13.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:181:0) after 1m48s
[11:58:01.549] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:181:0)
[11:58:01.581] Build status: STARTED
[11:58:01.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:182:0) after 9m50s
[12:07:51.585] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:182:0)
[12:07:51.605] Build status: STARTED
[12:07:51.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:183:0) after 4m9s
[12:12:00.911] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:183:0)
[12:12:00.934] Build status: STARTED
[12:12:00.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:184:0) after 1m35s
[12:13:35.967] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:184:0)
[12:13:35.985] Build status: STARTED
[12:13:35.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:185:0) after 9m28s
[12:23:04.071] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:185:0)
[12:23:04.090] Build status: STARTED
[12:23:04.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:186:0) after 3m24s
[12:26:28.147] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:186:0)
[12:26:28.170] Build status: STARTED
[12:26:28.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:187:0) after 8m18s
[12:34:46.234] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:187:0)
[12:34:46.261] Build status: STARTED
[12:34:46.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:188:0) after 8m35s
[12:43:21.283] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:188:0)
[12:43:21.302] Build status: STARTED
[12:43:21.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:189:0) after 4m13s
[12:47:34.520] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:189:0)
[12:47:34.546] Build status: STARTED
[12:47:34.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:190:0) after 3m43s
[12:51:17.873] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:190:0)
[12:51:17.893] Build status: STARTED
[12:51:17.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:191:0) after 4m9s
[12:55:26.950] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:191:0)
[12:55:27.028] Build status: STARTED
[12:55:27.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:192:0) after 1m48s
[12:57:15.072] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:192:0)
[12:57:15.095] Build status: STARTED
[12:57:15.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:193:0) after 3m35s
[13:00:50.127] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:193:0)
[13:00:50.157] Build status: STARTED
[13:00:50.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:194:0) after 4m13s
[13:05:03.192] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:194:0)
[13:05:03.228] Build status: STARTED
[13:05:03.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:195:0) after 3m6s
[13:08:09.444] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:195:0)
[13:08:09.466] Build status: STARTED
[13:08:09.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:196:0) after 3m33s
[13:11:42.591] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:196:0)
[13:11:42.613] Build status: STARTED
[13:11:42.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:197:0) after 4m6s
[13:15:49.143] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:197:0)
[13:15:49.182] Build status: STARTED
[13:15:49.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:198:0) after 9m13s
[13:25:02.333] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:198:0)
[13:25:02.375] Build status: STARTED
[13:25:02.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:199:0) after 4m49s
[13:29:51.438] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:199:0)
[13:29:51.477] Build status: STARTED
[13:29:51.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:200:0) after 4m20s
[13:34:11.529] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:200:0)
[13:34:11.681] Build status: STARTED
[13:34:11.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:201:0) after 7m0s
[13:41:11.774] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:201:0)
[13:41:11.858] Build status: STARTED
[13:41:11.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:202:0) after 7m28s
[13:48:40.078] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:202:0)
[13:48:40.110] Build status: STARTED
[13:48:40.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:203:0) after 7m14s
[13:55:54.204] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:203:0)
[13:55:54.250] Build status: STARTED
[13:55:54.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:204:0) after 6m1s
[14:01:55.297] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:204:0)
[14:01:55.315] Build status: STARTED
[14:01:55.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:205:0) after 5m11s
[14:07:06.348] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:205:0)
[14:07:06.369] Build status: STARTED
[14:07:06.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:206:0) after 4m10s
[14:11:16.546] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:206:0)
[14:11:16.700] Build status: STARTED
[14:11:16.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:207:0) after 2m38s
[14:13:54.750] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:207:0)
[14:13:54.810] Build status: STARTED
[14:13:54.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:208:0) after 3m49s
[14:17:43.893] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:208:0)
[14:17:43.911] Build status: STARTED
[14:17:43.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:209:0) after 2m10s
[14:19:53.950] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:209:0)
[14:19:53.974] Build status: STARTED
[14:19:53.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:210:0) after 3m25s
[14:23:19.005] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:210:0)
[14:23:19.029] Build status: STARTED
[14:23:19.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:211:0) after 5m44s
[14:29:03.099] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:211:0)
[14:29:03.121] Build status: STARTED
[14:29:03.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:212:0) after 2m17s
[14:31:20.155] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:212:0)
[14:31:20.179] Build status: STARTED
[14:31:20.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:213:0) after 7m31s
[14:38:51.224] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:213:0)
[14:38:51.266] Build status: STARTED
[14:38:51.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:214:0) after 8m47s
[14:47:38.318] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:214:0)
[14:47:38.365] Build status: STARTED
[14:47:38.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:215:0) after 6m51s
[14:54:29.434] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:215:0)
[14:54:29.476] Build status: STARTED
[14:54:29.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:216:0) after 1m5s
[14:55:34.563] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:216:0)
[14:55:34.584] Build status: STARTED
[14:55:34.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:217:0) after 2m15s
[14:57:50.006] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:217:0)
[14:57:50.036] Build status: STARTED
[14:57:50.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:218:0) after 5m16s
[15:03:06.216] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:218:0)
[15:03:06.234] Build status: STARTED
[15:03:06.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:219:0) after 6m3s
[15:09:09.354] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:219:0)
[15:09:09.374] Build status: STARTED
[15:09:09.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:220:0) after 9m2s
[15:18:11.495] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:220:0)
[15:18:11.514] Build status: STARTED
[15:18:11.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:221:0) after 2m59s
[15:21:10.590] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:221:0)
[15:21:10.609] Build status: STARTED
[15:21:10.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:222:0) after 7m11s
[15:28:21.671] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:222:0)
[15:28:21.706] Build status: STARTED
[15:28:21.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:223:0) after 3m11s
[15:31:32.750] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:223:0)
[15:31:32.769] Build status: STARTED
[15:31:32.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:224:0) after 2m20s
[15:33:52.973] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:224:0)
[15:33:53.066] Build status: STARTED
[15:33:53.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:225:0) after 8m34s
[15:42:27.102] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:225:0)
[15:42:27.123] Build status: STARTED
[15:42:27.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:226:0) after 9m49s
[15:52:16.121] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:226:0)
[15:52:16.166] Build status: STARTED
[15:52:16.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:227:0) after 2m13s
[15:54:29.407] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:227:0)
[15:54:29.430] Build status: STARTED
[15:54:29.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8930215932487819920:228:0) after 9m56s
[15:54:41.592] Received PubSub notification, asking Buildbucket for the build status
[15:54:41.616] Build:
{
"id": "8764785870256690305",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 30760,
"createdBy": "project:chromium",
"createTime": "2023-11-10T19:50:48.943998301Z",
"startTime": "2023-11-10T19:50:49.965695Z",
"endTime": "2023-11-11T15:54:40.878175Z",
"updateTime": "2023-11-11T15:54:40.878175Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "091f8abf85df221a98b8a5a75360b9cf1f6a9979",
"ref": "refs/heads/main"
}
}
}
[15:54:41.616] Invocation finished in 20h3m54.183866063s with status FAILED