[07:57:21.370] New invocation is queued and will start shortly
[07:57:22.606] Starting the invocation (attempt 1)
[07:57:22.632] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/8d109251bf7e4497c8aa517748c50392e88f4a0f"
[07:57:22.632] Popped gitiles commit info from properties and tags
[07:57:22.632] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:57:22.632] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:57:22.632] Buildbucket request:
{
"requestId": "8918573809236620048",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8d109251bf7e4497c8aa517748c50392e88f4a0f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8918573809236620048"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:57:23.349] Scheduled build:
{
"id": "8753143747163268129",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 31443,
"createdBy": "project:chromium",
"createTime": "2024-03-18T07:57:22.726404484Z",
"updateTime": "2024-03-18T07:57:22.726404484Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8d109251bf7e4497c8aa517748c50392e88f4a0f",
"ref": "refs/heads/main"
}
}
}
[07:57:23.349] Task URL: https://cr-buildbucket.appspot.com/build/8753143747163268129
[07:57:23.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:2:0) after 8m49s
[07:57:24.283] Received PubSub notification, asking Buildbucket for the build status
[07:57:24.303] Build status: SCHEDULED
[07:57:28.753] Received PubSub notification, asking Buildbucket for the build status
[07:57:28.772] Build status: STARTED
[08:06:12.727] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:2:0)
[08:06:12.794] Build status: STARTED
[08:06:12.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:5:0) after 6m12s
[08:12:25.054] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:5:0)
[08:12:25.086] Build status: STARTED
[08:12:25.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:6:0) after 7m14s
[08:19:39.225] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:6:0)
[08:19:39.240] Build status: STARTED
[08:19:39.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:7:0) after 2m40s
[08:22:19.689] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:7:0)
[08:22:19.735] Build status: STARTED
[08:22:19.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:8:0) after 3m36s
[08:25:55.879] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:8:0)
[08:25:55.898] Build status: STARTED
[08:25:55.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:9:0) after 4m18s
[08:30:14.014] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:9:0)
[08:30:14.040] Build status: STARTED
[08:30:14.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:10:0) after 2m46s
[08:33:00.257] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:10:0)
[08:33:00.273] Build status: STARTED
[08:33:00.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:11:0) after 1m7s
[08:34:07.366] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:11:0)
[08:34:07.392] Build status: STARTED
[08:34:07.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:12:0) after 8m41s
[08:42:48.438] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:12:0)
[08:42:48.510] Build status: STARTED
[08:42:48.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:13:0) after 8m48s
[08:51:36.553] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:13:0)
[08:51:36.610] Build status: STARTED
[08:51:36.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:14:0) after 1m21s
[08:52:57.713] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:14:0)
[08:52:57.735] Build status: STARTED
[08:52:57.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:15:0) after 3m13s
[08:56:10.906] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:15:0)
[08:56:10.923] Build status: STARTED
[08:56:10.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:16:0) after 4m47s
[09:00:57.953] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:16:0)
[09:00:58.089] Build status: STARTED
[09:00:58.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:17:0) after 9m15s
[09:10:13.316] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:17:0)
[09:10:13.515] Build status: STARTED
[09:10:13.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:18:0) after 2m59s
[09:13:12.744] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:18:0)
[09:13:12.779] Build status: STARTED
[09:13:12.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:19:0) after 7m15s
[09:20:27.913] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:19:0)
[09:20:27.935] Build status: STARTED
[09:20:27.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:20:0) after 8m47s
[09:29:15.156] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:20:0)
[09:29:15.256] Build status: STARTED
[09:29:15.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:21:0) after 8m4s
[09:37:19.287] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:21:0)
[09:37:19.362] Build status: STARTED
[09:37:19.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:22:0) after 5m19s
[09:42:38.385] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:22:0)
[09:42:38.406] Build status: STARTED
[09:42:38.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:23:0) after 7m28s
[09:50:06.767] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:23:0)
[09:50:06.836] Build status: STARTED
[09:50:06.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:24:0) after 2m44s
[09:52:51.283] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:24:0)
[09:52:51.298] Build status: STARTED
[09:52:51.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:25:0) after 6m48s
[09:59:39.461] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:25:0)
[09:59:39.551] Build status: STARTED
[09:59:39.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:26:0) after 7m26s
[10:07:05.662] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:26:0)
[10:07:05.698] Build status: STARTED
[10:07:05.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:27:0) after 7m14s
[10:14:19.894] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:27:0)
[10:14:19.912] Build status: STARTED
[10:14:19.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:28:0) after 3m0s
[10:17:20.109] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:28:0)
[10:17:20.158] Build status: STARTED
[10:17:20.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:29:0) after 4m16s
[10:21:36.525] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:29:0)
[10:21:36.541] Build status: STARTED
[10:21:36.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:30:0) after 6m38s
[10:28:14.745] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:30:0)
[10:28:14.899] Build status: STARTED
[10:28:14.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:31:0) after 3m10s
[10:31:25.055] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:31:0)
[10:31:25.083] Build status: STARTED
[10:31:25.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:32:0) after 4m44s
[10:36:09.111] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:32:0)
[10:36:09.172] Build status: STARTED
[10:36:09.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:33:0) after 1m57s
[10:38:06.196] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:33:0)
[10:38:06.269] Build status: STARTED
[10:38:06.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:34:0) after 1m34s
[10:39:40.290] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:34:0)
[10:39:40.322] Build status: STARTED
[10:39:40.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:35:0) after 4m29s
[10:44:09.449] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:35:0)
[10:44:09.473] Build status: STARTED
[10:44:09.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:36:0) after 8m12s
[10:52:21.495] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:36:0)
[10:52:21.515] Build status: STARTED
[10:52:21.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:37:0) after 7m46s
[11:00:07.545] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:37:0)
[11:00:07.566] Build status: STARTED
[11:00:07.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:38:0) after 6m40s
[11:06:47.937] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:38:0)
[11:06:47.966] Build status: STARTED
[11:06:47.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:39:0) after 8m8s
[11:14:56.057] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:39:0)
[11:14:56.093] Build status: STARTED
[11:14:56.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:40:0) after 8m47s
[11:23:43.263] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:40:0)
[11:23:43.330] Build status: STARTED
[11:23:43.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:41:0) after 8m32s
[11:32:15.349] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:41:0)
[11:32:15.369] Build status: STARTED
[11:32:15.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:42:0) after 6m12s
[11:38:27.392] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:42:0)
[11:38:27.412] Build status: STARTED
[11:38:27.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:43:0) after 9m44s
[11:48:11.435] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:43:0)
[11:48:11.452] Build status: STARTED
[11:48:11.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:44:0) after 3m1s
[11:51:12.787] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:44:0)
[11:51:12.811] Build status: STARTED
[11:51:12.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:45:0) after 9m19s
[12:00:31.859] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:45:0)
[12:00:31.945] Build status: STARTED
[12:00:31.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:46:0) after 6m19s
[12:06:51.064] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:46:0)
[12:06:51.164] Build status: STARTED
[12:06:51.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:47:0) after 1m10s
[12:08:01.203] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:47:0)
[12:08:01.232] Build status: STARTED
[12:08:01.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:48:0) after 6m49s
[12:14:50.328] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:48:0)
[12:14:50.347] Build status: STARTED
[12:14:50.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:49:0) after 5m48s
[12:20:38.539] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:49:0)
[12:20:38.581] Build status: STARTED
[12:20:38.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:50:0) after 4m31s
[12:25:09.609] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:50:0)
[12:25:09.664] Build status: STARTED
[12:25:09.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:51:0) after 9m12s
[12:34:21.685] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:51:0)
[12:34:21.700] Build status: STARTED
[12:34:21.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:52:0) after 5m28s
[12:39:49.807] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:52:0)
[12:39:49.833] Build status: STARTED
[12:39:49.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:53:0) after 3m37s
[12:43:27.022] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:53:0)
[12:43:27.042] Build status: STARTED
[12:43:27.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:54:0) after 2m50s
[12:46:17.145] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:54:0)
[12:46:17.174] Build status: STARTED
[12:46:17.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:55:0) after 7m41s
[12:53:58.796] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:55:0)
[12:53:58.870] Build status: STARTED
[12:53:58.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:56:0) after 7m49s
[13:01:47.987] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:56:0)
[13:01:48.023] Build status: STARTED
[13:01:48.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:57:0) after 9m30s
[13:11:18.044] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:57:0)
[13:11:18.066] Build status: STARTED
[13:11:18.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:58:0) after 2m4s
[13:13:22.094] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:58:0)
[13:13:22.166] Build status: STARTED
[13:13:22.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:59:0) after 8m38s
[13:22:00.198] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:59:0)
[13:22:00.224] Build status: STARTED
[13:22:00.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:60:0) after 1m45s
[13:23:45.255] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:60:0)
[13:23:45.277] Build status: STARTED
[13:23:45.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:61:0) after 6m15s
[13:30:00.822] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:61:0)
[13:30:00.853] Build status: STARTED
[13:30:00.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:62:0) after 4m42s
[13:34:42.987] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:62:0)
[13:34:43.009] Build status: STARTED
[13:34:43.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:63:0) after 5m37s
[13:40:20.196] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:63:0)
[13:40:20.227] Build status: STARTED
[13:40:20.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:64:0) after 4m51s
[13:45:11.555] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:64:0)
[13:45:11.577] Build status: STARTED
[13:45:11.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:65:0) after 9m58s
[13:55:09.597] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:65:0)
[13:55:09.619] Build status: STARTED
[13:55:09.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:66:0) after 8m9s
[14:03:18.709] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:66:0)
[14:03:18.734] Build status: STARTED
[14:03:18.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:67:0) after 1m5s
[14:04:23.922] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:67:0)
[14:04:23.961] Build status: STARTED
[14:04:23.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:68:0) after 6m44s
[14:11:08.207] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:68:0)
[14:11:08.251] Build status: STARTED
[14:11:08.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:69:0) after 4m48s
[14:15:56.421] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:69:0)
[14:15:56.436] Build status: STARTED
[14:15:56.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:70:0) after 5m1s
[14:20:57.740] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:70:0)
[14:20:57.763] Build status: STARTED
[14:20:57.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:71:0) after 7m33s
[14:28:31.052] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:71:0)
[14:28:31.076] Build status: STARTED
[14:28:31.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:72:0) after 7m6s
[14:35:37.210] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:72:0)
[14:35:37.276] Build status: STARTED
[14:35:37.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:73:0) after 4m36s
[14:40:13.925] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:73:0)
[14:40:13.949] Build status: STARTED
[14:40:13.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:74:0) after 3m9s
[14:43:23.432] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:74:0)
[14:43:23.474] Build status: STARTED
[14:43:23.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:75:0) after 6m16s
[14:49:39.521] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:75:0)
[14:49:39.537] Build status: STARTED
[14:49:39.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:76:0) after 8m6s
[14:57:45.890] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:76:0)
[14:57:45.914] Build status: STARTED
[14:57:45.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:77:0) after 9m22s
[15:07:08.741] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:77:0)
[15:07:08.773] Build status: STARTED
[15:07:08.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:78:0) after 5m6s
[15:12:14.817] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:78:0)
[15:12:14.843] Build status: STARTED
[15:12:14.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:79:0) after 1m57s
[15:14:11.863] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:79:0)
[15:14:11.929] Build status: STARTED
[15:14:11.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:80:0) after 4m58s
[15:19:09.981] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:80:0)
[15:19:10.054] Build status: STARTED
[15:19:10.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:81:0) after 5m37s
[15:24:47.227] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:81:0)
[15:24:47.249] Build status: STARTED
[15:24:47.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:82:0) after 9m23s
[15:34:10.353] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:82:0)
[15:34:10.390] Build status: STARTED
[15:34:10.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:83:0) after 7m58s
[15:42:08.412] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:83:0)
[15:42:08.434] Build status: STARTED
[15:42:08.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:84:0) after 1m52s
[15:44:00.458] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:84:0)
[15:44:00.527] Build status: STARTED
[15:44:00.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:85:0) after 7m17s
[15:51:17.617] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:85:0)
[15:51:17.637] Build status: STARTED
[15:51:17.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:86:0) after 4m14s
[15:55:31.678] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:86:0)
[15:55:31.751] Build status: STARTED
[15:55:31.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:87:0) after 5m26s
[16:00:57.835] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:87:0)
[16:00:57.937] Build status: STARTED
[16:00:57.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:88:0) after 5m33s
[16:06:31.041] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:88:0)
[16:06:31.069] Build status: STARTED
[16:06:31.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:89:0) after 4m29s
[16:11:00.185] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:89:0)
[16:11:00.236] Build status: STARTED
[16:11:00.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:90:0) after 2m42s
[16:13:42.272] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:90:0)
[16:13:42.298] Build status: STARTED
[16:13:42.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:91:0) after 4m19s
[16:18:29.780] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:91:0)
[16:18:29.810] Build status: STARTED
[16:18:29.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:92:0) after 2m16s
[16:20:45.878] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:92:0)
[16:20:45.915] Build status: STARTED
[16:20:45.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:93:0) after 3m22s
[16:24:07.994] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:93:0)
[16:24:08.039] Build status: STARTED
[16:24:08.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:94:0) after 9m55s
[16:34:03.191] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:94:0)
[16:34:03.221] Build status: STARTED
[16:34:03.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:95:0) after 9m8s
[16:43:24.842] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:95:0)
[16:43:24.870] Build status: STARTED
[16:43:24.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:96:0) after 6m8s
[16:49:32.893] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:96:0)
[16:49:32.982] Build status: STARTED
[16:49:32.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:97:0) after 1m55s
[16:51:28.053] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:97:0)
[16:51:28.089] Build status: STARTED
[16:51:28.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:98:0) after 9m17s
[17:00:45.190] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:98:0)
[17:00:45.215] Build status: STARTED
[17:00:45.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:99:0) after 9m56s
[17:10:41.309] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:99:0)
[17:10:41.339] Build status: STARTED
[17:10:41.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:100:0) after 3m31s
[17:14:12.420] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:100:0)
[17:14:12.446] Build status: STARTED
[17:14:12.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:101:0) after 4m25s
[17:18:37.489] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:101:0)
[17:18:37.515] Build status: STARTED
[17:18:37.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:102:0) after 7m45s
[17:26:22.581] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:102:0)
[17:26:22.620] Build status: STARTED
[17:26:22.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:103:0) after 8m27s
[17:34:49.645] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:103:0)
[17:34:49.711] Build status: STARTED
[17:34:49.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:104:0) after 6m20s
[17:41:09.750] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:104:0)
[17:41:09.774] Build status: STARTED
[17:41:09.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:105:0) after 4m22s
[17:45:31.844] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:105:0)
[17:45:31.869] Build status: STARTED
[17:45:31.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:106:0) after 9m4s
[17:54:35.899] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:106:0)
[17:54:35.929] Build status: STARTED
[17:54:35.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:107:0) after 9m11s
[18:03:47.021] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:107:0)
[18:03:47.053] Build status: STARTED
[18:03:47.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:108:0) after 8m48s
[18:12:35.088] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:108:0)
[18:12:35.182] Build status: STARTED
[18:12:35.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:109:0) after 3m55s
[18:16:30.226] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:109:0)
[18:16:30.245] Build status: STARTED
[18:16:30.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:110:0) after 2m20s
[18:18:50.294] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:110:0)
[18:18:50.424] Build status: STARTED
[18:18:50.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:111:0) after 4m21s
[18:23:11.522] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:111:0)
[18:23:11.558] Build status: STARTED
[18:23:11.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:112:0) after 2m9s
[18:25:20.593] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:112:0)
[18:25:20.669] Build status: STARTED
[18:25:20.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:113:0) after 3m32s
[18:28:52.653] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:113:0)
[18:28:52.698] Build status: STARTED
[18:28:52.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:114:0) after 4m56s
[18:33:48.757] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:114:0)
[18:33:48.784] Build status: STARTED
[18:33:48.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:115:0) after 7m34s
[18:41:22.820] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:115:0)
[18:41:22.866] Build status: STARTED
[18:41:22.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:116:0) after 3m41s
[18:45:03.950] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:116:0)
[18:45:03.971] Build status: STARTED
[18:45:03.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:117:0) after 2m11s
[18:47:15.002] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:117:0)
[18:47:15.055] Build status: STARTED
[18:47:15.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:118:0) after 1m17s
[18:48:32.088] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:118:0)
[18:48:32.115] Build status: STARTED
[18:48:32.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:119:0) after 4m7s
[18:52:39.179] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:119:0)
[18:52:39.195] Build status: STARTED
[18:52:39.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:120:0) after 7m39s
[19:00:18.218] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:120:0)
[19:00:18.244] Build status: STARTED
[19:00:18.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:121:0) after 8m32s
[19:08:50.279] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:121:0)
[19:08:50.312] Build status: STARTED
[19:08:50.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:122:0) after 2m47s
[19:11:37.337] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:122:0)
[19:11:37.354] Build status: STARTED
[19:11:37.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:123:0) after 9m59s
[19:21:36.356] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:123:0)
[19:21:36.374] Build status: STARTED
[19:21:36.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:124:0) after 5m46s
[19:27:22.391] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:124:0)
[19:27:22.446] Build status: STARTED
[19:27:22.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:125:0) after 2m6s
[19:29:28.470] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:125:0)
[19:29:28.572] Build status: STARTED
[19:29:28.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:126:0) after 9m17s
[19:38:45.604] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:126:0)
[19:38:45.623] Build status: STARTED
[19:38:45.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:127:0) after 9m45s
[19:48:30.674] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:127:0)
[19:48:30.698] Build status: STARTED
[19:48:30.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:128:0) after 2m31s
[19:51:01.801] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:128:0)
[19:51:01.824] Build status: STARTED
[19:51:01.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:129:0) after 6m26s
[19:57:27.922] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:129:0)
[19:57:27.962] Build status: STARTED
[19:57:27.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:130:0) after 2m22s
[19:59:50.046] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:130:0)
[19:59:50.076] Build status: STARTED
[19:59:50.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:131:0) after 6m47s
[20:06:37.107] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:131:0)
[20:06:37.136] Build status: STARTED
[20:06:37.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:132:0) after 6m11s
[20:12:48.217] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:132:0)
[20:12:48.238] Build status: STARTED
[20:12:48.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:133:0) after 8m9s
[20:20:57.287] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:133:0)
[20:20:57.311] Build status: STARTED
[20:20:57.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:134:0) after 3m18s
[20:24:15.343] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:134:0)
[20:24:15.379] Build status: STARTED
[20:24:15.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:135:0) after 4m10s
[20:28:25.409] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:135:0)
[20:28:25.444] Build status: STARTED
[20:28:25.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:136:0) after 5m30s
[20:33:55.447] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:136:0)
[20:33:55.471] Build status: STARTED
[20:33:55.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:137:0) after 6m18s
[20:40:13.555] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:137:0)
[20:40:13.573] Build status: STARTED
[20:40:13.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:138:0) after 3m13s
[20:43:26.601] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:138:0)
[20:43:26.619] Build status: STARTED
[20:43:26.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:139:0) after 4m32s
[20:47:58.805] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:139:0)
[20:47:58.880] Build status: STARTED
[20:47:58.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:140:0) after 5m37s
[20:53:36.003] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:140:0)
[20:53:36.024] Build status: STARTED
[20:53:36.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:141:0) after 3m40s
[20:57:16.108] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:141:0)
[20:57:16.224] Build status: STARTED
[20:57:16.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:142:0) after 6m35s
[21:03:51.257] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:142:0)
[21:03:51.350] Build status: STARTED
[21:03:51.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:143:0) after 6m25s
[21:10:16.437] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:143:0)
[21:10:16.463] Build status: STARTED
[21:10:16.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:144:0) after 2m18s
[21:12:34.539] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:144:0)
[21:12:34.574] Build status: STARTED
[21:12:34.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:145:0) after 1m9s
[21:13:43.649] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:145:0)
[21:13:43.748] Build status: STARTED
[21:13:43.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:146:0) after 2m10s
[21:15:53.800] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:146:0)
[21:15:53.829] Build status: STARTED
[21:15:53.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:147:0) after 5m7s
[21:21:00.903] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:147:0)
[21:21:00.928] Build status: STARTED
[21:21:00.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:148:0) after 1m48s
[21:22:48.959] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:148:0)
[21:22:48.979] Build status: STARTED
[21:22:48.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:149:0) after 9m17s
[21:32:06.093] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:149:0)
[21:32:06.116] Build status: STARTED
[21:32:06.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:150:0) after 3m45s
[21:35:51.148] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:150:0)
[21:35:51.172] Build status: STARTED
[21:35:51.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:151:0) after 2m10s
[21:38:01.256] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:151:0)
[21:38:01.277] Build status: STARTED
[21:38:01.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:152:0) after 2m9s
[21:40:10.316] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:152:0)
[21:40:10.411] Build status: STARTED
[21:40:10.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:153:0) after 1m53s
[21:42:03.534] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:153:0)
[21:42:03.581] Build status: STARTED
[21:42:03.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:154:0) after 6m54s
[21:48:57.614] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:154:0)
[21:48:57.634] Build status: STARTED
[21:48:57.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:155:0) after 7m21s
[21:56:18.681] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:155:0)
[21:56:18.721] Build status: STARTED
[21:56:18.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:156:0) after 3m58s
[22:00:16.749] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:156:0)
[22:00:16.799] Build status: STARTED
[22:00:16.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:157:0) after 1m29s
[22:01:45.857] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:157:0)
[22:01:49.323] Build status: STARTED
[22:01:49.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:158:0) after 4m11s
[22:06:00.367] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:158:0)
[22:06:00.833] Build status: STARTED
[22:06:00.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:159:0) after 3m28s
[22:09:28.912] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:159:0)
[22:09:28.937] Build status: STARTED
[22:09:28.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:160:0) after 7m43s
[22:17:12.029] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:160:0)
[22:17:12.119] Build status: STARTED
[22:17:12.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:161:0) after 2m59s
[22:20:11.617] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:161:0)
[22:20:11.651] Build status: STARTED
[22:20:11.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:162:0) after 3m1s
[22:23:12.707] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:162:0)
[22:23:12.735] Build status: STARTED
[22:23:12.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:163:0) after 6m42s
[22:29:54.772] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:163:0)
[22:29:54.809] Build status: STARTED
[22:29:54.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:164:0) after 2m7s
[22:32:01.834] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:164:0)
[22:32:01.861] Build status: STARTED
[22:32:01.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:165:0) after 8m23s
[22:40:24.903] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:165:0)
[22:40:24.923] Build status: STARTED
[22:40:24.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:166:0) after 7m29s
[22:47:53.950] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:166:0)
[22:47:53.971] Build status: STARTED
[22:47:53.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:167:0) after 3m38s
[22:51:32.411] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:167:0)
[22:51:32.428] Build status: STARTED
[22:51:32.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:168:0) after 6m53s
[22:58:25.595] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:168:0)
[22:58:25.639] Build status: STARTED
[22:58:25.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:169:0) after 4m17s
[23:02:42.734] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:169:0)
[23:02:42.757] Build status: STARTED
[23:02:42.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:170:0) after 1m32s
[23:04:14.872] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:170:0)
[23:04:14.892] Build status: STARTED
[23:04:14.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:171:0) after 4m49s
[23:09:04.016] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:171:0)
[23:09:04.033] Build status: STARTED
[23:09:04.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:172:0) after 4m23s
[23:13:27.341] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:172:0)
[23:13:27.420] Build status: STARTED
[23:13:27.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:173:0) after 9m27s
[23:22:54.399] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:173:0)
[23:22:54.423] Build status: STARTED
[23:22:54.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:174:0) after 3m4s
[23:25:58.488] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:174:0)
[23:25:58.509] Build status: STARTED
[23:25:58.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:175:0) after 3m10s
[23:29:08.724] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:175:0)
[23:29:09.243] Build status: STARTED
[23:29:09.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:176:0) after 4m42s
[23:33:51.268] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:176:0)
[23:33:51.292] Build status: STARTED
[23:33:51.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:177:0) after 3m41s
[23:37:32.388] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:177:0)
[23:37:32.434] Build status: STARTED
[23:37:32.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:178:0) after 9m16s
[23:46:48.542] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:178:0)
[23:46:48.565] Build status: STARTED
[23:46:48.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:179:0) after 9m18s
[23:56:06.592] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:179:0)
[23:56:06.615] Build status: STARTED
[23:56:06.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:180:0) after 9m31s
[00:05:37.860] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:180:0)
[00:05:37.889] Build status: STARTED
[00:05:37.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:181:0) after 6m20s
[00:11:58.025] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:181:0)
[00:11:58.048] Build status: STARTED
[00:11:58.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:182:0) after 2m14s
[00:14:12.094] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:182:0)
[00:14:12.139] Build status: STARTED
[00:14:12.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:183:0) after 2m51s
[00:17:03.647] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:183:0)
[00:17:03.668] Build status: STARTED
[00:17:03.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:184:0) after 6m26s
[00:23:29.690] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:184:0)
[00:23:29.710] Build status: STARTED
[00:23:29.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:185:0) after 6m22s
[00:29:51.731] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:185:0)
[00:29:51.822] Build status: STARTED
[00:29:51.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:186:0) after 6m20s
[00:36:11.937] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:186:0)
[00:36:11.974] Build status: STARTED
[00:36:11.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:187:0) after 5m7s
[00:41:19.020] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:187:0)
[00:41:19.044] Build status: STARTED
[00:41:19.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:188:0) after 9m29s
[00:50:48.067] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:188:0)
[00:50:48.087] Build status: STARTED
[00:50:48.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:189:0) after 1m43s
[00:52:31.117] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:189:0)
[00:52:31.368] Build status: STARTED
[00:52:31.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:190:0) after 2m9s
[00:54:40.691] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:190:0)
[00:54:40.708] Build status: STARTED
[00:54:40.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:191:0) after 1m52s
[00:56:32.837] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:191:0)
[00:56:32.922] Build status: STARTED
[00:56:32.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:192:0) after 3m48s
[01:00:21.427] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:192:0)
[01:00:21.545] Build status: STARTED
[01:00:21.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:193:0) after 7m56s
[01:08:17.717] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:193:0)
[01:08:17.737] Build status: STARTED
[01:08:17.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:194:0) after 7m57s
[01:16:14.977] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:194:0)
[01:16:14.995] Build status: STARTED
[01:16:14.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:195:0) after 6m1s
[01:22:16.152] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:195:0)
[01:22:16.170] Build status: STARTED
[01:22:16.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:196:0) after 2m43s
[01:24:59.296] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:196:0)
[01:24:59.316] Build status: STARTED
[01:24:59.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:197:0) after 2m23s
[01:27:22.389] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:197:0)
[01:27:22.471] Build status: STARTED
[01:27:22.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:198:0) after 8m3s
[01:35:25.496] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:198:0)
[01:35:25.575] Build status: STARTED
[01:35:25.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:199:0) after 2m52s
[01:38:17.687] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:199:0)
[01:38:17.707] Build status: STARTED
[01:38:17.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:200:0) after 6m48s
[01:45:05.732] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:200:0)
[01:45:05.765] Build status: STARTED
[01:45:05.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:201:0) after 3m22s
[01:48:27.796] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:201:0)
[01:48:27.870] Build status: STARTED
[01:48:27.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:202:0) after 2m42s
[01:51:09.997] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:202:0)
[01:51:10.018] Build status: STARTED
[01:51:10.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:203:0) after 7m59s
[01:59:09.402] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:203:0)
[01:59:09.428] Build status: STARTED
[01:59:09.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:204:0) after 5m23s
[02:04:32.494] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:204:0)
[02:04:32.519] Build status: STARTED
[02:04:32.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:205:0) after 8m9s
[02:12:41.587] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:205:0)
[02:12:41.614] Build status: STARTED
[02:12:41.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:206:0) after 6m52s
[02:19:33.745] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:206:0)
[02:19:33.764] Build status: STARTED
[02:19:33.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:207:0) after 1m17s
[02:20:50.813] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:207:0)
[02:20:50.859] Build status: STARTED
[02:20:50.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:208:0) after 2m51s
[02:23:42.015] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:208:0)
[02:23:42.050] Build status: STARTED
[02:23:42.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:209:0) after 5m53s
[02:29:35.151] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:209:0)
[02:29:35.170] Build status: STARTED
[02:29:35.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:210:0) after 1m0s
[02:30:35.282] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:210:0)
[02:30:35.306] Build status: STARTED
[02:30:35.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:211:0) after 5m6s
[02:35:41.472] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:211:0)
[02:35:41.489] Build status: STARTED
[02:35:41.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:212:0) after 7m6s
[02:42:47.714] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:212:0)
[02:42:47.734] Build status: STARTED
[02:42:47.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:213:0) after 9m59s
[02:52:46.948] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:213:0)
[02:52:46.968] Build status: STARTED
[02:52:46.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:214:0) after 1m15s
[02:54:01.997] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:214:0)
[02:54:02.031] Build status: STARTED
[02:54:02.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:215:0) after 9m35s
[03:03:37.325] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:215:0)
[03:03:37.364] Build status: STARTED
[03:03:37.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:216:0) after 4m42s
[03:08:19.397] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:216:0)
[03:08:19.436] Build status: STARTED
[03:08:19.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:217:0) after 4m9s
[03:12:28.585] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:217:0)
[03:12:28.787] Build status: STARTED
[03:12:28.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:218:0) after 2m39s
[03:15:07.921] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:218:0)
[03:15:08.075] Build status: STARTED
[03:15:08.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:219:0) after 5m16s
[03:20:24.099] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:219:0)
[03:20:24.135] Build status: STARTED
[03:20:24.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:220:0) after 9m28s
[03:29:52.162] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:220:0)
[03:29:52.201] Build status: STARTED
[03:29:52.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:221:0) after 8m39s
[03:38:31.184] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:221:0)
[03:38:31.209] Build status: STARTED
[03:38:31.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:222:0) after 5m6s
[03:43:37.208] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:222:0)
[03:43:37.227] Build status: STARTED
[03:43:37.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:223:0) after 8m54s
[03:52:31.250] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:223:0)
[03:52:31.270] Build status: STARTED
[03:52:31.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8918573809236620048:224:0) after 9m52s
[04:00:32.706] Received PubSub notification, asking Buildbucket for the build status
[04:00:32.725] Build:
{
"id": "8753143747163268129",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 31443,
"createdBy": "project:chromium",
"createTime": "2024-03-18T07:57:22.726404484Z",
"startTime": "2024-03-18T07:57:28.486565889Z",
"endTime": "2024-03-19T04:00:30.971016Z",
"updateTime": "2024-03-19T04:00:30.971016Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8d109251bf7e4497c8aa517748c50392e88f4a0f",
"ref": "refs/heads/main"
}
}
}
[04:00:32.725] Invocation finished in 20h3m11.360203945s with status FAILED