[19:49:04.816] New invocation is queued and will start shortly
[19:49:05.996] Starting the invocation (attempt 1)
[19:49:06.033] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a4b6a06b37e68606e7cf162797adf3379ae6d9ce"
[19:49:06.033] Popped gitiles commit info from properties and tags
[19:49:06.033] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:49:06.033] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:49:06.034] Buildbucket request:
{
"requestId": "9001515852663748384",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a4b6a06b37e68606e7cf162797adf3379ae6d9ce",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9001515852663748384"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:49:06.746] Scheduled build:
{
"id": "8836085790628953681",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 25491,
"createdBy": "project:chromium",
"createTime": "2021-09-14T19:49:06.122110080Z",
"updateTime": "2021-09-14T19:49:06.387129048Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a4b6a06b37e68606e7cf162797adf3379ae6d9ce",
"ref": "refs/heads/main"
}
}
}
[19:49:06.746] Task URL: https://cr-buildbucket.appspot.com/build/8836085790628953681
[19:49:06.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:2:0) after 9m53s
[19:52:34.089] Received PubSub notification, asking Buildbucket for the build status
[19:52:34.121] Build status: STARTED
[19:58:59.787] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:2:0)
[19:58:59.824] Build status: STARTED
[19:58:59.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:4:0) after 6m18s
[20:05:18.454] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:4:0)
[20:05:18.516] Build status: STARTED
[20:05:18.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:5:0) after 5m8s
[20:10:26.538] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:5:0)
[20:10:26.750] Build status: STARTED
[20:10:26.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:6:0) after 7m49s
[20:18:15.781] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:6:0)
[20:18:15.869] Build status: STARTED
[20:18:15.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:7:0) after 3m18s
[20:21:33.910] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:7:0)
[20:21:33.951] Build status: STARTED
[20:21:33.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:8:0) after 4m2s
[20:25:35.990] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:8:0)
[20:25:36.029] Build status: STARTED
[20:25:36.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:9:0) after 3m18s
[20:28:54.065] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:9:0)
[20:28:54.099] Build status: STARTED
[20:28:54.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:10:0) after 3m20s
[20:32:14.113] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:10:0)
[20:32:14.163] Build status: STARTED
[20:32:14.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:11:0) after 3m9s
[20:35:23.212] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:11:0)
[20:35:23.254] Build status: STARTED
[20:35:23.254] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:12:0) after 9m34s
[20:44:57.299] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:12:0)
[20:44:57.350] Build status: STARTED
[20:44:57.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:13:0) after 8m56s
[20:53:53.400] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:13:0)
[20:53:53.436] Build status: STARTED
[20:53:53.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:14:0) after 4m4s
[20:57:57.463] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:14:0)
[20:57:57.567] Build status: STARTED
[20:57:57.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:15:0) after 7m3s
[21:05:01.040] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:15:0)
[21:05:01.099] Build status: STARTED
[21:05:01.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:16:0) after 2m7s
[21:07:08.200] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:16:0)
[21:07:08.232] Build status: STARTED
[21:07:08.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:17:0) after 3m53s
[21:11:01.560] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:17:0)
[21:11:01.594] Build status: STARTED
[21:11:01.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:18:0) after 8m45s
[21:19:46.625] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:18:0)
[21:19:46.661] Build status: STARTED
[21:19:46.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:19:0) after 2m43s
[21:22:30.184] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:19:0)
[21:22:30.217] Build status: STARTED
[21:22:30.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:20:0) after 6m42s
[21:29:12.595] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:20:0)
[21:29:12.627] Build status: STARTED
[21:29:12.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:21:0) after 2m33s
[21:31:45.805] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:21:0)
[21:31:45.835] Build status: STARTED
[21:31:45.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:22:0) after 2m24s
[21:34:09.868] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:22:0)
[21:34:09.918] Build status: STARTED
[21:34:09.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:23:0) after 1m47s
[21:35:56.954] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:23:0)
[21:35:56.989] Build status: STARTED
[21:35:56.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:24:0) after 8m32s
[21:44:29.023] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:24:0)
[21:44:29.072] Build status: STARTED
[21:44:29.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:25:0) after 9m25s
[21:53:54.172] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:25:0)
[21:53:54.253] Build status: STARTED
[21:53:54.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:26:0) after 5m2s
[21:58:56.378] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:26:0)
[21:58:56.434] Build status: STARTED
[21:58:56.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:27:0) after 4m41s
[22:03:37.589] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:27:0)
[22:03:37.704] Build status: STARTED
[22:03:37.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:28:0) after 3m21s
[22:06:58.854] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:28:0)
[22:06:58.952] Build status: STARTED
[22:06:58.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:29:0) after 1m53s
[22:08:52.660] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:29:0)
[22:08:52.711] Build status: STARTED
[22:08:52.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:30:0) after 6m56s
[22:15:48.839] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:30:0)
[22:15:48.878] Build status: STARTED
[22:15:48.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:31:0) after 7m47s
[22:23:35.944] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:31:0)
[22:23:35.991] Build status: STARTED
[22:23:35.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:32:0) after 7m2s
[22:30:38.208] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:32:0)
[22:30:38.246] Build status: STARTED
[22:30:38.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:33:0) after 1m23s
[22:32:01.317] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:33:0)
[22:32:01.653] Build status: STARTED
[22:32:01.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:34:0) after 6m14s
[22:38:15.708] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:34:0)
[22:38:15.780] Build status: STARTED
[22:38:15.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:35:0) after 3m55s
[22:42:11.139] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:35:0)
[22:42:11.180] Build status: STARTED
[22:42:11.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:36:0) after 2m49s
[22:45:00.286] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:36:0)
[22:45:00.321] Build status: STARTED
[22:45:00.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:37:0) after 9m10s
[22:54:10.712] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:37:0)
[22:54:10.748] Build status: STARTED
[22:54:10.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:38:0) after 2m48s
[22:56:58.796] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:38:0)
[22:56:58.833] Build status: STARTED
[22:56:58.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:39:0) after 3m10s
[23:00:08.905] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:39:0)
[23:00:08.939] Build status: STARTED
[23:00:08.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:40:0) after 2m5s
[23:02:13.936] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:40:0)
[23:02:13.990] Build status: STARTED
[23:02:13.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:41:0) after 6m31s
[23:08:44.977] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:41:0)
[23:08:45.052] Build status: STARTED
[23:08:45.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:42:0) after 5m17s
[23:14:02.082] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:42:0)
[23:14:02.163] Build status: STARTED
[23:14:02.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:43:0) after 7m0s
[23:21:02.318] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:43:0)
[23:21:02.377] Build status: STARTED
[23:21:02.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:44:0) after 3m32s
[23:24:34.464] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:44:0)
[23:24:34.504] Build status: STARTED
[23:24:34.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:45:0) after 3m0s
[23:27:34.796] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:45:0)
[23:27:34.827] Build status: STARTED
[23:27:34.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:46:0) after 3m16s
[23:30:50.858] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:46:0)
[23:30:50.898] Build status: STARTED
[23:30:50.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:47:0) after 4m53s
[23:35:43.933] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:47:0)
[23:35:43.988] Build status: STARTED
[23:35:43.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:48:0) after 6m59s
[23:42:43.110] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:48:0)
[23:42:43.161] Build status: STARTED
[23:42:43.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:49:0) after 9m51s
[23:52:34.296] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:49:0)
[23:52:34.332] Build status: STARTED
[23:52:34.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:50:0) after 2m31s
[23:55:05.498] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:50:0)
[23:55:05.559] Build status: STARTED
[23:55:05.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:51:0) after 8m37s
[00:03:42.675] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:51:0)
[00:03:42.769] Build status: STARTED
[00:03:42.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:52:0) after 7m18s
[00:11:00.854] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:52:0)
[00:11:00.888] Build status: STARTED
[00:11:00.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:53:0) after 9m55s
[00:20:56.271] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:53:0)
[00:20:56.312] Build status: STARTED
[00:20:56.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:54:0) after 7m23s
[00:28:19.343] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:54:0)
[00:28:19.377] Build status: STARTED
[00:28:19.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:55:0) after 3m54s
[00:32:13.372] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:55:0)
[00:32:13.484] Build status: STARTED
[00:32:13.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:56:0) after 8m58s
[00:41:11.572] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:56:0)
[00:41:11.627] Build status: STARTED
[00:41:11.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:57:0) after 9m37s
[00:50:48.754] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:57:0)
[00:50:48.796] Build status: STARTED
[00:50:48.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:58:0) after 4m31s
[00:55:19.924] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:58:0)
[00:55:20.072] Build status: STARTED
[00:55:20.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:59:0) after 9m2s
[01:04:22.149] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:59:0)
[01:04:22.212] Build status: STARTED
[01:04:22.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:60:0) after 1m11s
[01:05:33.282] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:60:0)
[01:05:33.334] Build status: STARTED
[01:05:33.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:61:0) after 5m15s
[01:10:48.717] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:61:0)
[01:10:48.744] Build status: STARTED
[01:10:48.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:62:0) after 9m13s
[01:20:01.956] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:62:0)
[01:20:01.995] Build status: STARTED
[01:20:01.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:63:0) after 3m7s
[01:23:09.224] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:63:0)
[01:23:09.261] Build status: STARTED
[01:23:09.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:64:0) after 4m53s
[01:28:02.314] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:64:0)
[01:28:02.364] Build status: STARTED
[01:28:02.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:65:0) after 7m58s
[01:36:00.496] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:65:0)
[01:36:00.577] Build status: STARTED
[01:36:00.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:66:0) after 3m40s
[01:39:40.810] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:66:0)
[01:39:40.852] Build status: STARTED
[01:39:40.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:67:0) after 5m24s
[01:45:05.093] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:67:0)
[01:45:05.192] Build status: STARTED
[01:45:05.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:68:0) after 3m44s
[01:48:49.350] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:68:0)
[01:48:49.382] Build status: STARTED
[01:48:49.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:69:0) after 2m33s
[01:51:22.455] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:69:0)
[01:51:22.481] Build status: STARTED
[01:51:22.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:70:0) after 6m35s
[01:57:57.461] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:70:0)
[01:57:57.504] Build status: STARTED
[01:57:57.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:71:0) after 9m58s
[02:07:55.741] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:71:0)
[02:07:55.778] Build status: STARTED
[02:07:55.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:72:0) after 4m10s
[02:12:06.350] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:72:0)
[02:12:06.383] Build status: STARTED
[02:12:06.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:73:0) after 6m40s
[02:18:46.625] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:73:0)
[02:18:46.689] Build status: STARTED
[02:18:46.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:74:0) after 1m34s
[02:20:20.833] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:74:0)
[02:20:20.864] Build status: STARTED
[02:20:20.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:75:0) after 8m39s
[02:28:59.900] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:75:0)
[02:28:59.931] Build status: STARTED
[02:28:59.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:76:0) after 9m34s
[02:38:33.976] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:76:0)
[02:38:34.016] Build status: STARTED
[02:38:34.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:77:0) after 9m22s
[02:47:56.051] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:77:0)
[02:47:56.162] Build status: STARTED
[02:47:56.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:78:0) after 1m34s
[02:49:30.192] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:78:0)
[02:49:30.229] Build status: STARTED
[02:49:30.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:79:0) after 4m13s
[02:53:43.259] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:79:0)
[02:53:43.296] Build status: STARTED
[02:53:43.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:80:0) after 7m43s
[03:01:26.343] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:80:0)
[03:01:26.382] Build status: STARTED
[03:01:26.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:81:0) after 3m40s
[03:05:06.420] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:81:0)
[03:05:06.458] Build status: STARTED
[03:05:06.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:82:0) after 4m50s
[03:09:56.598] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:82:0)
[03:09:56.631] Build status: STARTED
[03:09:56.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:83:0) after 5m16s
[03:15:12.666] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:83:0)
[03:15:12.707] Build status: STARTED
[03:15:12.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:84:0) after 2m42s
[03:17:54.910] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:84:0)
[03:17:54.942] Build status: STARTED
[03:17:54.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:85:0) after 5m29s
[03:23:23.974] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:85:0)
[03:23:24.061] Build status: STARTED
[03:23:24.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:86:0) after 6m3s
[03:29:27.096] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:86:0)
[03:29:27.125] Build status: STARTED
[03:29:27.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:87:0) after 1m33s
[03:31:00.307] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:87:0)
[03:31:00.477] Build status: STARTED
[03:31:00.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:88:0) after 3m42s
[03:34:42.518] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:88:0)
[03:34:42.547] Build status: STARTED
[03:34:42.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:89:0) after 5m3s
[03:39:45.558] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:89:0)
[03:39:45.589] Build status: STARTED
[03:39:45.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:90:0) after 6m18s
[03:46:03.624] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:90:0)
[03:46:03.680] Build status: STARTED
[03:46:03.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:91:0) after 6m41s
[03:52:44.682] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:91:0)
[03:52:44.713] Build status: STARTED
[03:52:44.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:92:0) after 8m43s
[04:01:27.747] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:92:0)
[04:01:27.840] Build status: STARTED
[04:01:27.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:93:0) after 3m55s
[04:05:22.942] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:93:0)
[04:05:22.977] Build status: STARTED
[04:05:22.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:94:0) after 6m39s
[04:12:02.028] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:94:0)
[04:12:02.061] Build status: STARTED
[04:12:02.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:95:0) after 4m49s
[04:16:51.151] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:95:0)
[04:16:51.187] Build status: STARTED
[04:16:51.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:96:0) after 4m24s
[04:21:15.252] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:96:0)
[04:21:15.294] Build status: STARTED
[04:21:15.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:97:0) after 1m31s
[04:22:46.324] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:97:0)
[04:22:46.371] Build status: STARTED
[04:22:46.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:98:0) after 8m20s
[04:31:06.437] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:98:0)
[04:31:06.470] Build status: STARTED
[04:31:06.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:99:0) after 1m35s
[04:32:41.715] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:99:0)
[04:32:41.746] Build status: STARTED
[04:32:41.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:100:0) after 7m58s
[04:40:39.781] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:100:0)
[04:40:39.817] Build status: STARTED
[04:40:39.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:101:0) after 4m55s
[04:45:34.954] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:101:0)
[04:45:34.989] Build status: STARTED
[04:45:34.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:102:0) after 1m55s
[04:47:30.037] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:102:0)
[04:47:30.071] Build status: STARTED
[04:47:30.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:103:0) after 9m18s
[04:56:48.270] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:103:0)
[04:56:48.302] Build status: STARTED
[04:56:48.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:104:0) after 7m33s
[05:04:21.731] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:104:0)
[05:04:21.818] Build status: STARTED
[05:04:21.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:105:0) after 6m30s
[05:10:51.962] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:105:0)
[05:10:51.994] Build status: STARTED
[05:10:51.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:106:0) after 1m15s
[05:12:07.042] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:106:0)
[05:12:07.093] Build status: STARTED
[05:12:07.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:107:0) after 1m34s
[05:13:41.121] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:107:0)
[05:13:41.156] Build status: STARTED
[05:13:41.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:108:0) after 9m6s
[05:22:47.192] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:108:0)
[05:22:47.233] Build status: STARTED
[05:22:47.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:109:0) after 7m1s
[05:29:48.280] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:109:0)
[05:29:48.310] Build status: STARTED
[05:29:48.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:110:0) after 6m18s
[05:36:06.346] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:110:0)
[05:36:06.384] Build status: STARTED
[05:36:06.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:111:0) after 3m27s
[05:39:33.415] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:111:0)
[05:39:33.471] Build status: STARTED
[05:39:33.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:112:0) after 2m39s
[05:42:12.499] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:112:0)
[05:42:12.584] Build status: STARTED
[05:42:12.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:113:0) after 8m6s
[05:50:18.611] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:113:0)
[05:50:18.646] Build status: STARTED
[05:50:18.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:114:0) after 4m41s
[05:54:59.711] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:114:0)
[05:54:59.765] Build status: STARTED
[05:54:59.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:115:0) after 7m1s
[06:02:01.021] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:115:0)
[06:02:01.078] Build status: STARTED
[06:02:01.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:116:0) after 7m11s
[06:09:12.118] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:116:0)
[06:09:12.290] Build status: STARTED
[06:09:12.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9001515852663748384:117:0) after 9m45s
[06:17:45.031] Received PubSub notification, asking Buildbucket for the build status
[06:17:45.074] Build:
{
"id": "8836085790628953681",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 25491,
"createdBy": "project:chromium",
"createTime": "2021-09-14T19:49:06.122110080Z",
"startTime": "2021-09-14T19:52:33.339739Z",
"endTime": "2021-09-15T06:17:44.344032699Z",
"updateTime": "2021-09-15T06:17:44.344576019Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a4b6a06b37e68606e7cf162797adf3379ae6d9ce",
"ref": "refs/heads/main"
}
}
}
[06:17:45.074] Invocation finished in 10h28m40.276269911s with status FAILED