[11:06:34.767] New invocation is queued and will start shortly
[11:06:35.858] Starting the invocation (attempt 1)
[11:06:35.884] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fbfccfb4bfbb817b41c4eadec87a03ad843104d6"
[11:06:35.884] Popped gitiles commit info from properties and tags
[11:06:35.884] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:06:35.886] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:06:35.886] Buildbucket request:
{
"requestId": "8901348480725353504",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacCoverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fbfccfb4bfbb817b41c4eadec87a03ad843104d6",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8901348480725353504"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacCoverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:06:36.436] Scheduled build:
{
"id": "8735918418844970561",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacCoverage"
},
"number": 63007,
"createdBy": "project:chromium",
"createTime": "2024-09-24T11:06:35.935700030Z",
"updateTime": "2024-09-24T11:06:35.935700030Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fbfccfb4bfbb817b41c4eadec87a03ad843104d6",
"ref": "refs/heads/main"
}
},
"canary": true
}
[11:06:36.436] Task URL: https://cr-buildbucket.appspot.com/build/8735918418844970561
[11:06:36.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:2:0) after 4m1s
[11:06:38.232] Received PubSub notification, asking Buildbucket for the build status
[11:06:38.266] Build status: SCHEDULED
[11:06:42.311] Received PubSub notification, asking Buildbucket for the build status
[11:06:42.347] Build status: STARTED
[11:10:37.457] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:2:0)
[11:10:37.481] Build status: STARTED
[11:10:37.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:5:0) after 2m50s
[11:13:27.580] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:5:0)
[11:13:27.596] Build status: STARTED
[11:13:27.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:6:0) after 6m50s
[11:20:17.619] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:6:0)
[11:20:17.641] Build status: STARTED
[11:20:17.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:7:0) after 2m41s
[11:22:58.700] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:7:0)
[11:22:58.719] Build status: STARTED
[11:22:58.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:8:0) after 2m18s
[11:25:16.808] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:8:0)
[11:25:16.828] Build status: STARTED
[11:25:16.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:9:0) after 4m11s
[11:29:28.020] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:9:0)
[11:29:28.080] Build status: STARTED
[11:29:28.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:10:0) after 2m27s
[11:31:55.101] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:10:0)
[11:31:55.122] Build status: STARTED
[11:31:55.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:11:0) after 7m51s
[11:39:46.315] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:11:0)
[11:39:46.335] Build status: STARTED
[11:39:46.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:12:0) after 4m0s
[11:43:46.356] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:12:0)
[11:43:46.378] Build status: STARTED
[11:43:46.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:13:0) after 4m30s
[11:48:16.497] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:13:0)
[11:48:16.526] Build status: STARTED
[11:48:16.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:14:0) after 7m12s
[11:55:28.498] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:14:0)
[11:55:28.521] Build status: STARTED
[11:55:28.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:15:0) after 6m36s
[12:02:04.900] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:15:0)
[12:02:04.934] Build status: STARTED
[12:02:04.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:16:0) after 5m41s
[12:07:46.066] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:16:0)
[12:07:46.082] Build status: STARTED
[12:07:46.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:17:0) after 7m44s
[12:15:30.105] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:17:0)
[12:15:30.172] Build status: STARTED
[12:15:30.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:18:0) after 4m8s
[12:19:38.294] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:18:0)
[12:19:38.313] Build status: STARTED
[12:19:38.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:19:0) after 3m40s
[12:23:18.303] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:19:0)
[12:23:18.350] Build status: STARTED
[12:23:18.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:20:0) after 1m2s
[12:24:20.494] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:20:0)
[12:24:20.514] Build status: STARTED
[12:24:20.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:21:0) after 9m32s
[12:33:52.661] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:21:0)
[12:33:52.679] Build status: STARTED
[12:33:52.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:22:0) after 4m21s
[12:38:14.045] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:22:0)
[12:38:14.067] Build status: STARTED
[12:38:14.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:23:0) after 7m9s
[12:45:23.276] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:23:0)
[12:45:23.299] Build status: STARTED
[12:45:23.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:24:0) after 5m45s
[12:51:08.408] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:24:0)
[12:51:08.425] Build status: STARTED
[12:51:08.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:25:0) after 6m52s
[12:58:00.975] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:25:0)
[12:58:00.994] Build status: STARTED
[12:58:00.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:26:0) after 5m23s
[13:03:24.018] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:26:0)
[13:03:24.039] Build status: STARTED
[13:03:24.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:27:0) after 1m58s
[13:05:22.070] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:27:0)
[13:05:22.089] Build status: STARTED
[13:05:22.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:28:0) after 4m42s
[13:10:04.251] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:28:0)
[13:10:04.272] Build status: STARTED
[13:10:04.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:29:0) after 1m34s
[13:11:38.434] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:29:0)
[13:11:38.451] Build status: STARTED
[13:11:38.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:30:0) after 3m4s
[13:14:42.519] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:30:0)
[13:14:42.567] Build status: STARTED
[13:14:42.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:31:0) after 9m50s
[13:24:32.632] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:31:0)
[13:24:32.713] Build status: STARTED
[13:24:32.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:32:0) after 1m7s
[13:25:40.587] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:32:0)
[13:25:40.604] Build status: STARTED
[13:25:40.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:33:0) after 2m38s
[13:28:18.624] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:33:0)
[13:28:18.678] Build status: STARTED
[13:28:18.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:34:0) after 2m42s
[13:31:00.823] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:34:0)
[13:31:00.840] Build status: STARTED
[13:31:00.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:35:0) after 3m42s
[13:34:42.899] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:35:0)
[13:34:42.916] Build status: STARTED
[13:34:42.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:36:0) after 4m24s
[13:39:07.084] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:36:0)
[13:39:07.100] Build status: STARTED
[13:39:07.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:37:0) after 9m54s
[13:49:01.122] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:37:0)
[13:49:01.190] Build status: STARTED
[13:49:01.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:38:0) after 3m46s
[13:52:47.236] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:38:0)
[13:52:47.254] Build status: STARTED
[13:52:47.254] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:39:0) after 7m8s
[13:59:55.273] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:39:0)
[13:59:55.288] Build status: STARTED
[13:59:55.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:40:0) after 5m55s
[14:05:50.475] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:40:0)
[14:05:50.491] Build status: STARTED
[14:05:50.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:41:0) after 1m4s
[14:06:55.282] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:41:0)
[14:06:55.300] Build status: STARTED
[14:06:55.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:42:0) after 9m19s
[14:16:14.352] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:42:0)
[14:16:14.370] Build status: STARTED
[14:16:14.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:43:0) after 4m54s
[14:21:08.567] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:43:0)
[14:21:08.598] Build status: STARTED
[14:21:08.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:44:0) after 5m33s
[14:26:41.635] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:44:0)
[14:26:41.652] Build status: STARTED
[14:26:41.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:45:0) after 8m15s
[14:34:56.870] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:45:0)
[14:34:56.890] Build status: STARTED
[14:34:56.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:46:0) after 2m38s
[14:37:34.908] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:46:0)
[14:37:34.925] Build status: STARTED
[14:37:34.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:47:0) after 9m12s
[14:46:46.950] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:47:0)
[14:46:46.969] Build status: STARTED
[14:46:46.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:48:0) after 9m47s
[14:56:33.980] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:48:0)
[14:56:34.001] Build status: STARTED
[14:56:34.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:49:0) after 7m18s
[15:03:52.072] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:49:0)
[15:03:52.092] Build status: STARTED
[15:03:52.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:50:0) after 9m50s
[15:13:42.163] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:50:0)
[15:13:42.246] Build status: STARTED
[15:13:42.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:51:0) after 2m57s
[15:16:39.303] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:51:0)
[15:16:39.393] Build status: STARTED
[15:16:39.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:52:0) after 3m20s
[15:19:59.450] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:52:0)
[15:19:59.466] Build status: STARTED
[15:19:59.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:53:0) after 1m41s
[15:21:40.496] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:53:0)
[15:21:40.569] Build status: STARTED
[15:21:40.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:54:0) after 6m30s
[15:28:10.607] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:54:0)
[15:28:10.704] Build status: STARTED
[15:28:10.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8901348480725353504:55:0) after 8m56s
[15:35:02.147] Received PubSub notification, asking Buildbucket for the build status
[15:35:02.167] Build:
{
"id": "8735918418844970561",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacCoverage"
},
"number": 63007,
"createdBy": "project:chromium",
"createTime": "2024-09-24T11:06:35.935700030Z",
"startTime": "2024-09-24T11:06:40.143725883Z",
"endTime": "2024-09-24T15:35:01.771770919Z",
"updateTime": "2024-09-24T15:35:01.771770919Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fbfccfb4bfbb817b41c4eadec87a03ad843104d6",
"ref": "refs/heads/main"
}
},
"canary": true
}
[15:35:02.167] Invocation finished in 4h28m27.408721581s with status FAILED