[22:41:31.084] New invocation is queued and will start shortly
[22:41:32.374] Starting the invocation (attempt 1)
[22:41:32.434] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9eaef9db77b78d6e335e8407c5714eb06e2a4885"
[22:41:32.434] Popped gitiles commit info from properties and tags
[22:41:32.434] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:41:32.436] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:41:32.436] Buildbucket request:
{
"requestId": "8918246391688912560",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9eaef9db77b78d6e335e8407c5714eb06e2a4885",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8918246391688912560"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:41:33.251] Scheduled build:
{
"id": "8752816329399252033",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 30577,
"createdBy": "project:chromium",
"createTime": "2024-03-21T22:41:32.638929487Z",
"updateTime": "2024-03-21T22:41:32.638929487Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9eaef9db77b78d6e335e8407c5714eb06e2a4885",
"ref": "refs/heads/main"
}
}
}
[22:41:33.251] Task URL: https://cr-buildbucket.appspot.com/build/8752816329399252033
[22:41:33.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:2:0) after 3m17s
[22:41:45.951] Received PubSub notification, asking Buildbucket for the build status
[22:41:46.035] Build status: STARTED
[22:41:47.390] Received PubSub notification, asking Buildbucket for the build status
[22:41:47.431] Build status: STARTED
[22:44:50.314] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:2:0)
[22:44:50.335] Build status: STARTED
[22:44:50.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:5:0) after 3m8s
[22:47:58.570] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:5:0)
[22:47:58.587] Build status: STARTED
[22:47:58.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:6:0) after 8m49s
[22:56:48.246] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:6:0)
[22:56:48.269] Build status: STARTED
[22:56:48.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:7:0) after 5m5s
[23:01:53.314] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:7:0)
[23:01:53.348] Build status: STARTED
[23:01:53.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:8:0) after 1m11s
[23:03:04.572] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:8:0)
[23:03:04.623] Build status: STARTED
[23:03:04.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:9:0) after 4m41s
[23:07:45.781] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:9:0)
[23:07:45.818] Build status: STARTED
[23:07:45.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:10:0) after 9m8s
[23:16:53.861] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:10:0)
[23:16:53.885] Build status: STARTED
[23:16:53.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:11:0) after 6m17s
[23:23:11.019] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:11:0)
[23:23:11.167] Build status: STARTED
[23:23:11.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:12:0) after 6m10s
[23:29:21.680] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:12:0)
[23:29:21.714] Build status: STARTED
[23:29:21.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:13:0) after 7m34s
[23:36:55.741] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:13:0)
[23:36:55.797] Build status: STARTED
[23:36:55.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:14:0) after 4m9s
[23:41:04.893] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:14:0)
[23:41:04.912] Build status: STARTED
[23:41:04.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:15:0) after 7m35s
[23:48:40.035] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:15:0)
[23:48:40.084] Build status: STARTED
[23:48:40.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:16:0) after 4m54s
[23:53:34.082] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:16:0)
[23:53:34.105] Build status: STARTED
[23:53:34.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:17:0) after 9m28s
[00:03:02.336] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:17:0)
[00:03:02.386] Build status: STARTED
[00:03:02.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:18:0) after 3m29s
[00:06:31.806] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:18:0)
[00:06:31.827] Build status: STARTED
[00:06:31.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:19:0) after 9m12s
[00:15:43.956] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:19:0)
[00:15:43.980] Build status: STARTED
[00:15:43.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:20:0) after 1m27s
[00:17:11.211] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:20:0)
[00:17:11.241] Build status: STARTED
[00:17:11.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:21:0) after 9m1s
[00:26:12.263] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:21:0)
[00:26:12.279] Build status: STARTED
[00:26:12.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:22:0) after 7m8s
[00:33:20.436] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:22:0)
[00:33:20.474] Build status: STARTED
[00:33:20.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:23:0) after 7m21s
[00:40:41.583] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:23:0)
[00:40:41.613] Build status: STARTED
[00:40:41.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:24:0) after 1m52s
[00:42:33.613] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:24:0)
[00:42:33.636] Build status: STARTED
[00:42:33.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:25:0) after 4m22s
[00:46:55.668] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:25:0)
[00:46:55.687] Build status: STARTED
[00:46:55.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:26:0) after 4m40s
[00:51:35.788] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:26:0)
[00:51:35.807] Build status: STARTED
[00:51:35.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:27:0) after 5m15s
[00:56:50.918] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:27:0)
[00:56:50.937] Build status: STARTED
[00:56:50.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:28:0) after 9m17s
[01:06:07.960] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:28:0)
[01:06:08.003] Build status: STARTED
[01:06:08.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:29:0) after 9m7s
[01:15:15.045] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:29:0)
[01:15:15.092] Build status: STARTED
[01:15:15.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:30:0) after 5m17s
[01:20:32.109] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:30:0)
[01:20:32.148] Build status: STARTED
[01:20:32.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:31:0) after 9m19s
[01:29:51.280] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:31:0)
[01:29:51.301] Build status: STARTED
[01:29:51.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:32:0) after 2m30s
[01:32:21.371] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:32:0)
[01:32:21.394] Build status: STARTED
[01:32:21.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:33:0) after 5m39s
[01:38:00.597] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:33:0)
[01:38:00.830] Build status: STARTED
[01:38:00.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:34:0) after 9m49s
[01:47:50.021] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:34:0)
[01:47:50.041] Build status: STARTED
[01:47:50.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:35:0) after 3m22s
[01:51:12.426] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:35:0)
[01:51:12.499] Build status: STARTED
[01:51:12.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:36:0) after 5m15s
[01:56:27.638] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:36:0)
[01:56:27.662] Build status: STARTED
[01:56:27.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:37:0) after 9m16s
[02:05:43.710] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:37:0)
[02:05:43.758] Build status: STARTED
[02:05:43.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:38:0) after 1m29s
[02:07:12.829] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:38:0)
[02:07:12.887] Build status: STARTED
[02:07:12.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:39:0) after 1m52s
[02:09:04.924] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:39:0)
[02:09:04.963] Build status: STARTED
[02:09:04.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:40:0) after 5m39s
[02:14:44.009] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:40:0)
[02:14:44.032] Build status: STARTED
[02:14:44.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:41:0) after 9m38s
[02:24:22.267] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:41:0)
[02:24:22.285] Build status: STARTED
[02:24:22.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:42:0) after 9m32s
[02:33:54.369] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:42:0)
[02:33:54.478] Build status: STARTED
[02:33:54.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:43:0) after 2m33s
[02:36:27.499] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:43:0)
[02:36:27.557] Build status: STARTED
[02:36:27.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:44:0) after 7m16s
[02:43:43.721] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:44:0)
[02:43:43.809] Build status: STARTED
[02:43:43.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:45:0) after 9m31s
[02:53:14.789] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:45:0)
[02:53:14.809] Build status: STARTED
[02:53:14.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:46:0) after 8m11s
[03:01:25.872] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:46:0)
[03:01:25.909] Build status: STARTED
[03:01:25.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:47:0) after 6m49s
[03:08:15.094] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:47:0)
[03:08:15.120] Build status: STARTED
[03:08:15.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:48:0) after 1m36s
[03:09:51.311] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:48:0)
[03:09:51.335] Build status: STARTED
[03:09:51.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:49:0) after 6m37s
[03:16:28.465] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:49:0)
[03:16:28.488] Build status: STARTED
[03:16:28.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:50:0) after 5m49s
[03:22:17.518] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:50:0)
[03:22:17.556] Build status: STARTED
[03:22:17.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:51:0) after 2m7s
[03:24:24.654] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:51:0)
[03:24:24.695] Build status: STARTED
[03:24:24.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:52:0) after 5m31s
[03:29:55.714] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:52:0)
[03:29:55.734] Build status: STARTED
[03:29:55.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:53:0) after 4m43s
[03:34:38.772] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:53:0)
[03:34:38.793] Build status: STARTED
[03:34:38.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:54:0) after 8m52s
[03:43:30.827] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:54:0)
[03:43:30.863] Build status: STARTED
[03:43:30.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:55:0) after 1m11s
[03:44:41.883] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:55:0)
[03:44:41.928] Build status: STARTED
[03:44:41.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:56:0) after 1m32s
[03:46:14.263] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:56:0)
[03:46:14.286] Build status: STARTED
[03:46:14.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:57:0) after 3m9s
[03:49:23.320] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:57:0)
[03:49:23.344] Build status: STARTED
[03:49:23.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:58:0) after 8m11s
[03:57:34.393] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:58:0)
[03:57:34.418] Build status: STARTED
[03:57:34.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:59:0) after 8m40s
[04:06:14.547] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:59:0)
[04:06:14.582] Build status: STARTED
[04:06:14.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:60:0) after 5m50s
[04:12:04.618] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:60:0)
[04:12:04.635] Build status: STARTED
[04:12:04.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:61:0) after 6m21s
[04:18:25.713] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:61:0)
[04:18:25.732] Build status: STARTED
[04:18:25.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:62:0) after 6m37s
[04:25:02.755] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:62:0)
[04:25:02.789] Build status: STARTED
[04:25:02.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8918246391688912560:63:0) after 6m28s
[04:31:22.729] Received PubSub notification, asking Buildbucket for the build status
[04:31:22.756] Build:
{
"id": "8752816329399252033",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 30577,
"createdBy": "project:chromium",
"createTime": "2024-03-21T22:41:32.638929487Z",
"startTime": "2024-03-21T22:41:33.916071Z",
"endTime": "2024-03-22T04:31:21.870362Z",
"updateTime": "2024-03-22T04:31:21.870362Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9eaef9db77b78d6e335e8407c5714eb06e2a4885",
"ref": "refs/heads/main"
}
}
}
[04:31:22.756] Invocation finished in 5h49m51.68519076s with status FAILED