[00:04:37.196] New invocation is queued and will start shortly
[00:04:39.018] Starting the invocation (attempt 1)
[00:04:39.048] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/4ce8f51cf3d26eb4d76e7fe29b094435bcb3ec73"
[00:04:39.048] Popped gitiles commit info from properties and tags
[00:04:39.048] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:04:39.048] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:04:39.048] Buildbucket request:
{
"requestId": "8924582951028321968",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4ce8f51cf3d26eb4d76e7fe29b094435bcb3ec73",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8924582951028321968"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:04:39.683] Scheduled build:
{
"id": "8759152888334078673",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 30982,
"createdBy": "project:chromium",
"createTime": "2024-01-12T00:04:39.128217686Z",
"updateTime": "2024-01-12T00:04:39.128217686Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4ce8f51cf3d26eb4d76e7fe29b094435bcb3ec73",
"ref": "refs/heads/main"
}
}
}
[00:04:39.683] Task URL: https://cr-buildbucket.appspot.com/build/8759152888334078673
[00:04:39.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:2:0) after 4m43s
[00:04:40.612] Received PubSub notification, asking Buildbucket for the build status
[00:04:40.633] Build status: SCHEDULED
[00:04:41.245] Received PubSub notification, asking Buildbucket for the build status
[00:04:41.297] Build status: STARTED
[00:09:22.680] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:2:0)
[00:09:22.699] Build status: STARTED
[00:09:22.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:5:0) after 6m27s
[00:15:49.720] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:5:0)
[00:15:49.742] Build status: STARTED
[00:15:49.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:6:0) after 2m14s
[00:18:03.763] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:6:0)
[00:18:03.840] Build status: STARTED
[00:18:03.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:7:0) after 4m35s
[00:22:38.909] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:7:0)
[00:22:38.943] Build status: STARTED
[00:22:38.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:8:0) after 3m3s
[00:25:42.082] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:8:0)
[00:25:42.101] Build status: STARTED
[00:25:42.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:9:0) after 2m37s
[00:28:19.121] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:9:0)
[00:28:19.203] Build status: STARTED
[00:28:19.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:10:0) after 9m27s
[00:37:46.233] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:10:0)
[00:37:46.259] Build status: STARTED
[00:37:46.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:11:0) after 5m59s
[00:43:45.366] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:11:0)
[00:43:45.383] Build status: STARTED
[00:43:45.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:12:0) after 1m45s
[00:45:30.613] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:12:0)
[00:45:30.633] Build status: STARTED
[00:45:30.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:13:0) after 9m3s
[00:54:33.675] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:13:0)
[00:54:33.694] Build status: STARTED
[00:54:33.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:14:0) after 2m20s
[00:56:53.901] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:14:0)
[00:56:53.921] Build status: STARTED
[00:56:53.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:15:0) after 6m56s
[01:03:50.006] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:15:0)
[01:03:50.024] Build status: STARTED
[01:03:50.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:16:0) after 7m38s
[01:11:28.057] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:16:0)
[01:11:28.119] Build status: STARTED
[01:11:28.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:17:0) after 9m24s
[01:20:52.184] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:17:0)
[01:20:52.213] Build status: STARTED
[01:20:52.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:18:0) after 2m17s
[01:23:09.706] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:18:0)
[01:23:09.766] Build status: STARTED
[01:23:09.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:19:0) after 5m54s
[01:29:03.928] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:19:0)
[01:29:03.944] Build status: STARTED
[01:29:03.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:20:0) after 2m34s
[01:31:38.058] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:20:0)
[01:31:38.078] Build status: STARTED
[01:31:38.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:21:0) after 1m16s
[01:32:54.498] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:21:0)
[01:32:54.515] Build status: STARTED
[01:32:54.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:22:0) after 2m47s
[01:35:41.565] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:22:0)
[01:35:41.614] Build status: STARTED
[01:35:41.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:23:0) after 4m38s
[01:40:19.761] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:23:0)
[01:40:19.781] Build status: STARTED
[01:40:19.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:24:0) after 1m59s
[01:42:18.981] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:24:0)
[01:42:19.024] Build status: STARTED
[01:42:19.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:25:0) after 5m6s
[01:47:25.119] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:25:0)
[01:47:25.166] Build status: STARTED
[01:47:25.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:26:0) after 8m6s
[01:55:31.435] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:26:0)
[01:55:31.467] Build status: STARTED
[01:55:31.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:27:0) after 6m9s
[02:01:40.561] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:27:0)
[02:01:40.591] Build status: STARTED
[02:01:40.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:28:0) after 9m15s
[02:10:55.818] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:28:0)
[02:10:55.846] Build status: STARTED
[02:10:55.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:29:0) after 4m31s
[02:15:26.918] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:29:0)
[02:15:26.999] Build status: STARTED
[02:15:26.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:30:0) after 5m33s
[02:21:00.027] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:30:0)
[02:21:00.084] Build status: STARTED
[02:21:00.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:31:0) after 1m25s
[02:22:25.202] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:31:0)
[02:22:25.235] Build status: STARTED
[02:22:25.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:32:0) after 2m16s
[02:24:41.240] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:32:0)
[02:24:41.260] Build status: STARTED
[02:24:41.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:33:0) after 4m5s
[02:28:46.303] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:33:0)
[02:28:46.358] Build status: STARTED
[02:28:46.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:34:0) after 6m36s
[02:35:22.369] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:34:0)
[02:35:22.398] Build status: STARTED
[02:35:22.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:35:0) after 3m3s
[02:38:25.431] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:35:0)
[02:38:25.451] Build status: STARTED
[02:38:25.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:36:0) after 5m12s
[02:43:37.696] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:36:0)
[02:43:37.843] Build status: STARTED
[02:43:37.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:37:0) after 2m30s
[02:46:07.967] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:37:0)
[02:46:07.991] Build status: STARTED
[02:46:07.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:38:0) after 3m11s
[02:49:18.997] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:38:0)
[02:49:19.019] Build status: STARTED
[02:49:19.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:39:0) after 7m44s
[02:57:03.039] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:39:0)
[02:57:03.061] Build status: STARTED
[02:57:03.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:40:0) after 9m24s
[03:06:27.187] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:40:0)
[03:06:27.204] Build status: STARTED
[03:06:27.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:41:0) after 5m49s
[03:12:16.296] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:41:0)
[03:12:16.337] Build status: STARTED
[03:12:16.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:42:0) after 8m14s
[03:20:30.418] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:42:0)
[03:20:30.439] Build status: STARTED
[03:20:30.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:43:0) after 7m40s
[03:28:10.669] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:43:0)
[03:28:10.686] Build status: STARTED
[03:28:10.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:44:0) after 8m27s
[03:36:37.720] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:44:0)
[03:36:37.740] Build status: STARTED
[03:36:37.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:45:0) after 8m10s
[03:44:48.200] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:45:0)
[03:44:48.258] Build status: STARTED
[03:44:48.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:46:0) after 9m54s
[03:54:42.333] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:46:0)
[03:54:42.357] Build status: STARTED
[03:54:42.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:47:0) after 1m15s
[03:55:57.502] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:47:0)
[03:55:57.519] Build status: STARTED
[03:55:57.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:48:0) after 9m59s
[04:05:56.586] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:48:0)
[04:05:56.603] Build status: STARTED
[04:05:56.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:49:0) after 4m28s
[04:10:24.843] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:49:0)
[04:10:24.865] Build status: STARTED
[04:10:24.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:50:0) after 1m17s
[04:11:42.521] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:50:0)
[04:11:42.541] Build status: STARTED
[04:11:42.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:51:0) after 3m14s
[04:14:56.564] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:51:0)
[04:14:56.637] Build status: STARTED
[04:14:56.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:52:0) after 2m21s
[04:17:17.665] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:52:0)
[04:17:17.684] Build status: STARTED
[04:17:17.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:53:0) after 7m27s
[04:24:44.722] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:53:0)
[04:24:44.737] Build status: STARTED
[04:24:44.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:54:0) after 6m41s
[04:31:25.761] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:54:0)
[04:31:25.784] Build status: STARTED
[04:31:25.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:55:0) after 7m28s
[04:38:53.826] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:55:0)
[04:38:53.844] Build status: STARTED
[04:38:53.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:56:0) after 2m25s
[04:41:18.998] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:56:0)
[04:41:19.019] Build status: STARTED
[04:41:19.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:57:0) after 9m6s
[04:50:25.273] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:57:0)
[04:50:25.310] Build status: STARTED
[04:50:25.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:58:0) after 2m18s
[04:52:43.414] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:58:0)
[04:52:43.434] Build status: STARTED
[04:52:43.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:59:0) after 1m55s
[04:54:38.618] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:59:0)
[04:54:38.635] Build status: STARTED
[04:54:38.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:60:0) after 8m4s
[05:02:42.695] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:60:0)
[05:02:42.802] Build status: STARTED
[05:02:42.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:61:0) after 2m28s
[05:05:11.621] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:61:0)
[05:05:11.644] Build status: STARTED
[05:05:11.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:62:0) after 3m39s
[05:08:50.765] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:62:0)
[05:08:50.792] Build status: STARTED
[05:08:50.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:63:0) after 8m53s
[05:17:43.814] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:63:0)
[05:17:43.829] Build status: STARTED
[05:17:43.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:64:0) after 3m53s
[05:21:36.959] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:64:0)
[05:21:36.977] Build status: STARTED
[05:21:36.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:65:0) after 9m51s
[05:31:28.008] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:65:0)
[05:31:28.025] Build status: STARTED
[05:31:28.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:66:0) after 4m42s
[05:36:10.309] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:66:0)
[05:36:10.424] Build status: STARTED
[05:36:10.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:67:0) after 1m8s
[05:37:18.460] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:67:0)
[05:37:18.478] Build status: STARTED
[05:37:18.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:68:0) after 2m26s
[05:39:44.685] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:68:0)
[05:39:44.706] Build status: STARTED
[05:39:44.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8924582951028321968:69:0) after 7m54s
[05:43:52.929] Received PubSub notification, asking Buildbucket for the build status
[05:43:52.949] Build:
{
"id": "8759152888334078673",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 30982,
"createdBy": "project:chromium",
"createTime": "2024-01-12T00:04:39.128217686Z",
"startTime": "2024-01-12T00:04:40.692242Z",
"endTime": "2024-01-12T05:43:52.337067Z",
"updateTime": "2024-01-12T05:43:52.337067Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4ce8f51cf3d26eb4d76e7fe29b094435bcb3ec73",
"ref": "refs/heads/main"
}
}
}
[05:43:52.949] Invocation finished in 5h39m15.77409471s with status FAILED