[01:45:30.710] New invocation is queued and will start shortly
[01:45:31.780] Starting the invocation (attempt 1)
[01:45:31.808] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d35fb91448d746cf3dac006aad9c5f6e0d3185b5"
[01:45:31.808] Popped gitiles commit info from properties and tags
[01:45:31.808] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:45:31.809] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:45:31.809] Buildbucket request:
{
"requestId": "8925210782207953152",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d35fb91448d746cf3dac006aad9c5f6e0d3185b5",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8925210782207953152"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:45:32.414] Scheduled build:
{
"id": "8759780720337459073",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 30959,
"createdBy": "project:chromium",
"createTime": "2024-01-05T01:45:31.871663680Z",
"updateTime": "2024-01-05T01:45:31.871663680Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d35fb91448d746cf3dac006aad9c5f6e0d3185b5",
"ref": "refs/heads/main"
}
}
}
[01:45:32.414] Task URL: https://cr-buildbucket.appspot.com/build/8759780720337459073
[01:45:32.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:2:0) after 3m49s
[01:45:33.496] Received PubSub notification, asking Buildbucket for the build status
[01:45:33.517] Build status: SCHEDULED
[01:45:38.455] Received PubSub notification, asking Buildbucket for the build status
[01:45:38.475] Build status: STARTED
[01:49:21.405] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:2:0)
[01:49:21.426] Build status: STARTED
[01:49:21.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:5:0) after 8m55s
[01:58:16.473] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:5:0)
[01:58:16.497] Build status: STARTED
[01:58:16.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:6:0) after 9m44s
[02:08:00.608] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:6:0)
[02:08:00.629] Build status: STARTED
[02:08:00.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:7:0) after 9m11s
[02:17:11.743] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:7:0)
[02:17:11.769] Build status: STARTED
[02:17:11.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:8:0) after 8m2s
[02:25:13.790] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:8:0)
[02:25:13.832] Build status: STARTED
[02:25:13.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:9:0) after 1m37s
[02:26:50.917] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:9:0)
[02:26:50.988] Build status: STARTED
[02:26:50.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:10:0) after 7m56s
[02:34:47.109] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:10:0)
[02:34:47.134] Build status: STARTED
[02:34:47.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:11:0) after 1m39s
[02:36:26.159] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:11:0)
[02:36:26.176] Build status: STARTED
[02:36:26.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:12:0) after 2m58s
[02:39:24.180] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:12:0)
[02:39:24.201] Build status: STARTED
[02:39:24.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:13:0) after 6m39s
[02:46:03.294] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:13:0)
[02:46:03.487] Build status: STARTED
[02:46:03.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:14:0) after 7m53s
[02:53:56.507] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:14:0)
[02:53:56.525] Build status: STARTED
[02:53:56.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:15:0) after 6m23s
[03:00:19.548] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:15:0)
[03:00:19.617] Build status: STARTED
[03:00:19.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:16:0) after 2m21s
[03:02:40.675] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:16:0)
[03:02:40.694] Build status: STARTED
[03:02:40.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:17:0) after 6m49s
[03:09:29.736] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:17:0)
[03:09:29.841] Build status: STARTED
[03:09:29.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:18:0) after 8m5s
[03:17:35.109] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:18:0)
[03:17:35.135] Build status: STARTED
[03:17:35.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:19:0) after 5m8s
[03:22:43.185] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:19:0)
[03:22:43.201] Build status: STARTED
[03:22:43.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:20:0) after 2m26s
[03:25:09.225] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:20:0)
[03:25:09.245] Build status: STARTED
[03:25:09.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:21:0) after 1m34s
[03:26:43.495] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:21:0)
[03:26:43.515] Build status: STARTED
[03:26:43.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:22:0) after 3m4s
[03:29:47.870] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:22:0)
[03:29:47.886] Build status: STARTED
[03:29:47.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:23:0) after 7m1s
[03:36:48.908] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:23:0)
[03:36:48.924] Build status: STARTED
[03:36:48.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:24:0) after 5m2s
[03:41:51.167] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:24:0)
[03:41:51.191] Build status: STARTED
[03:41:51.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:25:0) after 7m58s
[03:49:49.239] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:25:0)
[03:49:49.257] Build status: STARTED
[03:49:49.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:26:0) after 6m37s
[03:56:26.326] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:26:0)
[03:56:26.355] Build status: STARTED
[03:56:26.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:27:0) after 7m15s
[04:03:41.382] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:27:0)
[04:03:41.445] Build status: STARTED
[04:03:41.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:28:0) after 1m27s
[04:05:08.993] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:28:0)
[04:05:09.050] Build status: STARTED
[04:05:09.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:29:0) after 3m8s
[04:08:17.168] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:29:0)
[04:08:17.189] Build status: STARTED
[04:08:17.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:30:0) after 5m0s
[04:13:17.243] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:30:0)
[04:13:17.280] Build status: STARTED
[04:13:17.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:31:0) after 8m8s
[04:21:25.301] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:31:0)
[04:21:25.318] Build status: STARTED
[04:21:25.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:32:0) after 8m42s
[04:30:07.515] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:32:0)
[04:30:07.532] Build status: STARTED
[04:30:07.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:33:0) after 1m10s
[04:31:17.670] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:33:0)
[04:31:17.686] Build status: STARTED
[04:31:17.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:34:0) after 1m51s
[04:33:08.741] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:34:0)
[04:33:08.763] Build status: STARTED
[04:33:08.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:35:0) after 8m6s
[04:41:14.792] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:35:0)
[04:41:14.811] Build status: STARTED
[04:41:14.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:36:0) after 4m43s
[04:45:57.971] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:36:0)
[04:45:57.998] Build status: STARTED
[04:45:57.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:37:0) after 4m29s
[04:50:27.019] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:37:0)
[04:50:27.036] Build status: STARTED
[04:50:27.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:38:0) after 1m27s
[04:51:54.342] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:38:0)
[04:51:54.358] Build status: STARTED
[04:51:54.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:39:0) after 5m36s
[04:57:30.342] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:39:0)
[04:57:30.358] Build status: STARTED
[04:57:30.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:40:0) after 9m51s
[05:07:21.389] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:40:0)
[05:07:21.410] Build status: STARTED
[05:07:21.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:41:0) after 7m53s
[05:15:14.401] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:41:0)
[05:15:14.458] Build status: STARTED
[05:15:14.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:42:0) after 4m26s
[05:19:40.434] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:42:0)
[05:19:40.453] Build status: STARTED
[05:19:40.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:43:0) after 3m57s
[05:23:37.490] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:43:0)
[05:23:37.513] Build status: STARTED
[05:23:37.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:44:0) after 7m34s
[05:31:11.558] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:44:0)
[05:31:11.577] Build status: STARTED
[05:31:11.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:45:0) after 6m28s
[05:37:39.631] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:45:0)
[05:37:39.647] Build status: STARTED
[05:37:39.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:46:0) after 4m43s
[05:42:22.871] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:46:0)
[05:42:22.888] Build status: STARTED
[05:42:22.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:47:0) after 4m46s
[05:47:09.011] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:47:0)
[05:47:09.033] Build status: STARTED
[05:47:09.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:48:0) after 3m17s
[05:50:26.186] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:48:0)
[05:50:26.226] Build status: STARTED
[05:50:26.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:49:0) after 1m22s
[05:51:48.516] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:49:0)
[05:51:48.532] Build status: STARTED
[05:51:48.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:50:0) after 2m41s
[05:54:29.556] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:50:0)
[05:54:29.577] Build status: STARTED
[05:54:29.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:51:0) after 5m48s
[06:00:17.755] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:51:0)
[06:00:17.841] Build status: STARTED
[06:00:17.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:52:0) after 4m27s
[06:04:44.987] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:52:0)
[06:04:45.017] Build status: STARTED
[06:04:45.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:53:0) after 8m21s
[06:13:06.057] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:53:0)
[06:13:06.102] Build status: STARTED
[06:13:06.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:54:0) after 2m46s
[06:15:52.123] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:54:0)
[06:15:52.142] Build status: STARTED
[06:15:52.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:55:0) after 5m55s
[06:21:47.248] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:55:0)
[06:21:47.300] Build status: STARTED
[06:21:47.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:56:0) after 2m57s
[06:24:44.530] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:56:0)
[06:24:44.550] Build status: STARTED
[06:24:44.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:57:0) after 5m11s
[06:29:55.581] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:57:0)
[06:29:55.618] Build status: STARTED
[06:29:55.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:58:0) after 3m25s
[06:33:20.816] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:58:0)
[06:33:20.880] Build status: STARTED
[06:33:20.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:59:0) after 1m47s
[06:35:07.956] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:59:0)
[06:35:07.974] Build status: STARTED
[06:35:07.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:60:0) after 4m43s
[06:39:51.393] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:60:0)
[06:39:51.421] Build status: STARTED
[06:39:51.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:61:0) after 5m13s
[06:45:04.540] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:61:0)
[06:45:04.557] Build status: STARTED
[06:45:04.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:62:0) after 8m15s
[06:53:19.813] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:62:0)
[06:53:20.006] Build status: STARTED
[06:53:20.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:63:0) after 8m26s
[07:01:46.838] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:63:0)
[07:01:46.853] Build status: STARTED
[07:01:46.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:64:0) after 2m39s
[07:04:25.879] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:64:0)
[07:04:25.908] Build status: STARTED
[07:04:25.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:65:0) after 8m46s
[07:13:11.892] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:65:0)
[07:13:11.917] Build status: STARTED
[07:13:11.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:66:0) after 2m27s
[07:15:38.986] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:66:0)
[07:15:39.036] Build status: STARTED
[07:15:39.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:67:0) after 6m40s
[07:22:19.113] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:67:0)
[07:22:19.136] Build status: STARTED
[07:22:19.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:68:0) after 7m9s
[07:29:28.153] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:68:0)
[07:29:28.206] Build status: STARTED
[07:29:28.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8925210782207953152:69:0) after 7m3s
[07:30:20.337] Received PubSub notification, asking Buildbucket for the build status
[07:30:20.356] Build:
{
"id": "8759780720337459073",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 30959,
"createdBy": "project:chromium",
"createTime": "2024-01-05T01:45:31.871663680Z",
"startTime": "2024-01-05T01:45:38.152598492Z",
"endTime": "2024-01-05T07:30:19.842026Z",
"updateTime": "2024-01-05T07:30:19.842026Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d35fb91448d746cf3dac006aad9c5f6e0d3185b5",
"ref": "refs/heads/main"
}
}
}
[07:30:20.356] Invocation finished in 5h44m49.652377611s with status FAILED