[02:58:06.704] New invocation is queued and will start shortly
[02:58:07.861] Starting the invocation (attempt 1)
[02:58:07.898] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fb410aa3bfe15584eb2a03c146cf690bed36c854"
[02:58:07.898] Popped gitiles commit info from properties and tags
[02:58:07.898] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:58:07.898] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:58:07.898] Buildbucket request:
{
"requestId": "8974853352212555616",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac (dbg)"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fb410aa3bfe15584eb2a03c146cf690bed36c854",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8974853352212555616"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac (dbg)"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:58:08.537] Scheduled build:
{
"id": "8809423290218724033",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac (dbg)"
},
"number": 28663,
"createdBy": "project:chromium",
"createTime": "2022-07-06T02:58:07.975890187Z",
"updateTime": "2022-07-06T02:58:07.975890187Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fb410aa3bfe15584eb2a03c146cf690bed36c854",
"ref": "refs/heads/main"
}
},
"canary": true
}
[02:58:08.537] Task URL: https://cr-buildbucket.appspot.com/build/8809423290218724033
[02:58:08.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:2:0) after 5m3s
[03:03:11.520] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:2:0)
[03:03:11.547] Build status: SCHEDULED
[03:03:11.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:3:0) after 9m10s
[03:12:21.695] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:3:0)
[03:12:21.718] Build status: SCHEDULED
[03:12:21.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:4:0) after 1m43s
[03:14:04.744] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:4:0)
[03:14:04.778] Build status: SCHEDULED
[03:14:04.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:5:0) after 2m2s
[03:16:07.134] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:5:0)
[03:16:07.241] Build status: SCHEDULED
[03:16:07.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:6:0) after 1m52s
[03:17:59.263] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:6:0)
[03:17:59.285] Build status: SCHEDULED
[03:17:59.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:7:0) after 6m43s
[03:24:42.313] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:7:0)
[03:24:42.338] Build status: SCHEDULED
[03:24:42.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:8:0) after 6m54s
[03:31:36.362] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:8:0)
[03:31:36.398] Build status: SCHEDULED
[03:31:36.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:9:0) after 2m49s
[03:34:25.421] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:9:0)
[03:34:25.472] Build status: SCHEDULED
[03:34:25.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:10:0) after 9m9s
[03:43:34.681] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:10:0)
[03:43:34.700] Build status: SCHEDULED
[03:43:34.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:11:0) after 5m39s
[03:49:13.688] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:11:0)
[03:49:13.905] Build status: SCHEDULED
[03:49:13.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:12:0) after 5m1s
[03:54:15.316] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:12:0)
[03:54:15.351] Build status: SCHEDULED
[03:54:15.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:13:0) after 9m9s
[04:03:24.376] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:13:0)
[04:03:24.400] Build status: SCHEDULED
[04:03:24.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:14:0) after 1m38s
[04:05:02.465] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:14:0)
[04:05:02.487] Build status: SCHEDULED
[04:05:02.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:15:0) after 6m44s
[04:11:46.813] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:15:0)
[04:11:46.833] Build status: SCHEDULED
[04:11:46.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:16:0) after 8m51s
[04:20:37.880] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:16:0)
[04:20:37.912] Build status: SCHEDULED
[04:20:37.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:17:0) after 2m30s
[04:23:07.951] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:17:0)
[04:23:07.985] Build status: SCHEDULED
[04:23:07.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:18:0) after 1m7s
[04:24:15.269] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:18:0)
[04:24:15.296] Build status: SCHEDULED
[04:24:15.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:19:0) after 4m38s
[04:28:53.341] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:19:0)
[04:28:53.366] Build status: SCHEDULED
[04:28:53.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:20:0) after 9m5s
[04:37:58.398] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:20:0)
[04:37:58.427] Build status: SCHEDULED
[04:37:58.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:21:0) after 9m44s
[04:47:42.655] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:21:0)
[04:47:42.700] Build status: SCHEDULED
[04:47:42.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:22:0) after 1m10s
[04:48:52.942] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:22:0)
[04:48:52.984] Build status: SCHEDULED
[04:48:52.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:23:0) after 8m31s
[04:57:24.009] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:23:0)
[04:57:24.041] Build status: SCHEDULED
[04:57:24.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:24:0) after 2m55s
[05:00:20.275] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:24:0)
[05:00:20.299] Build status: SCHEDULED
[05:00:20.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:25:0) after 1m2s
[05:01:22.436] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:25:0)
[05:01:22.481] Build status: SCHEDULED
[05:01:22.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:26:0) after 7m38s
[05:09:01.154] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:26:0)
[05:09:01.186] Build status: SCHEDULED
[05:09:01.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:27:0) after 5m43s
[05:13:40.387] Received PubSub notification, asking Buildbucket for the build status
[05:13:40.410] Build status: STARTED
[05:14:45.111] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:27:0)
[05:14:45.146] Build status: STARTED
[05:14:45.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:29:0) after 2m14s
[05:16:59.145] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:29:0)
[05:16:59.170] Build status: STARTED
[05:16:59.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:30:0) after 7m26s
[05:24:25.195] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:30:0)
[05:24:25.229] Build status: STARTED
[05:24:25.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:31:0) after 7m33s
[05:31:58.260] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:31:0)
[05:31:58.298] Build status: STARTED
[05:31:58.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:32:0) after 7m7s
[05:39:05.364] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:32:0)
[05:39:05.399] Build status: STARTED
[05:39:05.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:33:0) after 8m28s
[05:47:33.426] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:33:0)
[05:47:33.448] Build status: STARTED
[05:47:33.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:34:0) after 6m12s
[05:53:45.485] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:34:0)
[05:53:45.530] Build status: STARTED
[05:53:45.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:35:0) after 1m54s
[05:55:39.644] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:35:0)
[05:55:39.665] Build status: STARTED
[05:55:39.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:36:0) after 8m50s
[06:04:29.704] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:36:0)
[06:04:29.726] Build status: STARTED
[06:04:29.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:37:0) after 3m11s
[06:07:40.751] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:37:0)
[06:07:40.830] Build status: STARTED
[06:07:40.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:38:0) after 6m57s
[06:14:37.942] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:38:0)
[06:14:38.257] Build status: STARTED
[06:14:38.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:39:0) after 8m27s
[06:23:05.294] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:39:0)
[06:23:05.318] Build status: STARTED
[06:23:05.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:40:0) after 1m13s
[06:24:18.547] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:40:0)
[06:24:18.572] Build status: STARTED
[06:24:18.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:41:0) after 9m49s
[06:34:07.655] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:41:0)
[06:34:07.676] Build status: STARTED
[06:34:07.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:42:0) after 9m23s
[06:43:30.701] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:42:0)
[06:43:30.739] Build status: STARTED
[06:43:30.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:43:0) after 3m48s
[06:47:18.770] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:43:0)
[06:47:18.791] Build status: STARTED
[06:47:18.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:44:0) after 9m35s
[06:56:53.811] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:44:0)
[06:56:53.837] Build status: STARTED
[06:56:53.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:45:0) after 8m1s
[07:04:55.036] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:45:0)
[07:04:55.070] Build status: STARTED
[07:04:55.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:46:0) after 8m15s
[07:13:10.278] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:46:0)
[07:13:10.345] Build status: STARTED
[07:13:10.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:47:0) after 3m31s
[07:16:41.468] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:47:0)
[07:16:41.503] Build status: STARTED
[07:16:41.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:48:0) after 4m12s
[07:20:53.492] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:48:0)
[07:20:53.514] Build status: STARTED
[07:20:53.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:49:0) after 2m28s
[07:23:21.546] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:49:0)
[07:23:21.567] Build status: STARTED
[07:23:21.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:50:0) after 6m16s
[07:29:37.589] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:50:0)
[07:29:37.669] Build status: STARTED
[07:29:37.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:51:0) after 7m5s
[07:36:42.793] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:51:0)
[07:36:42.816] Build status: STARTED
[07:36:42.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:52:0) after 4m8s
[07:40:50.876] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:52:0)
[07:40:50.991] Build status: STARTED
[07:40:50.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:53:0) after 7m54s
[07:48:45.175] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:53:0)
[07:48:45.275] Build status: STARTED
[07:48:45.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:54:0) after 8m2s
[07:56:47.436] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:54:0)
[07:56:47.469] Build status: STARTED
[07:56:47.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:55:0) after 5m39s
[08:02:26.495] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:55:0)
[08:02:26.523] Build status: STARTED
[08:02:26.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:56:0) after 4m25s
[08:06:51.546] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:56:0)
[08:06:51.569] Build status: STARTED
[08:06:51.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:57:0) after 3m53s
[08:10:44.603] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:57:0)
[08:10:44.624] Build status: STARTED
[08:10:44.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:58:0) after 1m56s
[08:12:40.763] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:58:0)
[08:12:40.788] Build status: STARTED
[08:12:40.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:59:0) after 3m36s
[08:16:16.814] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:59:0)
[08:16:16.856] Build status: STARTED
[08:16:16.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:60:0) after 6m50s
[08:23:06.884] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:60:0)
[08:23:06.903] Build status: STARTED
[08:23:06.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8974853352212555616:61:0) after 8m10s
[08:30:15.941] Received PubSub notification, asking Buildbucket for the build status
[08:30:15.964] Build:
{
"id": "8809423290218724033",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac (dbg)"
},
"number": 28663,
"createdBy": "project:chromium",
"createTime": "2022-07-06T02:58:07.975890187Z",
"startTime": "2022-07-06T05:13:39.671882Z",
"endTime": "2022-07-06T08:30:15.609755797Z",
"updateTime": "2022-07-06T08:30:15.609755797Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fb410aa3bfe15584eb2a03c146cf690bed36c854",
"ref": "refs/heads/main"
}
},
"canary": true
}
[08:30:15.964] Invocation finished in 5h32m9.274654406s with status FAILED