[03:53:37.034] New invocation is queued and will start shortly
[03:53:38.136] Starting the invocation (attempt 1)
[03:53:38.233] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/8ff0ab4150146596b3dd1760221d630a68d488d0"
[03:53:38.233] Popped gitiles commit info from properties and tags
[03:53:38.233] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:53:38.233] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:53:38.234] Buildbucket request:
{
"requestId": "8918498546998755552",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTChromeOS"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8ff0ab4150146596b3dd1760221d630a68d488d0",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8918498546998755552"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTChromeOS"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:53:38.778] Scheduled build:
{
"id": "8753068485005631265",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTChromeOS"
},
"number": 7992,
"createdBy": "project:chromium",
"createTime": "2024-03-19T03:53:38.313364944Z",
"updateTime": "2024-03-19T03:53:38.313364944Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8ff0ab4150146596b3dd1760221d630a68d488d0",
"ref": "refs/heads/main"
}
},
"canary": true
}
[03:53:38.778] Task URL: https://cr-buildbucket.appspot.com/build/8753068485005631265
[03:53:38.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:2:0) after 6m39s
[03:53:39.736] Received PubSub notification, asking Buildbucket for the build status
[03:53:39.754] Build status: SCHEDULED
[03:55:02.225] Received PubSub notification, asking Buildbucket for the build status
[03:55:02.284] Build status: STARTED
[04:00:17.806] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:2:0)
[04:00:17.852] Build status: STARTED
[04:00:17.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:5:0) after 6m11s
[04:06:29.007] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:5:0)
[04:06:29.049] Build status: STARTED
[04:06:29.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:6:0) after 5m42s
[04:12:11.339] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:6:0)
[04:12:11.395] Build status: STARTED
[04:12:11.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:7:0) after 7m6s
[04:19:17.521] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:7:0)
[04:19:17.597] Build status: STARTED
[04:19:17.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:8:0) after 4m34s
[04:23:52.257] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:8:0)
[04:23:52.298] Build status: STARTED
[04:23:52.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:9:0) after 6m9s
[04:30:01.331] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:9:0)
[04:30:01.368] Build status: STARTED
[04:30:01.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:10:0) after 8m42s
[04:38:43.478] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:10:0)
[04:38:43.534] Build status: STARTED
[04:38:43.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:11:0) after 2m35s
[04:41:19.170] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:11:0)
[04:41:19.193] Build status: STARTED
[04:41:19.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:12:0) after 5m56s
[04:47:15.219] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:12:0)
[04:47:15.245] Build status: STARTED
[04:47:15.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:13:0) after 9m22s
[04:56:37.273] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:13:0)
[04:56:37.368] Build status: STARTED
[04:56:37.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:14:0) after 3m11s
[04:59:48.390] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:14:0)
[04:59:48.441] Build status: STARTED
[04:59:48.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:15:0) after 4m2s
[05:03:50.595] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:15:0)
[05:03:50.722] Build status: STARTED
[05:03:50.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:16:0) after 7m8s
[05:10:58.954] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:16:0)
[05:10:58.975] Build status: STARTED
[05:10:58.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:17:0) after 4m48s
[05:15:47.006] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:17:0)
[05:15:47.035] Build status: STARTED
[05:15:47.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:18:0) after 9m1s
[05:24:48.266] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:18:0)
[05:24:48.285] Build status: STARTED
[05:24:48.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:19:0) after 7m37s
[05:32:25.266] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:19:0)
[05:32:25.322] Build status: STARTED
[05:32:25.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:20:0) after 9m22s
[05:41:47.382] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:20:0)
[05:41:47.544] Build status: STARTED
[05:41:47.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:21:0) after 5m56s
[05:47:43.661] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:21:0)
[05:47:43.680] Build status: STARTED
[05:47:43.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:22:0) after 8m14s
[05:55:57.917] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:22:0)
[05:55:57.940] Build status: STARTED
[05:55:57.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:23:0) after 5m38s
[06:01:35.976] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:23:0)
[06:01:35.999] Build status: STARTED
[06:01:35.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:24:0) after 5m25s
[06:07:01.154] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:24:0)
[06:07:01.196] Build status: STARTED
[06:07:01.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:25:0) after 3m16s
[06:10:17.256] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:25:0)
[06:10:17.686] Build status: STARTED
[06:10:17.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:26:0) after 4m32s
[06:14:49.712] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:26:0)
[06:14:49.736] Build status: STARTED
[06:14:49.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:27:0) after 7m15s
[06:22:04.766] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:27:0)
[06:22:04.836] Build status: STARTED
[06:22:04.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:28:0) after 2m0s
[06:24:04.977] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:28:0)
[06:24:05.010] Build status: STARTED
[06:24:05.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:29:0) after 3m0s
[06:27:05.354] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:29:0)
[06:27:05.435] Build status: STARTED
[06:27:05.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:30:0) after 9m29s
[06:36:34.958] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:30:0)
[06:36:34.975] Build status: STARTED
[06:36:34.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:31:0) after 5m5s
[06:41:40.067] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:31:0)
[06:41:40.087] Build status: STARTED
[06:41:40.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:32:0) after 7m49s
[06:49:29.127] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:32:0)
[06:49:29.164] Build status: STARTED
[06:49:29.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:33:0) after 6m36s
[06:56:05.194] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:33:0)
[06:56:05.211] Build status: STARTED
[06:56:05.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:34:0) after 7m29s
[07:03:34.263] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:34:0)
[07:03:34.296] Build status: STARTED
[07:03:34.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:35:0) after 8m46s
[07:12:20.483] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:35:0)
[07:12:20.506] Build status: STARTED
[07:12:20.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:36:0) after 7m42s
[07:20:02.617] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:36:0)
[07:20:02.635] Build status: STARTED
[07:20:02.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:37:0) after 1m9s
[07:21:11.795] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:37:0)
[07:21:11.818] Build status: STARTED
[07:21:11.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:38:0) after 4m44s
[07:25:55.812] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:38:0)
[07:25:55.839] Build status: STARTED
[07:25:55.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:39:0) after 7m55s
[07:33:50.917] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:39:0)
[07:33:50.939] Build status: STARTED
[07:33:50.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:40:0) after 1m2s
[07:34:53.326] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:40:0)
[07:34:53.386] Build status: STARTED
[07:34:53.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:41:0) after 7m44s
[07:42:37.450] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:41:0)
[07:42:37.515] Build status: STARTED
[07:42:37.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:42:0) after 1m44s
[07:44:21.543] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:42:0)
[07:44:21.561] Build status: STARTED
[07:44:21.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:43:0) after 5m50s
[07:50:11.588] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:43:0)
[07:50:11.619] Build status: STARTED
[07:50:11.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:44:0) after 6m41s
[07:56:52.642] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:44:0)
[07:56:52.660] Build status: STARTED
[07:56:52.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:45:0) after 1m35s
[07:58:27.768] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:45:0)
[07:58:27.816] Build status: STARTED
[07:58:27.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:46:0) after 3m56s
[08:02:23.841] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:46:0)
[08:02:23.879] Build status: STARTED
[08:02:23.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:47:0) after 8m12s
[08:10:36.102] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:47:0)
[08:10:36.120] Build status: STARTED
[08:10:36.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:48:0) after 5m15s
[08:15:51.150] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:48:0)
[08:15:51.175] Build status: STARTED
[08:15:51.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:49:0) after 3m56s
[08:19:47.922] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:49:0)
[08:19:47.941] Build status: STARTED
[08:19:47.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:50:0) after 6m6s
[08:25:53.977] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:50:0)
[08:25:54.044] Build status: STARTED
[08:25:54.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:51:0) after 6m15s
[08:32:09.127] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:51:0)
[08:32:09.155] Build status: STARTED
[08:32:09.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:52:0) after 4m41s
[08:36:50.179] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:52:0)
[08:36:50.219] Build status: STARTED
[08:36:50.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:53:0) after 7m1s
[08:43:51.248] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:53:0)
[08:43:51.287] Build status: STARTED
[08:43:51.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:54:0) after 7m50s
[08:51:41.369] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:54:0)
[08:51:41.388] Build status: STARTED
[08:51:41.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:55:0) after 6m34s
[08:58:15.428] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:55:0)
[08:58:15.465] Build status: STARTED
[08:58:15.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:56:0) after 1m48s
[09:00:03.951] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:56:0)
[09:00:03.993] Build status: STARTED
[09:00:03.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:57:0) after 3m51s
[09:03:55.089] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:57:0)
[09:03:55.132] Build status: STARTED
[09:03:55.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:58:0) after 4m23s
[09:08:18.306] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:58:0)
[09:08:18.505] Build status: STARTED
[09:08:18.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:59:0) after 2m54s
[09:11:12.710] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:59:0)
[09:11:12.732] Build status: STARTED
[09:11:12.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:60:0) after 2m57s
[09:14:09.763] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:60:0)
[09:14:09.813] Build status: STARTED
[09:14:09.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:61:0) after 6m52s
[09:21:02.072] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:61:0)
[09:21:02.096] Build status: STARTED
[09:21:02.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:62:0) after 2m18s
[09:23:20.630] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:62:0)
[09:23:20.659] Build status: STARTED
[09:23:20.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:63:0) after 2m19s
[09:25:39.856] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:63:0)
[09:25:39.873] Build status: STARTED
[09:25:39.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:64:0) after 2m44s
[09:28:24.359] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:64:0)
[09:28:24.477] Build status: STARTED
[09:28:24.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:65:0) after 9m51s
[09:38:15.512] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:65:0)
[09:38:15.559] Build status: STARTED
[09:38:15.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:66:0) after 1m15s
[09:39:30.582] Handling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:66:0)
[09:39:30.601] Build status: STARTED
[09:39:30.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTChromeOS:8918498546998755552:67:0) after 7m0s
[09:43:27.531] Received PubSub notification, asking Buildbucket for the build status
[09:43:27.576] Build:
{
"id": "8753068485005631265",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTChromeOS"
},
"number": 7992,
"createdBy": "project:chromium",
"createTime": "2024-03-19T03:53:38.313364944Z",
"startTime": "2024-03-19T03:55:01.618616Z",
"endTime": "2024-03-19T09:42:58.421284Z",
"updateTime": "2024-03-19T09:42:58.421284Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8ff0ab4150146596b3dd1760221d630a68d488d0",
"ref": "refs/heads/main"
}
},
"canary": true
}
[09:43:27.576] Invocation finished in 5h49m50.547801754s with status FAILED