[03:04:57.728] New invocation is queued and will start shortly
[03:04:58.853] Starting the invocation (attempt 1)
[03:04:58.894] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a23c9ee35ce2b4da1fa62c3d740de6bd7f55d14a"
[03:04:58.894] Popped gitiles commit info from properties and tags
[03:04:58.894] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:04:58.894] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:04:58.894] Buildbucket request:
{
"requestId": "9002937980808248800",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a23c9ee35ce2b4da1fa62c3d740de6bd7f55d14a",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9002937980808248800"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:04:59.348] Scheduled build:
{
"id": "8837507918856812209",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 26440,
"createdBy": "project:chromium",
"createTime": "2021-08-30T03:04:58.957304796Z",
"updateTime": "2021-08-30T03:04:59.186175563Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a23c9ee35ce2b4da1fa62c3d740de6bd7f55d14a",
"ref": "refs/heads/main"
}
}
}
[03:04:59.348] Task URL: https://cr-buildbucket.appspot.com/build/8837507918856812209
[03:04:59.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:2:0) after 9m30s
[03:05:08.996] Received PubSub notification, asking Buildbucket for the build status
[03:05:09.024] Build status: STARTED
[03:14:29.701] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:2:0)
[03:14:29.731] Build status: STARTED
[03:14:29.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:4:0) after 7m21s
[03:21:50.755] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:4:0)
[03:21:50.785] Build status: STARTED
[03:21:50.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:5:0) after 4m24s
[03:26:14.905] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:5:0)
[03:26:14.950] Build status: STARTED
[03:26:14.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:6:0) after 3m1s
[03:29:16.280] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:6:0)
[03:29:16.304] Build status: STARTED
[03:29:16.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:7:0) after 3m53s
[03:33:09.422] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:7:0)
[03:33:09.456] Build status: STARTED
[03:33:09.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:8:0) after 9m11s
[03:42:20.597] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:8:0)
[03:42:20.633] Build status: STARTED
[03:42:20.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:9:0) after 6m20s
[03:48:40.749] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:9:0)
[03:48:40.781] Build status: STARTED
[03:48:40.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:10:0) after 1m25s
[03:50:05.866] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:10:0)
[03:50:05.891] Build status: STARTED
[03:50:05.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:11:0) after 6m45s
[03:56:50.911] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:11:0)
[03:56:50.935] Build status: STARTED
[03:56:50.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:12:0) after 9m36s
[04:06:26.989] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:12:0)
[04:06:27.022] Build status: STARTED
[04:06:27.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:13:0) after 7m15s
[04:13:42.041] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:13:0)
[04:13:42.080] Build status: STARTED
[04:13:42.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:14:0) after 6m45s
[04:20:27.097] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:14:0)
[04:20:27.134] Build status: STARTED
[04:20:27.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:15:0) after 4m14s
[04:24:41.153] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:15:0)
[04:24:41.183] Build status: STARTED
[04:24:41.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:16:0) after 5m7s
[04:29:48.202] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:16:0)
[04:29:48.670] Build status: STARTED
[04:29:48.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:17:0) after 9m42s
[04:39:30.686] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:17:0)
[04:39:30.720] Build status: STARTED
[04:39:30.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:18:0) after 1m8s
[04:40:38.737] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:18:0)
[04:40:38.767] Build status: STARTED
[04:40:38.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:19:0) after 3m4s
[04:43:42.784] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:19:0)
[04:43:42.811] Build status: STARTED
[04:43:42.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:20:0) after 2m37s
[04:46:20.078] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:20:0)
[04:46:20.108] Build status: STARTED
[04:46:20.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:21:0) after 9m45s
[04:56:05.118] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:21:0)
[04:56:05.208] Build status: STARTED
[04:56:05.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:22:0) after 1m9s
[04:57:14.225] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:22:0)
[04:57:14.303] Build status: STARTED
[04:57:14.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:23:0) after 3m51s
[05:01:05.453] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:23:0)
[05:01:05.490] Build status: STARTED
[05:01:05.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:24:0) after 5m53s
[05:06:58.663] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:24:0)
[05:06:58.695] Build status: STARTED
[05:06:58.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:25:0) after 4m11s
[05:11:09.720] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:25:0)
[05:11:09.745] Build status: STARTED
[05:11:09.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:26:0) after 2m19s
[05:13:28.788] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:26:0)
[05:13:28.821] Build status: STARTED
[05:13:28.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:27:0) after 8m34s
[05:22:03.506] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:27:0)
[05:22:03.555] Build status: STARTED
[05:22:03.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:28:0) after 2m56s
[05:24:59.861] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:28:0)
[05:24:59.964] Build status: STARTED
[05:24:59.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:29:0) after 5m20s
[05:30:20.329] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:29:0)
[05:30:20.356] Build status: STARTED
[05:30:20.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:30:0) after 4m41s
[05:35:01.433] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:30:0)
[05:35:01.496] Build status: STARTED
[05:35:01.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:31:0) after 5m32s
[05:40:33.796] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:31:0)
[05:40:33.838] Build status: STARTED
[05:40:33.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:32:0) after 9m50s
[05:50:23.868] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:32:0)
[05:50:23.914] Build status: STARTED
[05:50:23.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:33:0) after 7m23s
[05:57:46.930] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:33:0)
[05:57:46.960] Build status: STARTED
[05:57:46.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:34:0) after 6m34s
[06:04:20.983] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:34:0)
[06:04:21.016] Build status: STARTED
[06:04:21.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:35:0) after 5m6s
[06:09:27.040] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:35:0)
[06:09:27.138] Build status: STARTED
[06:09:27.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:36:0) after 8m50s
[06:18:17.158] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:36:0)
[06:18:17.188] Build status: STARTED
[06:18:17.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:37:0) after 2m40s
[06:20:57.311] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:37:0)
[06:20:57.336] Build status: STARTED
[06:20:57.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:38:0) after 7m41s
[06:28:38.355] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:38:0)
[06:28:38.381] Build status: STARTED
[06:28:38.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:39:0) after 6m43s
[06:35:21.403] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:39:0)
[06:35:21.450] Build status: STARTED
[06:35:21.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:40:0) after 3m38s
[06:38:59.554] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:40:0)
[06:38:59.578] Build status: STARTED
[06:38:59.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:41:0) after 6m32s
[06:45:31.598] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:41:0)
[06:45:31.631] Build status: STARTED
[06:45:31.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:42:0) after 7m54s
[06:53:25.745] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:42:0)
[06:53:25.770] Build status: STARTED
[06:53:25.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:43:0) after 1m19s
[06:54:44.791] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:43:0)
[06:54:44.818] Build status: STARTED
[06:54:44.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:44:0) after 6m58s
[07:01:42.858] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:44:0)
[07:01:42.889] Build status: STARTED
[07:01:42.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:45:0) after 6m2s
[07:07:44.935] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:45:0)
[07:07:44.969] Build status: STARTED
[07:07:44.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:46:0) after 5m38s
[07:13:22.986] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:46:0)
[07:13:23.044] Build status: STARTED
[07:13:23.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:47:0) after 7m17s
[07:20:40.086] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:47:0)
[07:20:40.124] Build status: STARTED
[07:20:40.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:48:0) after 9m1s
[07:29:41.170] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:48:0)
[07:29:41.203] Build status: STARTED
[07:29:41.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:49:0) after 2m54s
[07:32:35.283] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:49:0)
[07:32:35.324] Build status: STARTED
[07:32:35.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:50:0) after 8m10s
[07:40:45.503] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:50:0)
[07:40:45.534] Build status: STARTED
[07:40:45.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:51:0) after 6m50s
[07:47:35.569] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:51:0)
[07:47:35.669] Build status: STARTED
[07:47:35.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:52:0) after 6m34s
[07:54:09.907] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:52:0)
[07:54:09.945] Build status: STARTED
[07:54:09.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:53:0) after 1m1s
[07:55:10.998] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:53:0)
[07:55:11.035] Build status: STARTED
[07:55:11.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:54:0) after 2m57s
[07:58:08.059] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:54:0)
[07:58:08.156] Build status: STARTED
[07:58:08.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:55:0) after 8m16s
[08:06:24.131] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:55:0)
[08:06:24.161] Build status: STARTED
[08:06:24.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:56:0) after 1m12s
[08:07:36.182] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:56:0)
[08:07:36.220] Build status: STARTED
[08:07:36.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:57:0) after 6m46s
[08:14:22.242] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:57:0)
[08:14:22.272] Build status: STARTED
[08:14:22.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:58:0) after 9m5s
[08:23:27.301] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:58:0)
[08:23:27.356] Build status: STARTED
[08:23:27.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:9002937980808248800:59:0) after 7m40s
[08:29:15.485] Received PubSub notification, asking Buildbucket for the build status
[08:29:15.520] Build:
{
"id": "8837507918856812209",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 26440,
"createdBy": "project:chromium",
"createTime": "2021-08-30T03:04:58.957304796Z",
"startTime": "2021-08-30T03:05:08.213894Z",
"endTime": "2021-08-30T08:29:14.877010135Z",
"updateTime": "2021-08-30T08:29:14.877763766Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a23c9ee35ce2b4da1fa62c3d740de6bd7f55d14a",
"ref": "refs/heads/main"
}
}
}
[08:29:15.520] Invocation finished in 5h24m17.808503244s with status FAILED