[18:44:07.875] New invocation is queued and will start shortly
[18:44:08.984] Starting the invocation (attempt 1)
[18:44:09.022] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/461b86b8f6479eb4c4978e4890971551700dd9cb"
[18:44:09.022] Popped gitiles commit info from properties and tags
[18:44:09.022] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:44:09.022] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:44:09.022] Buildbucket request:
{
"requestId": "8980229651796282304",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "461b86b8f6479eb4c4978e4890971551700dd9cb",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8980229651796282304"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWin"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:44:09.567] Scheduled build:
{
"id": "8814799589840061585",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin"
},
"number": 1416,
"createdBy": "project:chromium",
"createTime": "2022-05-07T18:44:09.109555655Z",
"updateTime": "2022-05-07T18:44:09.109555655Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "461b86b8f6479eb4c4978e4890971551700dd9cb",
"ref": "refs/heads/main"
}
}
}
[18:44:09.567] Task URL: https://cr-buildbucket.appspot.com/build/8814799589840061585
[18:44:09.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:2:0) after 7m20s
[18:49:44.466] Received PubSub notification, asking Buildbucket for the build status
[18:49:44.488] Build status: STARTED
[18:51:29.586] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:2:0)
[18:51:29.627] Build status: STARTED
[18:51:29.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:4:0) after 3m56s
[18:55:25.707] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:4:0)
[18:55:25.763] Build status: STARTED
[18:55:25.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:5:0) after 3m44s
[18:59:09.818] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:5:0)
[18:59:09.838] Build status: STARTED
[18:59:09.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:6:0) after 1m37s
[19:00:46.960] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:6:0)
[19:00:47.013] Build status: STARTED
[19:00:47.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:7:0) after 4m2s
[19:04:49.371] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:7:0)
[19:04:49.393] Build status: STARTED
[19:04:49.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:8:0) after 4m16s
[19:09:05.580] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:8:0)
[19:09:05.608] Build status: STARTED
[19:09:05.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:9:0) after 3m44s
[19:12:49.726] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:9:0)
[19:12:49.760] Build status: STARTED
[19:12:49.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:10:0) after 1m0s
[19:13:50.081] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:10:0)
[19:13:50.104] Build status: STARTED
[19:13:50.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:11:0) after 3m47s
[19:17:37.167] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:11:0)
[19:17:37.202] Build status: STARTED
[19:17:37.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:12:0) after 1m30s
[19:19:07.225] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:12:0)
[19:19:07.264] Build status: STARTED
[19:19:07.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:13:0) after 8m16s
[19:27:23.284] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:13:0)
[19:27:23.313] Build status: STARTED
[19:27:23.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:14:0) after 2m33s
[19:29:56.522] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:14:0)
[19:29:56.603] Build status: STARTED
[19:29:56.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:15:0) after 6m43s
[19:36:39.622] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:15:0)
[19:36:39.641] Build status: STARTED
[19:36:39.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:16:0) after 6m10s
[19:42:49.868] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:16:0)
[19:42:49.904] Build status: STARTED
[19:42:49.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:17:0) after 7m50s
[19:50:39.973] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:17:0)
[19:50:39.992] Build status: STARTED
[19:50:39.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:18:0) after 2m18s
[19:52:58.010] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:18:0)
[19:52:58.053] Build status: STARTED
[19:52:58.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:19:0) after 2m50s
[19:55:48.072] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:19:0)
[19:55:48.104] Build status: STARTED
[19:55:48.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:20:0) after 2m14s
[19:58:02.129] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:20:0)
[19:58:02.151] Build status: STARTED
[19:58:02.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:21:0) after 7m51s
[20:05:53.204] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:21:0)
[20:05:53.286] Build status: STARTED
[20:05:53.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:22:0) after 7m57s
[20:13:50.306] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:22:0)
[20:13:50.366] Build status: STARTED
[20:13:50.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:23:0) after 8m37s
[20:22:27.796] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:23:0)
[20:22:27.826] Build status: STARTED
[20:22:27.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:24:0) after 1m53s
[20:24:20.871] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:24:0)
[20:24:20.890] Build status: STARTED
[20:24:20.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:25:0) after 7m38s
[20:31:58.986] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:25:0)
[20:31:59.009] Build status: STARTED
[20:31:59.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:26:0) after 6m26s
[20:38:25.029] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:26:0)
[20:38:25.062] Build status: STARTED
[20:38:25.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:27:0) after 2m16s
[20:40:41.091] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:27:0)
[20:40:41.164] Build status: STARTED
[20:40:41.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:28:0) after 2m30s
[20:43:11.323] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:28:0)
[20:43:11.359] Build status: STARTED
[20:43:11.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:29:0) after 4m37s
[20:47:48.382] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:29:0)
[20:47:48.404] Build status: STARTED
[20:47:48.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:30:0) after 6m46s
[20:54:34.424] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:30:0)
[20:54:34.467] Build status: STARTED
[20:54:34.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:31:0) after 4m22s
[20:58:56.638] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:31:0)
[20:58:56.658] Build status: STARTED
[20:58:56.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:32:0) after 7m42s
[21:06:38.981] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:32:0)
[21:06:39.005] Build status: STARTED
[21:06:39.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:33:0) after 5m0s
[21:11:39.019] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:33:0)
[21:11:39.044] Build status: STARTED
[21:11:39.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:34:0) after 2m50s
[21:14:29.068] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:34:0)
[21:14:29.093] Build status: STARTED
[21:14:29.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:35:0) after 6m10s
[21:20:39.113] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:35:0)
[21:20:39.136] Build status: STARTED
[21:20:39.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:36:0) after 1m30s
[21:22:09.156] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:36:0)
[21:22:09.223] Build status: STARTED
[21:22:09.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:37:0) after 8m43s
[21:30:52.254] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:37:0)
[21:30:52.295] Build status: STARTED
[21:30:52.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:38:0) after 4m32s
[21:35:24.805] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:38:0)
[21:35:24.839] Build status: STARTED
[21:35:24.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:39:0) after 1m31s
[21:36:55.913] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:39:0)
[21:36:55.989] Build status: STARTED
[21:36:55.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:40:0) after 6m19s
[21:43:15.106] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:40:0)
[21:43:15.160] Build status: STARTED
[21:43:15.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:41:0) after 9m38s
[21:52:53.330] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:41:0)
[21:52:53.351] Build status: STARTED
[21:52:53.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:42:0) after 3m56s
[21:56:49.399] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:42:0)
[21:56:49.452] Build status: STARTED
[21:56:49.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:43:0) after 9m1s
[22:05:50.619] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:43:0)
[22:05:50.664] Build status: STARTED
[22:05:50.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:44:0) after 4m7s
[22:09:57.794] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:44:0)
[22:09:57.825] Build status: STARTED
[22:09:57.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:45:0) after 4m59s
[22:14:57.045] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:45:0)
[22:14:57.066] Build status: STARTED
[22:14:57.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:46:0) after 7m11s
[22:22:08.172] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:46:0)
[22:22:08.203] Build status: STARTED
[22:22:08.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:47:0) after 9m15s
[22:31:23.343] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:47:0)
[22:31:23.392] Build status: STARTED
[22:31:23.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:48:0) after 8m34s
[22:39:57.411] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:48:0)
[22:39:57.654] Build status: STARTED
[22:39:57.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:49:0) after 9m4s
[22:49:01.779] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:49:0)
[22:49:01.811] Build status: STARTED
[22:49:01.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:50:0) after 2m24s
[22:51:26.029] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:50:0)
[22:51:26.108] Build status: STARTED
[22:51:26.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:51:0) after 1m56s
[22:53:22.126] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:51:0)
[22:53:22.144] Build status: STARTED
[22:53:22.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:52:0) after 5m37s
[22:58:59.281] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:52:0)
[22:58:59.317] Build status: STARTED
[22:58:59.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:53:0) after 9m41s
[23:08:40.506] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:53:0)
[23:08:40.541] Build status: STARTED
[23:08:40.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:54:0) after 4m16s
[23:12:56.735] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:54:0)
[23:12:56.767] Build status: STARTED
[23:12:56.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:55:0) after 2m56s
[23:15:52.988] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:55:0)
[23:15:53.009] Build status: STARTED
[23:15:53.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:56:0) after 3m29s
[23:19:22.026] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:56:0)
[23:19:22.061] Build status: STARTED
[23:19:22.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:57:0) after 6m1s
[23:25:23.412] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:57:0)
[23:25:23.433] Build status: STARTED
[23:25:23.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:58:0) after 8m58s
[23:34:21.466] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:58:0)
[23:34:21.485] Build status: STARTED
[23:34:21.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:59:0) after 9m18s
[23:43:39.608] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:59:0)
[23:43:39.627] Build status: STARTED
[23:43:39.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:60:0) after 9m4s
[23:52:43.939] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:60:0)
[23:52:43.969] Build status: STARTED
[23:52:43.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:61:0) after 4m54s
[23:57:37.992] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:61:0)
[23:57:38.024] Build status: STARTED
[23:57:38.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:62:0) after 1m25s
[23:59:03.011] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:62:0)
[23:59:03.035] Build status: STARTED
[23:59:03.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:63:0) after 9m55s
[00:08:58.057] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:63:0)
[00:08:58.094] Build status: STARTED
[00:08:58.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:64:0) after 4m40s
[00:13:38.093] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:64:0)
[00:13:38.127] Build status: STARTED
[00:13:38.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:65:0) after 6m15s
[00:19:53.150] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:65:0)
[00:19:53.184] Build status: STARTED
[00:19:53.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:66:0) after 2m56s
[00:22:49.216] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:66:0)
[00:22:49.469] Build status: STARTED
[00:22:49.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:67:0) after 8m21s
[00:31:11.124] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:67:0)
[00:31:11.166] Build status: STARTED
[00:31:11.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:68:0) after 3m54s
[00:35:05.473] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:68:0)
[00:35:05.491] Build status: STARTED
[00:35:05.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:69:0) after 2m9s
[00:37:14.753] Handling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:69:0)
[00:37:14.777] Build status: STARTED
[00:37:14.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin:8980229651796282304:70:0) after 2m34s
[00:39:36.188] Received PubSub notification, asking Buildbucket for the build status
[00:39:36.250] Build:
{
"id": "8814799589840061585",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin"
},
"number": 1416,
"createdBy": "project:chromium",
"createTime": "2022-05-07T18:44:09.109555655Z",
"startTime": "2022-05-07T18:49:42.006579Z",
"endTime": "2022-05-08T00:39:35.823011488Z",
"updateTime": "2022-05-08T00:39:35.823011488Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "461b86b8f6479eb4c4978e4890971551700dd9cb",
"ref": "refs/heads/main"
}
}
}
[00:39:36.250] Invocation finished in 5h55m28.389971235s with status FAILED