[15:28:45.021] New invocation is queued and will start shortly
[15:28:46.264] Starting the invocation (attempt 1)
[15:28:46.301] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/798a93d1f60f951ef6603f96438bd09684b99caa"
[15:28:46.301] Popped gitiles commit info from properties and tags
[15:28:46.301] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:28:46.302] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:28:46.302] Buildbucket request:
{
"requestId": "8973084783759938240",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacCoverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "798a93d1f60f951ef6603f96438bd09684b99caa",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8973084783759938240"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacCoverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:28:47.041] Scheduled build:
{
"id": "8807654721668176689",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacCoverage"
},
"number": 51030,
"createdBy": "project:chromium",
"createTime": "2022-07-25T15:28:46.378978994Z",
"updateTime": "2022-07-25T15:28:46.378978994Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "798a93d1f60f951ef6603f96438bd09684b99caa",
"ref": "refs/heads/main"
}
},
"canary": true
}
[15:28:47.041] Task URL: https://cr-buildbucket.appspot.com/build/8807654721668176689
[15:28:47.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:2:0) after 5m3s
[15:33:50.447] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:2:0)
[15:33:50.469] Build status: SCHEDULED
[15:33:50.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:3:0) after 7m29s
[15:41:19.541] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:3:0)
[15:41:19.570] Build status: SCHEDULED
[15:41:19.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:4:0) after 6m27s
[15:47:46.634] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:4:0)
[15:47:46.702] Build status: SCHEDULED
[15:47:46.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:5:0) after 2m22s
[15:50:09.001] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:5:0)
[15:50:09.036] Build status: SCHEDULED
[15:50:09.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:6:0) after 1m48s
[15:51:57.203] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:6:0)
[15:51:57.222] Build status: SCHEDULED
[15:51:57.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:7:0) after 4m32s
[15:56:29.245] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:7:0)
[15:56:29.267] Build status: SCHEDULED
[15:56:29.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:8:0) after 7m55s
[16:04:24.401] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:8:0)
[16:04:24.420] Build status: SCHEDULED
[16:04:24.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:9:0) after 4m41s
[16:09:05.448] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:9:0)
[16:09:05.470] Build status: SCHEDULED
[16:09:05.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:10:0) after 9m21s
[16:18:26.637] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:10:0)
[16:18:26.657] Build status: SCHEDULED
[16:18:26.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:11:0) after 5m22s
[16:23:48.782] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:11:0)
[16:23:48.839] Build status: SCHEDULED
[16:23:48.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:12:0) after 5m4s
[16:28:52.963] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:12:0)
[16:28:52.985] Build status: SCHEDULED
[16:28:52.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:13:0) after 3m49s
[16:32:42.435] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:13:0)
[16:32:42.457] Build status: SCHEDULED
[16:32:42.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:14:0) after 5m26s
[16:38:08.959] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:14:0)
[16:38:09.034] Build status: SCHEDULED
[16:38:09.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:15:0) after 9m43s
[16:47:52.249] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:15:0)
[16:47:52.278] Build status: SCHEDULED
[16:47:52.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:16:0) after 4m32s
[16:52:25.290] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:16:0)
[16:52:25.326] Build status: SCHEDULED
[16:52:25.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:17:0) after 4m17s
[16:56:42.426] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:17:0)
[16:56:42.453] Build status: SCHEDULED
[16:56:42.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:18:0) after 5m9s
[17:01:51.476] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:18:0)
[17:01:51.564] Build status: SCHEDULED
[17:01:51.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:19:0) after 9m2s
[17:10:53.579] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:19:0)
[17:10:53.602] Build status: SCHEDULED
[17:10:53.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:20:0) after 2m54s
[17:13:47.671] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:20:0)
[17:13:47.717] Build status: SCHEDULED
[17:13:47.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:21:0) after 5m39s
[17:19:26.735] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:21:0)
[17:19:26.755] Build status: SCHEDULED
[17:19:26.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:22:0) after 9m11s
[17:28:37.882] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:22:0)
[17:28:37.911] Build status: SCHEDULED
[17:28:37.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:23:0) after 6m15s
[17:34:52.988] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:23:0)
[17:34:53.007] Build status: SCHEDULED
[17:34:53.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:24:0) after 1m35s
[17:36:28.031] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:24:0)
[17:36:28.053] Build status: SCHEDULED
[17:36:28.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:25:0) after 1m41s
[17:38:09.076] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:25:0)
[17:38:09.106] Build status: SCHEDULED
[17:38:09.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:26:0) after 9m35s
[17:47:44.127] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:26:0)
[17:47:44.159] Build status: SCHEDULED
[17:47:44.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:27:0) after 9m13s
[17:56:57.199] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:27:0)
[17:56:57.234] Build status: SCHEDULED
[17:56:57.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:28:0) after 5m15s
[18:02:12.671] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:28:0)
[18:02:12.755] Build status: SCHEDULED
[18:02:12.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:29:0) after 5m38s
[18:07:50.951] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:29:0)
[18:07:50.986] Build status: SCHEDULED
[18:07:50.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:30:0) after 6m7s
[18:13:58.008] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:30:0)
[18:13:58.031] Build status: SCHEDULED
[18:13:58.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:31:0) after 5m46s
[18:19:44.233] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:31:0)
[18:19:44.253] Build status: SCHEDULED
[18:19:44.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:32:0) after 2m59s
[18:22:43.366] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:32:0)
[18:22:43.390] Build status: SCHEDULED
[18:22:43.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:33:0) after 3m11s
[18:25:54.481] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:33:0)
[18:25:54.509] Build status: SCHEDULED
[18:25:54.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:34:0) after 2m42s
[18:28:36.580] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:34:0)
[18:28:36.603] Build status: SCHEDULED
[18:28:36.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:35:0) after 9m14s
[18:37:50.831] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:35:0)
[18:37:50.930] Build status: SCHEDULED
[18:37:50.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:36:0) after 4m15s
[18:42:05.954] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:36:0)
[18:42:05.977] Build status: SCHEDULED
[18:42:05.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:37:0) after 6m40s
[18:48:46.000] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:37:0)
[18:48:46.020] Build status: SCHEDULED
[18:48:46.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:38:0) after 1m4s
[18:49:50.052] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:38:0)
[18:49:50.075] Build status: SCHEDULED
[18:49:50.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:39:0) after 8m11s
[18:58:01.525] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:39:0)
[18:58:01.579] Build status: SCHEDULED
[18:58:01.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:40:0) after 5m24s
[19:03:25.675] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:40:0)
[19:03:25.698] Build status: SCHEDULED
[19:03:25.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:41:0) after 3m0s
[19:06:25.802] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:41:0)
[19:06:25.826] Build status: SCHEDULED
[19:06:25.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:42:0) after 2m2s
[19:08:27.864] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:42:0)
[19:08:27.886] Build status: SCHEDULED
[19:08:27.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:43:0) after 5m15s
[19:13:42.944] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:43:0)
[19:13:42.963] Build status: SCHEDULED
[19:13:42.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:44:0) after 1m45s
[19:15:28.267] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:44:0)
[19:15:28.286] Build status: SCHEDULED
[19:15:28.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:45:0) after 3m52s
[19:19:20.549] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:45:0)
[19:19:20.573] Build status: SCHEDULED
[19:19:20.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:46:0) after 7m39s
[19:26:59.644] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:46:0)
[19:26:59.685] Build status: SCHEDULED
[19:26:59.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:47:0) after 3m23s
[19:30:22.919] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:47:0)
[19:30:22.939] Build status: SCHEDULED
[19:30:22.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:48:0) after 2m2s
[19:32:24.957] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:48:0)
[19:32:24.977] Build status: SCHEDULED
[19:32:24.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:49:0) after 1m6s
[19:33:31.007] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:49:0)
[19:33:31.028] Build status: SCHEDULED
[19:33:31.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:50:0) after 4m27s
[19:37:58.049] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:50:0)
[19:37:58.160] Build status: SCHEDULED
[19:37:58.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:51:0) after 9m30s
[19:47:28.352] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:51:0)
[19:47:28.376] Build status: SCHEDULED
[19:47:28.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:52:0) after 4m14s
[19:51:42.660] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:52:0)
[19:51:42.682] Build status: SCHEDULED
[19:51:42.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:53:0) after 2m36s
[19:53:46.808] Received PubSub notification, asking Buildbucket for the build status
[19:53:46.832] Build status: STARTED
[19:54:18.708] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:53:0)
[19:54:18.742] Build status: STARTED
[19:54:18.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:55:0) after 9m58s
[20:04:16.869] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:55:0)
[20:04:16.891] Build status: STARTED
[20:04:16.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8973084783759938240:56:0) after 9m49s
[20:10:50.644] Received PubSub notification, asking Buildbucket for the build status
[20:10:50.666] Build:
{
"id": "8807654721668176689",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacCoverage"
},
"number": 51030,
"createdBy": "project:chromium",
"createTime": "2022-07-25T15:28:46.378978994Z",
"startTime": "2022-07-25T19:53:46.372714Z",
"endTime": "2022-07-25T20:10:50.279413995Z",
"updateTime": "2022-07-25T20:10:50.279413995Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "798a93d1f60f951ef6603f96438bd09684b99caa",
"ref": "refs/heads/main"
}
},
"canary": true
}
[20:10:50.666] Invocation finished in 4h42m5.66596455s with status FAILED