[09:07:35.486] New invocation is queued and will start shortly
[09:07:36.544] Starting the invocation (attempt 1)
[09:07:36.591] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2abf46d4a34e7e44e0e31e57615d5c8bde3fb4f1"
[09:07:36.591] Popped gitiles commit info from properties and tags
[09:07:36.591] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:07:36.591] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:07:36.592] Buildbucket request:
{
"requestId": "8916848048056467648",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2abf46d4a34e7e44e0e31e57615d5c8bde3fb4f1",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8916848048056467648"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:07:37.219] Scheduled build:
{
"id": "8751417986083212529",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 22337,
"createdBy": "project:chromium",
"createTime": "2024-04-06T09:07:36.744075138Z",
"updateTime": "2024-04-06T09:07:36.744075138Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2abf46d4a34e7e44e0e31e57615d5c8bde3fb4f1",
"ref": "refs/heads/main"
}
}
}
[09:07:37.219] Task URL: https://cr-buildbucket.appspot.com/build/8751417986083212529
[09:07:37.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:2:0) after 3m56s
[09:07:38.135] Received PubSub notification, asking Buildbucket for the build status
[09:07:38.152] Build status: SCHEDULED
[09:09:35.696] Received PubSub notification, asking Buildbucket for the build status
[09:09:35.790] Build status: STARTED
[09:11:33.251] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:2:0)
[09:11:33.280] Build status: STARTED
[09:11:33.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:5:0) after 4m35s
[09:16:08.361] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:5:0)
[09:16:08.413] Build status: STARTED
[09:16:08.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:6:0) after 5m37s
[09:21:45.427] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:6:0)
[09:21:45.517] Build status: STARTED
[09:21:45.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:7:0) after 9m3s
[09:30:48.637] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:7:0)
[09:30:48.690] Build status: STARTED
[09:30:48.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:8:0) after 3m38s
[09:34:26.733] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:8:0)
[09:34:26.754] Build status: STARTED
[09:34:26.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:9:0) after 5m59s
[09:40:25.801] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:9:0)
[09:40:25.825] Build status: STARTED
[09:40:25.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:10:0) after 2m57s
[09:43:23.077] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:10:0)
[09:43:23.102] Build status: STARTED
[09:43:23.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:11:0) after 8m13s
[09:51:36.221] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:11:0)
[09:51:36.262] Build status: STARTED
[09:51:36.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:12:0) after 8m14s
[09:59:50.324] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:12:0)
[09:59:50.347] Build status: STARTED
[09:59:50.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:13:0) after 1m59s
[10:01:49.466] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:13:0)
[10:01:49.509] Build status: STARTED
[10:01:49.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:14:0) after 9m32s
[10:11:21.560] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:14:0)
[10:11:21.600] Build status: STARTED
[10:11:21.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:15:0) after 9m31s
[10:20:52.615] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:15:0)
[10:20:52.638] Build status: STARTED
[10:20:52.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:16:0) after 4m29s
[10:25:21.745] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:16:0)
[10:25:21.774] Build status: STARTED
[10:25:21.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:17:0) after 8m26s
[10:33:47.799] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:17:0)
[10:33:47.898] Build status: STARTED
[10:33:47.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:18:0) after 4m10s
[10:37:58.012] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:18:0)
[10:37:58.034] Build status: STARTED
[10:37:58.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:19:0) after 5m54s
[10:43:52.331] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:19:0)
[10:43:52.348] Build status: STARTED
[10:43:52.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:20:0) after 2m34s
[10:46:26.364] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:20:0)
[10:46:26.388] Build status: STARTED
[10:46:26.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:21:0) after 7m42s
[10:54:08.410] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:21:0)
[10:54:08.430] Build status: STARTED
[10:54:08.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:22:0) after 8m15s
[11:02:23.446] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:22:0)
[11:02:23.598] Build status: STARTED
[11:02:23.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:23:0) after 9m22s
[11:11:45.619] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:23:0)
[11:11:45.693] Build status: STARTED
[11:11:45.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:24:0) after 7m5s
[11:18:51.039] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:24:0)
[11:18:51.058] Build status: STARTED
[11:18:51.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:25:0) after 4m55s
[11:23:46.077] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:25:0)
[11:23:46.099] Build status: STARTED
[11:23:46.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:26:0) after 4m20s
[11:28:06.264] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:26:0)
[11:28:06.289] Build status: STARTED
[11:28:06.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:27:0) after 6m12s
[11:34:18.451] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:27:0)
[11:34:18.490] Build status: STARTED
[11:34:18.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:28:0) after 6m44s
[11:41:03.643] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:28:0)
[11:41:03.674] Build status: STARTED
[11:41:03.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:29:0) after 2m22s
[11:43:27.653] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:29:0)
[11:43:27.672] Build status: STARTED
[11:43:27.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:30:0) after 7m0s
[11:50:27.747] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:30:0)
[11:50:27.772] Build status: STARTED
[11:50:27.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:31:0) after 9m30s
[11:59:57.789] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:31:0)
[11:59:57.807] Build status: STARTED
[11:59:57.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:32:0) after 3m19s
[12:03:16.939] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:32:0)
[12:03:16.956] Build status: STARTED
[12:03:16.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:33:0) after 1m7s
[12:04:24.272] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:33:0)
[12:04:24.292] Build status: STARTED
[12:04:24.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:34:0) after 6m14s
[12:10:38.393] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:34:0)
[12:10:38.421] Build status: STARTED
[12:10:38.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:35:0) after 2m3s
[12:12:41.441] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:35:0)
[12:12:41.466] Build status: STARTED
[12:12:41.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:36:0) after 1m11s
[12:13:52.455] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:36:0)
[12:13:52.540] Build status: STARTED
[12:13:52.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:37:0) after 3m7s
[12:16:59.567] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:37:0)
[12:16:59.593] Build status: STARTED
[12:16:59.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:38:0) after 2m24s
[12:19:23.899] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:38:0)
[12:19:23.919] Build status: STARTED
[12:19:23.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:39:0) after 8m9s
[12:27:32.943] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:39:0)
[12:27:32.965] Build status: STARTED
[12:27:32.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:40:0) after 6m24s
[12:33:57.010] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:40:0)
[12:33:57.141] Build status: STARTED
[12:33:57.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:41:0) after 4m11s
[12:38:08.727] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:41:0)
[12:38:08.750] Build status: STARTED
[12:38:08.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:42:0) after 4m7s
[12:42:15.772] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:42:0)
[12:42:15.794] Build status: STARTED
[12:42:15.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:43:0) after 4m22s
[12:46:38.016] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:43:0)
[12:46:38.038] Build status: STARTED
[12:46:38.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:44:0) after 5m11s
[12:51:49.266] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:44:0)
[12:51:49.289] Build status: STARTED
[12:51:49.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916848048056467648:45:0) after 5m16s
[12:55:07.957] Received PubSub notification, asking Buildbucket for the build status
[12:55:07.976] Build:
{
"id": "8751417986083212529",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 22337,
"createdBy": "project:chromium",
"createTime": "2024-04-06T09:07:36.744075138Z",
"startTime": "2024-04-06T09:09:35.288065207Z",
"endTime": "2024-04-06T12:55:07.578887364Z",
"updateTime": "2024-04-06T12:55:07.578887364Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2abf46d4a34e7e44e0e31e57615d5c8bde3fb4f1",
"ref": "refs/heads/main"
}
}
}
[12:55:07.976] Invocation finished in 3h47m32.497578678s with status FAILED