[11:01:32.590] New invocation is queued and will start shortly
[11:01:33.659] Starting the invocation (attempt 1)
[11:01:33.699] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2f03402d9fb91d94983001d34b19a88fbec37e72"
[11:01:33.699] Popped gitiles commit info from properties and tags
[11:01:33.699] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:01:33.699] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:01:33.699] Buildbucket request:
{
"requestId": "8974279355540224992",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2f03402d9fb91d94983001d34b19a88fbec37e72",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8974279355540224992"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:01:34.481] Scheduled build:
{
"id": "8808849293561428753",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 16132,
"createdBy": "project:chromium",
"createTime": "2022-07-12T11:01:33.845528940Z",
"updateTime": "2022-07-12T11:01:33.845528940Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2f03402d9fb91d94983001d34b19a88fbec37e72",
"ref": "refs/heads/main"
}
}
}
[11:01:34.481] Task URL: https://cr-buildbucket.appspot.com/build/8808849293561428753
[11:01:34.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:2:0) after 1m48s
[11:03:22.589] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:2:0)
[11:03:22.632] Build status: SCHEDULED
[11:03:22.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:3:0) after 6m22s
[11:04:33.333] Received PubSub notification, asking Buildbucket for the build status
[11:04:33.380] Build status: STARTED
[11:09:44.918] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:3:0)
[11:09:44.942] Build status: STARTED
[11:09:44.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:5:0) after 1m44s
[11:11:28.959] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:5:0)
[11:11:28.990] Build status: STARTED
[11:11:28.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:6:0) after 4m51s
[11:16:20.087] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:6:0)
[11:16:20.114] Build status: STARTED
[11:16:20.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:7:0) after 7m7s
[11:23:27.847] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:7:0)
[11:23:27.870] Build status: STARTED
[11:23:27.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:8:0) after 8m5s
[11:31:33.059] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:8:0)
[11:31:33.089] Build status: STARTED
[11:31:33.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:9:0) after 4m11s
[11:35:44.120] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:9:0)
[11:35:44.154] Build status: STARTED
[11:35:44.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:10:0) after 6m46s
[11:42:30.174] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:10:0)
[11:42:30.228] Build status: STARTED
[11:42:30.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:11:0) after 2m41s
[11:45:11.253] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:11:0)
[11:45:11.272] Build status: STARTED
[11:45:11.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:12:0) after 3m14s
[11:48:25.297] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:12:0)
[11:48:25.318] Build status: STARTED
[11:48:25.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:13:0) after 1m45s
[11:50:10.433] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:13:0)
[11:50:10.455] Build status: STARTED
[11:50:10.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:14:0) after 1m15s
[11:51:25.549] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:14:0)
[11:51:25.584] Build status: STARTED
[11:51:25.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:15:0) after 8m50s
[12:00:15.606] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:15:0)
[12:00:15.649] Build status: STARTED
[12:00:15.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:16:0) after 8m35s
[12:08:50.769] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:16:0)
[12:08:50.802] Build status: STARTED
[12:08:50.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:17:0) after 5m33s
[12:14:23.824] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:17:0)
[12:14:23.846] Build status: STARTED
[12:14:23.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:18:0) after 4m41s
[12:19:04.894] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:18:0)
[12:19:04.933] Build status: STARTED
[12:19:04.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:19:0) after 3m29s
[12:22:34.166] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:19:0)
[12:22:34.209] Build status: STARTED
[12:22:34.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:20:0) after 8m28s
[12:31:02.514] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:20:0)
[12:31:02.539] Build status: STARTED
[12:31:02.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:21:0) after 5m50s
[12:36:52.745] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:21:0)
[12:36:52.766] Build status: STARTED
[12:36:52.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:22:0) after 9m47s
[12:46:39.876] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:22:0)
[12:46:39.920] Build status: STARTED
[12:46:39.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:23:0) after 1m23s
[12:48:03.152] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:23:0)
[12:48:03.175] Build status: STARTED
[12:48:03.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:24:0) after 1m29s
[12:49:32.363] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:24:0)
[12:49:32.385] Build status: STARTED
[12:49:32.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:25:0) after 1m1s
[12:50:33.510] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:25:0)
[12:50:33.533] Build status: STARTED
[12:50:33.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:26:0) after 7m25s
[12:57:58.635] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:26:0)
[12:57:58.655] Build status: STARTED
[12:57:58.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:27:0) after 9m2s
[13:07:00.951] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:27:0)
[13:07:00.971] Build status: STARTED
[13:07:00.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:28:0) after 6m53s
[13:13:54.094] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:28:0)
[13:13:54.133] Build status: STARTED
[13:13:54.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:29:0) after 6m13s
[13:20:07.248] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:29:0)
[13:20:07.278] Build status: STARTED
[13:20:07.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:30:0) after 7m29s
[13:27:36.301] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:30:0)
[13:27:36.323] Build status: STARTED
[13:27:36.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:31:0) after 4m57s
[13:32:33.405] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:31:0)
[13:32:33.442] Build status: STARTED
[13:32:33.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:32:0) after 9m35s
[13:42:08.554] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:32:0)
[13:42:08.746] Build status: STARTED
[13:42:08.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:33:0) after 1m56s
[13:44:04.774] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:33:0)
[13:44:04.808] Build status: STARTED
[13:44:04.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:34:0) after 8m33s
[13:52:37.868] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:34:0)
[13:52:37.903] Build status: STARTED
[13:52:37.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:35:0) after 9m35s
[14:02:13.197] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:35:0)
[14:02:13.221] Build status: STARTED
[14:02:13.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:36:0) after 7m39s
[14:09:52.282] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:36:0)
[14:09:52.333] Build status: STARTED
[14:09:52.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:37:0) after 6m10s
[14:16:02.487] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:37:0)
[14:16:02.511] Build status: STARTED
[14:16:02.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:38:0) after 7m35s
[14:23:37.891] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:38:0)
[14:23:37.911] Build status: STARTED
[14:23:37.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:39:0) after 8m59s
[14:32:36.895] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:39:0)
[14:32:36.915] Build status: STARTED
[14:32:36.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:40:0) after 8m27s
[14:41:03.986] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:40:0)
[14:41:04.051] Build status: STARTED
[14:41:04.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:41:0) after 2m50s
[14:43:54.147] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:41:0)
[14:43:54.203] Build status: STARTED
[14:43:54.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:42:0) after 5m35s
[14:49:29.259] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:42:0)
[14:49:29.329] Build status: STARTED
[14:49:29.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:43:0) after 6m23s
[14:55:52.359] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:43:0)
[14:55:52.416] Build status: STARTED
[14:55:52.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:44:0) after 1m11s
[14:57:03.570] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:44:0)
[14:57:03.592] Build status: STARTED
[14:57:03.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:45:0) after 8m53s
[15:05:56.786] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:45:0)
[15:05:56.827] Build status: STARTED
[15:05:56.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:46:0) after 7m59s
[15:13:56.370] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:46:0)
[15:13:56.394] Build status: STARTED
[15:13:56.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:47:0) after 7m24s
[15:21:20.413] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:47:0)
[15:21:20.436] Build status: STARTED
[15:21:20.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:48:0) after 3m3s
[15:24:23.456] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:48:0)
[15:24:23.526] Build status: STARTED
[15:24:23.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:49:0) after 7m48s
[15:32:11.550] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:49:0)
[15:32:11.588] Build status: STARTED
[15:32:11.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:50:0) after 8m52s
[15:41:03.846] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:50:0)
[15:41:03.878] Build status: STARTED
[15:41:03.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:51:0) after 4m30s
[15:45:34.126] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:51:0)
[15:45:34.165] Build status: STARTED
[15:45:34.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:52:0) after 4m54s
[15:50:28.322] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:52:0)
[15:50:28.360] Build status: STARTED
[15:50:28.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:53:0) after 2m18s
[15:52:46.426] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:53:0)
[15:52:46.470] Build status: STARTED
[15:52:46.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:54:0) after 6m58s
[15:59:44.652] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:54:0)
[15:59:44.686] Build status: STARTED
[15:59:44.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8974279355540224992:55:0) after 7m28s
[16:07:10.419] Received PubSub notification, asking Buildbucket for the build status
[16:07:10.450] Build:
{
"id": "8808849293561428753",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 16132,
"createdBy": "project:chromium",
"createTime": "2022-07-12T11:01:33.845528940Z",
"startTime": "2022-07-12T11:04:27.521094Z",
"endTime": "2022-07-12T16:07:10.096506297Z",
"updateTime": "2022-07-12T16:07:10.096506297Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2f03402d9fb91d94983001d34b19a88fbec37e72",
"ref": "refs/heads/main"
}
}
}
[16:07:10.450] Invocation finished in 5h5m37.875988198s with status FAILED