[20:47:50.703] New invocation is queued and will start shortly
[20:47:51.782] Starting the invocation (attempt 1)
[20:47:51.816] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/632530e5a36370c69171fdf7239263e9e3b5ee45"
[20:47:51.816] Popped gitiles commit info from properties and tags
[20:47:51.816] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:47:51.816] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:47:51.816] Buildbucket request:
{
"requestId": "8969622023319631168",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "632530e5a36370c69171fdf7239263e9e3b5ee45",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8969622023319631168"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:47:52.321] Scheduled build:
{
"id": "8804191961443866513",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 16765,
"createdBy": "project:chromium",
"createTime": "2022-09-01T20:47:51.868218683Z",
"updateTime": "2022-09-01T20:47:51.868218683Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "632530e5a36370c69171fdf7239263e9e3b5ee45",
"ref": "refs/heads/main"
}
},
"canary": true
}
[20:47:52.321] Task URL: https://cr-buildbucket.appspot.com/build/8804191961443866513
[20:47:52.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:2:0) after 1m23s
[20:48:02.767] Received PubSub notification, asking Buildbucket for the build status
[20:48:02.796] Build status: STARTED
[20:49:15.343] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:2:0)
[20:49:15.363] Build status: STARTED
[20:49:15.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:4:0) after 2m31s
[20:51:46.393] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:4:0)
[20:51:46.416] Build status: STARTED
[20:51:46.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:5:0) after 9m6s
[21:00:52.460] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:5:0)
[21:00:52.481] Build status: STARTED
[21:00:52.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:6:0) after 9m49s
[21:10:41.507] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:6:0)
[21:10:41.532] Build status: STARTED
[21:10:41.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:7:0) after 4m1s
[21:14:42.760] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:7:0)
[21:14:42.820] Build status: STARTED
[21:14:42.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:8:0) after 5m29s
[21:20:11.872] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:8:0)
[21:20:11.955] Build status: STARTED
[21:20:11.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:9:0) after 5m5s
[21:25:17.200] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:9:0)
[21:25:17.227] Build status: STARTED
[21:25:17.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:10:0) after 4m34s
[21:29:51.300] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:10:0)
[21:29:51.334] Build status: STARTED
[21:29:51.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:11:0) after 5m4s
[21:34:55.466] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:11:0)
[21:34:55.493] Build status: STARTED
[21:34:55.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:12:0) after 8m43s
[21:43:38.642] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:12:0)
[21:43:38.665] Build status: STARTED
[21:43:38.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:13:0) after 4m32s
[21:48:10.895] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:13:0)
[21:48:10.924] Build status: STARTED
[21:48:10.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:14:0) after 9m44s
[21:57:54.999] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:14:0)
[21:57:55.027] Build status: STARTED
[21:57:55.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:15:0) after 9m13s
[22:07:08.114] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:15:0)
[22:07:08.141] Build status: STARTED
[22:07:08.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:16:0) after 2m55s
[22:10:03.165] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:16:0)
[22:10:03.205] Build status: STARTED
[22:10:03.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:17:0) after 8m9s
[22:18:12.294] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:17:0)
[22:18:12.323] Build status: STARTED
[22:18:12.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:18:0) after 5m32s
[22:23:44.345] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:18:0)
[22:23:44.415] Build status: STARTED
[22:23:44.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:19:0) after 9m26s
[22:33:10.524] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:19:0)
[22:33:10.570] Build status: STARTED
[22:33:10.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:20:0) after 7m37s
[22:40:47.594] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:20:0)
[22:40:47.615] Build status: STARTED
[22:40:47.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:21:0) after 8m46s
[22:49:33.752] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:21:0)
[22:49:33.777] Build status: STARTED
[22:49:33.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:22:0) after 8m29s
[22:58:03.063] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:22:0)
[22:58:03.103] Build status: STARTED
[22:58:03.103] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:23:0) after 8m47s
[23:06:50.120] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:23:0)
[23:06:50.141] Build status: STARTED
[23:06:50.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:24:0) after 6m4s
[23:12:54.306] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:24:0)
[23:12:54.330] Build status: STARTED
[23:12:54.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:25:0) after 1m34s
[23:14:28.398] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:25:0)
[23:14:28.423] Build status: STARTED
[23:14:28.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:26:0) after 2m33s
[23:17:01.558] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:26:0)
[23:17:01.584] Build status: STARTED
[23:17:01.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:27:0) after 5m29s
[23:22:30.691] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:27:0)
[23:22:30.717] Build status: STARTED
[23:22:30.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:28:0) after 4m48s
[23:27:18.971] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:28:0)
[23:27:18.998] Build status: STARTED
[23:27:18.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:29:0) after 9m28s
[23:36:46.998] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:29:0)
[23:36:47.067] Build status: STARTED
[23:36:47.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:30:0) after 1m27s
[23:38:14.092] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:30:0)
[23:38:14.116] Build status: STARTED
[23:38:14.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:31:0) after 5m6s
[23:43:20.143] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:31:0)
[23:43:20.164] Build status: STARTED
[23:43:20.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:32:0) after 6m24s
[23:49:44.197] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:32:0)
[23:49:44.220] Build status: STARTED
[23:49:44.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:33:0) after 3m27s
[23:53:11.224] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:33:0)
[23:53:11.245] Build status: STARTED
[23:53:11.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:34:0) after 9m42s
[00:02:53.306] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:34:0)
[00:02:53.329] Build status: STARTED
[00:02:53.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:35:0) after 8m44s
[00:11:37.376] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:35:0)
[00:11:37.405] Build status: STARTED
[00:11:37.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:36:0) after 2m40s
[00:14:17.751] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:36:0)
[00:14:17.777] Build status: STARTED
[00:14:17.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:37:0) after 3m33s
[00:17:50.835] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:37:0)
[00:17:50.855] Build status: STARTED
[00:17:50.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:38:0) after 1m44s
[00:19:34.949] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:38:0)
[00:19:34.975] Build status: STARTED
[00:19:34.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:39:0) after 3m46s
[00:23:21.056] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:39:0)
[00:23:21.100] Build status: STARTED
[00:23:21.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:40:0) after 7m47s
[00:31:08.133] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:40:0)
[00:31:08.164] Build status: STARTED
[00:31:08.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:41:0) after 7m38s
[00:38:46.237] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:41:0)
[00:38:46.263] Build status: STARTED
[00:38:46.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:42:0) after 3m5s
[00:41:51.332] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:42:0)
[00:41:51.358] Build status: STARTED
[00:41:51.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:43:0) after 1m5s
[00:42:56.442] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:43:0)
[00:42:56.465] Build status: STARTED
[00:42:56.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:44:0) after 5m9s
[00:48:05.979] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:44:0)
[00:48:06.002] Build status: STARTED
[00:48:06.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:45:0) after 6m47s
[00:54:53.139] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:45:0)
[00:54:53.182] Build status: STARTED
[00:54:53.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:46:0) after 2m38s
[00:57:31.711] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:46:0)
[00:57:31.785] Build status: STARTED
[00:57:31.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:47:0) after 1m4s
[00:58:35.896] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:47:0)
[00:58:36.058] Build status: STARTED
[00:58:36.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:48:0) after 8m27s
[01:07:03.242] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:48:0)
[01:07:03.269] Build status: STARTED
[01:07:03.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:49:0) after 9m7s
[01:16:10.355] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:49:0)
[01:16:10.429] Build status: STARTED
[01:16:10.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:50:0) after 8m46s
[01:24:56.920] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:50:0)
[01:24:56.953] Build status: STARTED
[01:24:56.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:51:0) after 6m28s
[01:31:25.034] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:51:0)
[01:31:25.083] Build status: STARTED
[01:31:25.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:52:0) after 8m22s
[01:39:47.129] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:52:0)
[01:39:47.161] Build status: STARTED
[01:39:47.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:53:0) after 9m48s
[01:49:35.355] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:53:0)
[01:49:35.386] Build status: STARTED
[01:49:35.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:54:0) after 3m5s
[01:52:40.420] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:54:0)
[01:52:40.457] Build status: STARTED
[01:52:40.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:55:0) after 5m37s
[01:58:17.646] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:55:0)
[01:58:17.671] Build status: STARTED
[01:58:17.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:56:0) after 2m17s
[02:00:34.712] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:56:0)
[02:00:34.885] Build status: STARTED
[02:00:34.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:57:0) after 3m31s
[02:04:05.913] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:57:0)
[02:04:05.971] Build status: STARTED
[02:04:05.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:58:0) after 3m48s
[02:07:54.085] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:58:0)
[02:07:54.124] Build status: STARTED
[02:07:54.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:59:0) after 9m11s
[02:17:05.232] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:59:0)
[02:17:05.264] Build status: STARTED
[02:17:05.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:60:0) after 7m48s
[02:24:53.313] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:60:0)
[02:24:53.349] Build status: STARTED
[02:24:53.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:61:0) after 3m6s
[02:27:59.471] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:61:0)
[02:27:59.493] Build status: STARTED
[02:27:59.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8969622023319631168:62:0) after 6m33s
[02:28:46.513] Received PubSub notification, asking Buildbucket for the build status
[02:28:46.532] Build:
{
"id": "8804191961443866513",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 16765,
"createdBy": "project:chromium",
"createTime": "2022-09-01T20:47:51.868218683Z",
"startTime": "2022-09-01T20:48:02.082928Z",
"endTime": "2022-09-02T02:28:46.243952140Z",
"updateTime": "2022-09-02T02:28:46.243952140Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "632530e5a36370c69171fdf7239263e9e3b5ee45",
"ref": "refs/heads/main"
}
},
"canary": true
}
[02:28:46.532] Invocation finished in 5h40m55.835948631s with status FAILED