[16:59:14.951] New invocation is queued and will start shortly
[16:59:16.016] Starting the invocation (attempt 1)
[16:59:16.045] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2a77cec6f8237cacb639ea84eac18b15b778768b"
[16:59:16.045] Popped gitiles commit info from properties and tags
[16:59:16.045] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:59:16.045] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:59:16.045] Buildbucket request:
{
"requestId": "8910838974149177584",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2a77cec6f8237cacb639ea84eac18b15b778768b",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8910838974149177584"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:59:16.596] Scheduled build:
{
"id": "8745408912266390881",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 23538,
"createdBy": "project:chromium",
"createTime": "2024-06-11T16:59:16.109933816Z",
"updateTime": "2024-06-11T16:59:16.109933816Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2a77cec6f8237cacb639ea84eac18b15b778768b",
"ref": "refs/heads/main"
}
}
}
[16:59:16.596] Task URL: https://cr-buildbucket.appspot.com/build/8745408912266390881
[16:59:16.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:2:0) after 5m17s
[16:59:17.525] Received PubSub notification, asking Buildbucket for the build status
[16:59:17.546] Build status: SCHEDULED
[17:01:14.808] Received PubSub notification, asking Buildbucket for the build status
[17:01:14.832] Build status: STARTED
[17:04:33.663] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:2:0)
[17:04:33.681] Build status: STARTED
[17:04:33.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:5:0) after 5m50s
[17:10:23.696] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:5:0)
[17:10:23.730] Build status: STARTED
[17:10:23.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:6:0) after 5m26s
[17:15:49.749] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:6:0)
[17:15:49.797] Build status: STARTED
[17:15:49.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:7:0) after 6m59s
[17:22:48.808] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:7:0)
[17:22:48.829] Build status: STARTED
[17:22:48.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:8:0) after 4m0s
[17:26:48.912] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:8:0)
[17:26:48.936] Build status: STARTED
[17:26:48.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:9:0) after 4m13s
[17:31:02.026] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:9:0)
[17:31:02.045] Build status: STARTED
[17:31:02.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:10:0) after 5m9s
[17:36:11.116] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:10:0)
[17:36:11.141] Build status: STARTED
[17:36:11.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:11:0) after 9m11s
[17:45:22.161] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:11:0)
[17:45:22.193] Build status: STARTED
[17:45:22.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:12:0) after 4m12s
[17:49:34.261] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:12:0)
[17:49:34.281] Build status: STARTED
[17:49:34.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:13:0) after 7m31s
[17:57:05.307] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:13:0)
[17:57:05.325] Build status: STARTED
[17:57:05.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:14:0) after 7m34s
[18:04:39.346] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:14:0)
[18:04:39.364] Build status: STARTED
[18:04:39.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:15:0) after 5m5s
[18:09:44.389] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:15:0)
[18:09:44.409] Build status: STARTED
[18:09:44.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:16:0) after 1m5s
[18:10:49.475] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:16:0)
[18:10:49.497] Build status: STARTED
[18:10:49.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:17:0) after 3m33s
[18:14:22.516] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:17:0)
[18:14:22.555] Build status: STARTED
[18:14:22.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:18:0) after 7m28s
[18:21:50.587] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:18:0)
[18:21:50.939] Build status: STARTED
[18:21:50.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:19:0) after 8m13s
[18:30:03.972] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:19:0)
[18:30:03.992] Build status: STARTED
[18:30:03.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:20:0) after 6m9s
[18:36:13.003] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:20:0)
[18:36:13.024] Build status: STARTED
[18:36:13.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:21:0) after 4m28s
[18:40:41.129] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:21:0)
[18:40:41.151] Build status: STARTED
[18:40:41.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:22:0) after 9m59s
[18:50:40.169] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:22:0)
[18:50:40.212] Build status: STARTED
[18:50:40.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:23:0) after 4m53s
[18:55:33.263] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:23:0)
[18:55:33.332] Build status: STARTED
[18:55:33.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:24:0) after 4m42s
[19:00:15.365] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:24:0)
[19:00:15.386] Build status: STARTED
[19:00:15.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:25:0) after 4m39s
[19:04:54.432] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:25:0)
[19:04:54.450] Build status: STARTED
[19:04:54.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:26:0) after 4m14s
[19:09:08.479] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:26:0)
[19:09:08.501] Build status: STARTED
[19:09:08.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:27:0) after 5m15s
[19:14:23.584] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:27:0)
[19:14:23.649] Build status: STARTED
[19:14:23.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:28:0) after 6m27s
[19:20:50.715] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:28:0)
[19:20:50.810] Build status: STARTED
[19:20:50.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:29:0) after 9m26s
[19:30:16.836] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:29:0)
[19:30:16.862] Build status: STARTED
[19:30:16.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:30:0) after 7m10s
[19:37:26.962] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:30:0)
[19:37:26.979] Build status: STARTED
[19:37:26.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:31:0) after 9m45s
[19:47:12.018] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:31:0)
[19:47:12.039] Build status: STARTED
[19:47:12.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:32:0) after 3m23s
[19:50:35.059] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:32:0)
[19:50:35.079] Build status: STARTED
[19:50:35.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:33:0) after 6m58s
[19:57:33.102] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:33:0)
[19:57:33.120] Build status: STARTED
[19:57:33.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:34:0) after 2m41s
[20:00:14.115] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:34:0)
[20:00:14.169] Build status: STARTED
[20:00:14.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:35:0) after 5m8s
[20:05:22.228] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:35:0)
[20:05:22.252] Build status: STARTED
[20:05:22.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:36:0) after 2m46s
[20:08:08.282] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:36:0)
[20:08:08.332] Build status: STARTED
[20:08:08.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:37:0) after 3m53s
[20:12:01.369] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:37:0)
[20:12:01.439] Build status: STARTED
[20:12:01.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:38:0) after 9m6s
[20:21:07.503] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:38:0)
[20:21:07.572] Build status: STARTED
[20:21:07.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:39:0) after 9m34s
[20:30:41.594] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:39:0)
[20:30:41.615] Build status: STARTED
[20:30:41.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:40:0) after 2m10s
[20:32:51.636] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:40:0)
[20:32:51.653] Build status: STARTED
[20:32:51.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:41:0) after 8m8s
[20:40:59.788] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:41:0)
[20:40:59.816] Build status: STARTED
[20:40:59.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:42:0) after 8m11s
[20:49:10.841] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:42:0)
[20:49:10.858] Build status: STARTED
[20:49:10.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:43:0) after 5m54s
[20:55:04.882] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:43:0)
[20:55:04.899] Build status: STARTED
[20:55:04.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:44:0) after 9m34s
[21:04:38.931] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:44:0)
[21:04:38.983] Build status: STARTED
[21:04:38.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:45:0) after 2m19s
[21:06:58.015] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:45:0)
[21:06:58.036] Build status: STARTED
[21:06:58.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:46:0) after 8m4s
[21:15:02.151] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:46:0)
[21:15:02.324] Build status: STARTED
[21:15:02.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:47:0) after 6m30s
[21:21:32.365] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:47:0)
[21:21:32.459] Build status: STARTED
[21:21:32.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:48:0) after 2m45s
[21:24:17.492] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:48:0)
[21:24:17.510] Build status: STARTED
[21:24:17.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:49:0) after 4m2s
[21:28:19.613] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:49:0)
[21:28:19.634] Build status: STARTED
[21:28:19.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:50:0) after 3m51s
[21:32:10.627] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:50:0)
[21:32:10.644] Build status: STARTED
[21:32:10.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:51:0) after 2m39s
[21:34:49.680] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:51:0)
[21:34:49.702] Build status: STARTED
[21:34:49.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:52:0) after 3m39s
[21:38:28.764] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:52:0)
[21:38:28.787] Build status: STARTED
[21:38:28.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:53:0) after 1m33s
[21:40:01.819] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:53:0)
[21:40:01.837] Build status: STARTED
[21:40:01.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:54:0) after 6m38s
[21:46:39.861] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:54:0)
[21:46:39.879] Build status: STARTED
[21:46:39.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:55:0) after 1m36s
[21:48:15.905] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:55:0)
[21:48:15.954] Build status: STARTED
[21:48:15.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:56:0) after 8m41s
[21:56:57.030] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:56:0)
[21:56:57.048] Build status: STARTED
[21:56:57.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:57:0) after 8m26s
[22:05:23.197] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:57:0)
[22:05:23.216] Build status: STARTED
[22:05:23.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:58:0) after 7m10s
[22:12:33.255] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:58:0)
[22:12:33.274] Build status: STARTED
[22:12:33.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910838974149177584:59:0) after 5m57s
[22:12:46.344] Received PubSub notification, asking Buildbucket for the build status
[22:12:46.361] Build:
{
"id": "8745408912266390881",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 23538,
"createdBy": "project:chromium",
"createTime": "2024-06-11T16:59:16.109933816Z",
"startTime": "2024-06-11T17:01:14.435852075Z",
"endTime": "2024-06-11T22:12:46.115853989Z",
"updateTime": "2024-06-11T22:12:46.115853989Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2a77cec6f8237cacb639ea84eac18b15b778768b",
"ref": "refs/heads/main"
}
}
}
[22:12:46.361] Invocation finished in 5h13m31.431213624s with status FAILED