[11:32:37.197] New invocation is queued and will start shortly
[11:32:38.359] Starting the invocation (attempt 1)
[11:32:38.507] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f517ac1a2455a0324bc376f5e074d08147ecafd4"
[11:32:38.507] Popped gitiles commit info from properties and tags
[11:32:38.507] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:32:38.508] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:32:38.508] Buildbucket request:
{
"requestId": "8951175173917739776",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f517ac1a2455a0324bc376f5e074d08147ecafd4",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8951175173917739776"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:32:39.078] Scheduled build:
{
"id": "8785745111809377777",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 18617,
"createdBy": "project:chromium",
"createTime": "2023-03-24T11:32:38.583171291Z",
"updateTime": "2023-03-24T11:32:38.583171291Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f517ac1a2455a0324bc376f5e074d08147ecafd4",
"ref": "refs/heads/main"
}
}
}
[11:32:39.078] Task URL: https://cr-buildbucket.appspot.com/build/8785745111809377777
[11:32:39.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:2:0) after 1m45s
[11:34:24.252] Received PubSub notification, asking Buildbucket for the build status
[11:34:24.275] Build status: STARTED
[11:34:24.524] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:2:0)
[11:34:24.555] Build status: STARTED
[11:34:24.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:4:0) after 1m17s
[11:35:41.683] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:4:0)
[11:35:41.780] Build status: STARTED
[11:35:41.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:5:0) after 1m9s
[11:36:50.836] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:5:0)
[11:36:50.868] Build status: STARTED
[11:36:50.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:6:0) after 3m53s
[11:40:43.889] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:6:0)
[11:40:43.910] Build status: STARTED
[11:40:43.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:7:0) after 6m5s
[11:46:48.932] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:7:0)
[11:46:49.001] Build status: STARTED
[11:46:49.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:8:0) after 1m0s
[11:47:49.021] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:8:0)
[11:47:49.041] Build status: STARTED
[11:47:49.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:9:0) after 1m10s
[11:48:59.059] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:9:0)
[11:48:59.090] Build status: STARTED
[11:48:59.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:10:0) after 6m38s
[11:55:37.115] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:10:0)
[11:55:37.148] Build status: STARTED
[11:55:37.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:11:0) after 7m43s
[12:03:20.179] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:11:0)
[12:03:20.202] Build status: STARTED
[12:03:20.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:12:0) after 8m35s
[12:11:55.330] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:12:0)
[12:11:55.370] Build status: STARTED
[12:11:55.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:13:0) after 8m54s
[12:20:49.586] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:13:0)
[12:20:49.618] Build status: STARTED
[12:20:49.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:14:0) after 2m59s
[12:23:48.753] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:14:0)
[12:23:48.797] Build status: STARTED
[12:23:48.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:15:0) after 4m23s
[12:28:11.822] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:15:0)
[12:28:11.864] Build status: STARTED
[12:28:11.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:16:0) after 5m1s
[12:33:12.914] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:16:0)
[12:33:12.937] Build status: STARTED
[12:33:12.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:17:0) after 4m42s
[12:37:54.962] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:17:0)
[12:37:54.988] Build status: STARTED
[12:37:54.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:18:0) after 2m24s
[12:40:19.524] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:18:0)
[12:40:19.551] Build status: STARTED
[12:40:19.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:19:0) after 5m11s
[12:45:30.803] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:19:0)
[12:45:30.826] Build status: STARTED
[12:45:30.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:20:0) after 9m45s
[12:55:15.848] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:20:0)
[12:55:15.906] Build status: STARTED
[12:55:15.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:21:0) after 6m50s
[13:02:05.929] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:21:0)
[13:02:05.949] Build status: STARTED
[13:02:05.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:22:0) after 7m44s
[13:09:49.974] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:22:0)
[13:09:49.994] Build status: STARTED
[13:09:49.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:23:0) after 2m37s
[13:12:27.136] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:23:0)
[13:12:27.158] Build status: STARTED
[13:12:27.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:24:0) after 9m43s
[13:22:10.409] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:24:0)
[13:22:10.431] Build status: STARTED
[13:22:10.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:25:0) after 1m1s
[13:23:11.468] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:25:0)
[13:23:11.501] Build status: STARTED
[13:23:11.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:26:0) after 5m9s
[13:28:20.494] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:26:0)
[13:28:20.524] Build status: STARTED
[13:28:20.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:27:0) after 9m0s
[13:37:20.653] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:27:0)
[13:37:20.679] Build status: STARTED
[13:37:20.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:28:0) after 2m49s
[13:40:09.695] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:28:0)
[13:40:09.725] Build status: STARTED
[13:40:09.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:29:0) after 5m58s
[13:46:07.808] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:29:0)
[13:46:07.835] Build status: STARTED
[13:46:07.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:30:0) after 3m10s
[13:49:17.865] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:30:0)
[13:49:17.892] Build status: STARTED
[13:49:17.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:31:0) after 3m8s
[13:52:25.878] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:31:0)
[13:52:25.901] Build status: STARTED
[13:52:25.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:32:0) after 7m34s
[14:00:00.153] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:32:0)
[14:00:00.173] Build status: STARTED
[14:00:00.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:33:0) after 8m35s
[14:08:35.279] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:33:0)
[14:08:35.303] Build status: STARTED
[14:08:35.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:34:0) after 8m26s
[14:17:01.379] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:34:0)
[14:17:01.406] Build status: STARTED
[14:17:01.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:35:0) after 8m53s
[14:25:54.473] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:35:0)
[14:25:54.503] Build status: STARTED
[14:25:54.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:36:0) after 9m37s
[14:35:32.130] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:36:0)
[14:35:32.152] Build status: STARTED
[14:35:32.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:37:0) after 8m55s
[14:44:27.446] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:37:0)
[14:44:27.474] Build status: STARTED
[14:44:27.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:38:0) after 2m23s
[14:46:50.808] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:38:0)
[14:46:50.830] Build status: STARTED
[14:46:50.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:39:0) after 3m45s
[14:50:35.870] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:39:0)
[14:50:35.931] Build status: STARTED
[14:50:35.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:40:0) after 1m33s
[14:52:09.343] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:40:0)
[14:52:09.403] Build status: STARTED
[14:52:09.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:41:0) after 8m9s
[15:00:18.437] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:41:0)
[15:00:18.497] Build status: STARTED
[15:00:18.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:42:0) after 5m12s
[15:05:30.962] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:42:0)
[15:05:30.987] Build status: STARTED
[15:05:30.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:43:0) after 4m26s
[15:09:57.015] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:43:0)
[15:09:57.158] Build status: STARTED
[15:09:57.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:44:0) after 5m30s
[15:15:27.201] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:44:0)
[15:15:27.361] Build status: STARTED
[15:15:27.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:45:0) after 6m13s
[15:21:40.415] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:45:0)
[15:21:40.440] Build status: STARTED
[15:21:40.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:46:0) after 2m45s
[15:24:25.733] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:46:0)
[15:24:25.754] Build status: STARTED
[15:24:25.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:47:0) after 8m10s
[15:32:35.779] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:47:0)
[15:32:35.800] Build status: STARTED
[15:32:35.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:48:0) after 7m45s
[15:40:20.872] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:48:0)
[15:40:20.897] Build status: STARTED
[15:40:20.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:49:0) after 2m33s
[15:42:54.011] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:49:0)
[15:42:54.034] Build status: STARTED
[15:42:54.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:50:0) after 9m54s
[15:52:48.055] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:50:0)
[15:52:48.076] Build status: STARTED
[15:52:48.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:51:0) after 1m21s
[15:54:09.179] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:51:0)
[15:54:09.203] Build status: STARTED
[15:54:09.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:52:0) after 9m44s
[16:03:53.612] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:52:0)
[16:03:53.652] Build status: STARTED
[16:03:53.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:53:0) after 6m12s
[16:10:05.685] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:53:0)
[16:10:05.707] Build status: STARTED
[16:10:05.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:54:0) after 4m18s
[16:14:24.188] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:54:0)
[16:14:24.219] Build status: STARTED
[16:14:24.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:55:0) after 1m41s
[16:16:05.266] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:55:0)
[16:16:05.290] Build status: STARTED
[16:16:05.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:56:0) after 2m5s
[16:18:10.320] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:56:0)
[16:18:10.468] Build status: STARTED
[16:18:10.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:57:0) after 4m54s
[16:23:04.607] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:57:0)
[16:23:04.660] Build status: STARTED
[16:23:04.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:58:0) after 3m21s
[16:26:25.683] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:58:0)
[16:26:25.703] Build status: STARTED
[16:26:25.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:59:0) after 1m10s
[16:27:35.743] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:59:0)
[16:27:35.767] Build status: STARTED
[16:27:35.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:60:0) after 8m34s
[16:36:10.081] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:60:0)
[16:36:10.099] Build status: STARTED
[16:36:10.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:61:0) after 5m39s
[16:41:49.133] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:61:0)
[16:41:49.186] Build status: STARTED
[16:41:49.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:62:0) after 8m50s
[16:50:39.234] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:62:0)
[16:50:39.261] Build status: STARTED
[16:50:39.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:63:0) after 3m31s
[16:54:10.335] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:63:0)
[16:54:10.362] Build status: STARTED
[16:54:10.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:64:0) after 2m13s
[16:56:23.384] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:64:0)
[16:56:23.407] Build status: STARTED
[16:56:23.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:65:0) after 5m0s
[17:01:23.500] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:65:0)
[17:01:23.526] Build status: STARTED
[17:01:23.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:66:0) after 3m14s
[17:04:37.549] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:66:0)
[17:04:37.569] Build status: STARTED
[17:04:37.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:67:0) after 3m41s
[17:08:18.654] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:67:0)
[17:08:18.682] Build status: STARTED
[17:08:18.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:68:0) after 6m22s
[17:14:40.711] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:68:0)
[17:14:40.736] Build status: STARTED
[17:14:40.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:69:0) after 9m1s
[17:23:41.777] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:69:0)
[17:23:41.797] Build status: STARTED
[17:23:41.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:70:0) after 9m39s
[17:33:20.824] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:70:0)
[17:33:20.863] Build status: STARTED
[17:33:20.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:71:0) after 1m15s
[17:34:35.936] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:71:0)
[17:34:36.018] Build status: STARTED
[17:34:36.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:72:0) after 3m0s
[17:37:36.048] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:72:0)
[17:37:36.069] Build status: STARTED
[17:37:36.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:73:0) after 8m50s
[17:46:26.083] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:73:0)
[17:46:26.122] Build status: STARTED
[17:46:26.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:74:0) after 8m0s
[17:54:26.313] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:74:0)
[17:54:26.347] Build status: STARTED
[17:54:26.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:75:0) after 2m43s
[17:57:09.548] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:75:0)
[17:57:09.594] Build status: STARTED
[17:57:09.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:76:0) after 8m3s
[18:05:12.721] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:76:0)
[18:05:12.771] Build status: STARTED
[18:05:12.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:77:0) after 6m9s
[18:11:21.845] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:77:0)
[18:11:21.866] Build status: STARTED
[18:11:21.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:78:0) after 2m44s
[18:14:05.920] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:78:0)
[18:14:05.959] Build status: STARTED
[18:14:05.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:79:0) after 5m14s
[18:19:20.043] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:79:0)
[18:19:20.102] Build status: STARTED
[18:19:20.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:80:0) after 4m43s
[18:24:03.092] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:80:0)
[18:24:03.119] Build status: STARTED
[18:24:03.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:81:0) after 6m55s
[18:30:59.047] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:81:0)
[18:30:59.101] Build status: STARTED
[18:30:59.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:82:0) after 8m40s
[18:39:39.236] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:82:0)
[18:39:39.263] Build status: STARTED
[18:39:39.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:83:0) after 4m31s
[18:44:10.316] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:83:0)
[18:44:10.349] Build status: STARTED
[18:44:10.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:84:0) after 4m28s
[18:48:38.943] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:84:0)
[18:48:38.964] Build status: STARTED
[18:48:38.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:85:0) after 1m5s
[18:49:44.480] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:85:0)
[18:49:44.504] Build status: STARTED
[18:49:44.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:86:0) after 3m33s
[18:53:17.600] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:86:0)
[18:53:17.625] Build status: STARTED
[18:53:17.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:87:0) after 6m2s
[18:59:19.645] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:87:0)
[18:59:19.667] Build status: STARTED
[18:59:19.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:88:0) after 6m51s
[19:06:10.756] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:88:0)
[19:06:10.780] Build status: STARTED
[19:06:10.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:89:0) after 7m33s
[19:13:43.803] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:89:0)
[19:13:43.825] Build status: STARTED
[19:13:43.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:90:0) after 6m7s
[19:19:50.847] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:90:0)
[19:19:50.872] Build status: STARTED
[19:19:50.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:91:0) after 3m59s
[19:23:49.905] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:91:0)
[19:23:49.928] Build status: STARTED
[19:23:49.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:92:0) after 1m38s
[19:25:28.012] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:92:0)
[19:25:28.034] Build status: STARTED
[19:25:28.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:93:0) after 1m30s
[19:26:58.889] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:93:0)
[19:26:58.918] Build status: STARTED
[19:26:58.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:94:0) after 5m30s
[19:32:28.992] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:94:0)
[19:32:29.180] Build status: STARTED
[19:32:29.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:95:0) after 4m5s
[19:36:34.207] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:95:0)
[19:36:34.238] Build status: STARTED
[19:36:34.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:96:0) after 8m51s
[19:45:25.293] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:96:0)
[19:45:25.349] Build status: STARTED
[19:45:25.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:97:0) after 6m43s
[19:52:08.512] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:97:0)
[19:52:08.539] Build status: STARTED
[19:52:08.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:98:0) after 7m1s
[19:59:09.581] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:98:0)
[19:59:09.611] Build status: STARTED
[19:59:09.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:99:0) after 3m32s
[20:02:41.634] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:99:0)
[20:02:41.657] Build status: STARTED
[20:02:41.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:100:0) after 5m57s
[20:08:38.651] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:100:0)
[20:08:38.671] Build status: STARTED
[20:08:38.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:101:0) after 9m31s
[20:18:09.792] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:101:0)
[20:18:09.818] Build status: STARTED
[20:18:09.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:102:0) after 7m14s
[20:25:23.836] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:102:0)
[20:25:23.872] Build status: STARTED
[20:25:23.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:103:0) after 6m52s
[20:32:15.952] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:103:0)
[20:32:16.076] Build status: STARTED
[20:32:16.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:104:0) after 1m36s
[20:33:52.096] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:104:0)
[20:33:52.165] Build status: STARTED
[20:33:52.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:105:0) after 9m15s
[20:43:07.609] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:105:0)
[20:43:07.629] Build status: STARTED
[20:43:07.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:106:0) after 6m27s
[20:49:34.880] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:106:0)
[20:49:34.900] Build status: STARTED
[20:49:34.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:107:0) after 1m51s
[20:51:25.949] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:107:0)
[20:51:26.000] Build status: STARTED
[20:51:26.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:108:0) after 4m6s
[20:55:32.113] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:108:0)
[20:55:32.156] Build status: STARTED
[20:55:32.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:109:0) after 3m26s
[20:58:58.859] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:109:0)
[20:58:58.893] Build status: STARTED
[20:58:58.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:110:0) after 7m31s
[21:06:29.967] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:110:0)
[21:06:29.992] Build status: STARTED
[21:06:29.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:111:0) after 5m28s
[21:11:58.179] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:111:0)
[21:11:58.207] Build status: STARTED
[21:11:58.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:112:0) after 2m27s
[21:14:25.439] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:112:0)
[21:14:25.462] Build status: STARTED
[21:14:25.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:113:0) after 4m16s
[21:18:41.511] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:113:0)
[21:18:41.540] Build status: STARTED
[21:18:41.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:114:0) after 9m19s
[21:28:00.576] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:114:0)
[21:28:00.598] Build status: STARTED
[21:28:00.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:115:0) after 7m17s
[21:35:17.761] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:115:0)
[21:35:17.789] Build status: STARTED
[21:35:17.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:116:0) after 8m24s
[21:43:42.413] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:116:0)
[21:43:42.434] Build status: STARTED
[21:43:42.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:117:0) after 7m33s
[21:51:15.469] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:117:0)
[21:51:15.489] Build status: STARTED
[21:51:15.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8951175173917739776:118:0) after 3m18s
[21:52:23.218] Received PubSub notification, asking Buildbucket for the build status
[21:52:23.275] Build:
{
"id": "8785745111809377777",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 18617,
"createdBy": "project:chromium",
"createTime": "2023-03-24T11:32:38.583171291Z",
"startTime": "2023-03-24T11:34:23.778906Z",
"endTime": "2023-03-24T21:52:22.726150895Z",
"updateTime": "2023-03-24T21:52:22.726150895Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f517ac1a2455a0324bc376f5e074d08147ecafd4",
"ref": "refs/heads/main"
}
}
}
[21:52:23.275] Invocation finished in 10h19m46.086436765s with status FAILED