[10:40:52.478] New invocation is queued and will start shortly
[10:40:53.600] Starting the invocation (attempt 1)
[10:40:53.634] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9e106f8a36c0804cc7cd978fd60acc4bb7fa71d2"
[10:40:53.634] Popped gitiles commit info from properties and tags
[10:40:53.634] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:40:53.635] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:40:53.635] Buildbucket request:
{
"requestId": "8876164141278397632",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9e106f8a36c0804cc7cd978fd60acc4bb7fa71d2",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8876164141278397632"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:40:54.150] Scheduled build:
{
"id": "8710734079335731713",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 27767,
"createdBy": "project:chromium",
"createTime": "2025-06-29T10:40:53.700670581Z",
"updateTime": "2025-06-29T10:40:53.700670581Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9e106f8a36c0804cc7cd978fd60acc4bb7fa71d2",
"ref": "refs/heads/main"
}
},
"canary": true
}
[10:40:54.150] Task URL: https://cr-buildbucket.appspot.com/build/8710734079335731713
[10:40:54.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:2:0) after 9m43s
[10:40:55.143] Received PubSub notification, asking Buildbucket for the build status
[10:40:55.172] Build status: SCHEDULED
[10:41:54.742] Received PubSub notification, asking Buildbucket for the build status
[10:41:54.796] Build status: STARTED
[10:50:37.169] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:2:0)
[10:50:37.221] Build status: STARTED
[10:50:37.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:5:0) after 2m33s
[10:53:10.252] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:5:0)
[10:53:10.283] Build status: STARTED
[10:53:10.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:6:0) after 7m50s
[11:01:00.425] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:6:0)
[11:01:00.448] Build status: STARTED
[11:01:00.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:7:0) after 6m36s
[11:07:36.465] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:7:0)
[11:07:36.488] Build status: STARTED
[11:07:36.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:8:0) after 3m56s
[11:11:32.567] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:8:0)
[11:11:32.604] Build status: STARTED
[11:11:32.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:9:0) after 4m24s
[11:15:56.659] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:9:0)
[11:15:56.679] Build status: STARTED
[11:15:56.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:10:0) after 5m44s
[11:21:40.658] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:10:0)
[11:21:40.676] Build status: STARTED
[11:21:40.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:11:0) after 3m51s
[11:25:31.710] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:11:0)
[11:25:31.732] Build status: STARTED
[11:25:31.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:12:0) after 3m53s
[11:29:24.764] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:12:0)
[11:29:24.780] Build status: STARTED
[11:29:24.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:13:0) after 1m52s
[11:31:17.127] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:13:0)
[11:31:17.148] Build status: STARTED
[11:31:17.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:14:0) after 2m34s
[11:33:51.169] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:14:0)
[11:33:51.194] Build status: STARTED
[11:33:51.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:15:0) after 1m33s
[11:35:24.754] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:15:0)
[11:35:24.911] Build status: STARTED
[11:35:24.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:16:0) after 3m48s
[11:39:13.134] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:16:0)
[11:39:13.154] Build status: STARTED
[11:39:13.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:17:0) after 4m7s
[11:43:20.387] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:17:0)
[11:43:20.406] Build status: STARTED
[11:43:20.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:18:0) after 7m45s
[11:51:05.710] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:18:0)
[11:51:05.730] Build status: STARTED
[11:51:05.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:19:0) after 5m52s
[11:56:57.906] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:19:0)
[11:56:57.932] Build status: STARTED
[11:56:57.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:20:0) after 6m10s
[12:03:07.955] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:20:0)
[12:03:07.976] Build status: STARTED
[12:03:07.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:21:0) after 5m13s
[12:08:21.004] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:21:0)
[12:08:21.051] Build status: STARTED
[12:08:21.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:22:0) after 4m24s
[12:12:45.106] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:22:0)
[12:12:45.143] Build status: STARTED
[12:12:45.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:23:0) after 6m56s
[12:19:41.168] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:23:0)
[12:19:41.198] Build status: STARTED
[12:19:41.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:24:0) after 6m26s
[12:26:07.220] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:24:0)
[12:26:07.263] Build status: STARTED
[12:26:07.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:25:0) after 8m17s
[12:34:24.437] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:25:0)
[12:34:24.463] Build status: STARTED
[12:34:24.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:26:0) after 4m34s
[12:38:58.471] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:26:0)
[12:38:58.502] Build status: STARTED
[12:38:58.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:27:0) after 7m48s
[12:46:46.543] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:27:0)
[12:46:46.579] Build status: STARTED
[12:46:46.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:28:0) after 4m0s
[12:50:46.610] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:28:0)
[12:50:46.628] Build status: STARTED
[12:50:46.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:29:0) after 4m59s
[12:55:45.653] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:29:0)
[12:55:45.673] Build status: STARTED
[12:55:45.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:30:0) after 4m38s
[13:00:23.698] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:30:0)
[13:00:23.761] Build status: STARTED
[13:00:23.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:31:0) after 3m54s
[13:04:17.784] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:31:0)
[13:04:17.799] Build status: STARTED
[13:04:17.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:32:0) after 2m38s
[13:06:55.820] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:32:0)
[13:06:55.840] Build status: STARTED
[13:06:55.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:33:0) after 2m51s
[13:09:46.854] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:33:0)
[13:09:46.877] Build status: STARTED
[13:09:46.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:34:0) after 9m51s
[13:19:37.894] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:34:0)
[13:19:37.910] Build status: STARTED
[13:19:37.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:35:0) after 8m55s
[13:28:32.923] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:35:0)
[13:28:32.947] Build status: STARTED
[13:28:32.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:36:0) after 4m48s
[13:33:20.971] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:36:0)
[13:33:20.992] Build status: STARTED
[13:33:20.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:37:0) after 7m45s
[13:41:06.116] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:37:0)
[13:41:06.203] Build status: STARTED
[13:41:06.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:38:0) after 1m55s
[13:43:01.260] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:38:0)
[13:43:01.378] Build status: STARTED
[13:43:01.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:39:0) after 9m44s
[13:52:45.400] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:39:0)
[13:52:45.421] Build status: STARTED
[13:52:45.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:40:0) after 4m14s
[13:56:59.438] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:40:0)
[13:56:59.474] Build status: STARTED
[13:56:59.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:41:0) after 8m13s
[14:05:12.499] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:41:0)
[14:05:12.518] Build status: STARTED
[14:05:12.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:42:0) after 1m25s
[14:06:37.802] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:42:0)
[14:06:37.817] Build status: STARTED
[14:06:37.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:43:0) after 9m55s
[14:16:32.934] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:43:0)
[14:16:32.953] Build status: STARTED
[14:16:32.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:44:0) after 5m9s
[14:21:42.118] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:44:0)
[14:21:42.143] Build status: STARTED
[14:21:42.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:45:0) after 9m35s
[14:31:17.289] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:45:0)
[14:31:17.321] Build status: STARTED
[14:31:17.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:46:0) after 6m35s
[14:37:52.453] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:46:0)
[14:37:52.471] Build status: STARTED
[14:37:52.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:47:0) after 9m46s
[14:47:38.581] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:47:0)
[14:47:38.603] Build status: STARTED
[14:47:38.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:48:0) after 7m48s
[14:55:26.780] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:48:0)
[14:55:26.846] Build status: STARTED
[14:55:26.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:49:0) after 8m14s
[15:03:40.929] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:49:0)
[15:03:40.950] Build status: STARTED
[15:03:40.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:50:0) after 6m50s
[15:10:31.418] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:50:0)
[15:10:31.465] Build status: STARTED
[15:10:31.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:51:0) after 6m50s
[15:17:21.508] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:51:0)
[15:17:21.563] Build status: STARTED
[15:17:21.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:52:0) after 9m8s
[15:26:29.689] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:52:0)
[15:26:29.710] Build status: STARTED
[15:26:29.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:53:0) after 6m23s
[15:32:52.795] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:53:0)
[15:32:52.809] Build status: STARTED
[15:32:52.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:54:0) after 8m42s
[15:41:34.949] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:54:0)
[15:41:34.967] Build status: STARTED
[15:41:34.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:55:0) after 6m53s
[15:48:28.006] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:55:0)
[15:48:28.074] Build status: STARTED
[15:48:28.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:56:0) after 5m22s
[15:53:50.189] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:56:0)
[15:53:50.204] Build status: STARTED
[15:53:50.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:57:0) after 6m24s
[16:00:14.256] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:57:0)
[16:00:14.280] Build status: STARTED
[16:00:14.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:58:0) after 3m59s
[16:04:13.391] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:58:0)
[16:04:13.416] Build status: STARTED
[16:04:13.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:59:0) after 4m29s
[16:08:42.668] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:59:0)
[16:08:42.740] Build status: STARTED
[16:08:42.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:60:0) after 2m17s
[16:10:59.774] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:60:0)
[16:10:59.792] Build status: STARTED
[16:10:59.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:61:0) after 1m2s
[16:12:02.012] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:61:0)
[16:12:02.031] Build status: STARTED
[16:12:02.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:62:0) after 9m51s
[16:21:53.119] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:62:0)
[16:21:53.195] Build status: STARTED
[16:21:53.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:63:0) after 6m45s
[16:28:38.235] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:63:0)
[16:28:38.255] Build status: STARTED
[16:28:38.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:64:0) after 9m32s
[16:38:10.272] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:64:0)
[16:38:10.290] Build status: STARTED
[16:38:10.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:65:0) after 8m55s
[16:47:05.316] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:65:0)
[16:47:05.336] Build status: STARTED
[16:47:05.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:66:0) after 1m46s
[16:48:51.550] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:66:0)
[16:48:51.572] Build status: STARTED
[16:48:51.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:67:0) after 3m47s
[16:52:38.677] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:67:0)
[16:52:38.702] Build status: STARTED
[16:52:38.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:68:0) after 6m43s
[16:59:22.113] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:68:0)
[16:59:22.158] Build status: STARTED
[16:59:22.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:69:0) after 4m7s
[17:03:29.156] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:69:0)
[17:03:29.245] Build status: STARTED
[17:03:29.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:70:0) after 5m18s
[17:08:47.269] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:70:0)
[17:08:47.304] Build status: STARTED
[17:08:47.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:71:0) after 7m58s
[17:16:45.649] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:71:0)
[17:16:45.680] Build status: STARTED
[17:16:45.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:72:0) after 4m32s
[17:21:17.704] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:72:0)
[17:21:17.720] Build status: STARTED
[17:21:17.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:73:0) after 7m2s
[17:28:19.742] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:73:0)
[17:28:19.774] Build status: STARTED
[17:28:19.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:74:0) after 9m53s
[17:38:13.076] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:74:0)
[17:38:13.093] Build status: STARTED
[17:38:13.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:75:0) after 1m46s
[17:39:59.115] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:75:0)
[17:39:59.179] Build status: STARTED
[17:39:59.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:76:0) after 7m14s
[17:47:13.422] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:76:0)
[17:47:13.444] Build status: STARTED
[17:47:13.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:77:0) after 6m50s
[17:54:03.469] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:77:0)
[17:54:03.520] Build status: STARTED
[17:54:03.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:78:0) after 2m9s
[17:56:12.591] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:78:0)
[17:56:12.631] Build status: STARTED
[17:56:12.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:79:0) after 9m24s
[18:05:36.651] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:79:0)
[18:05:36.671] Build status: STARTED
[18:05:36.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:80:0) after 5m14s
[18:10:51.274] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:80:0)
[18:10:51.292] Build status: STARTED
[18:10:51.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:81:0) after 5m46s
[18:16:37.314] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:81:0)
[18:16:37.331] Build status: STARTED
[18:16:37.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:82:0) after 7m7s
[18:23:44.367] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:82:0)
[18:23:44.386] Build status: STARTED
[18:23:44.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:83:0) after 4m49s
[18:28:33.449] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:83:0)
[18:28:33.469] Build status: STARTED
[18:28:33.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:84:0) after 7m25s
[18:35:58.501] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:84:0)
[18:35:58.520] Build status: STARTED
[18:35:58.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:85:0) after 3m54s
[18:39:52.627] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:85:0)
[18:39:52.642] Build status: STARTED
[18:39:52.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:86:0) after 8m4s
[18:47:56.769] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:86:0)
[18:47:56.786] Build status: STARTED
[18:47:56.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:87:0) after 5m32s
[18:53:28.809] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:87:0)
[18:53:28.825] Build status: STARTED
[18:53:28.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:88:0) after 9m6s
[19:02:34.844] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:88:0)
[19:02:34.863] Build status: STARTED
[19:02:34.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:89:0) after 1m5s
[19:03:39.936] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:89:0)
[19:03:39.968] Build status: STARTED
[19:03:39.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:90:0) after 5m56s
[19:09:35.994] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:90:0)
[19:09:36.019] Build status: STARTED
[19:09:36.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:91:0) after 4m19s
[19:13:55.176] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:91:0)
[19:13:55.197] Build status: STARTED
[19:13:55.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:92:0) after 4m33s
[19:18:28.323] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:92:0)
[19:18:28.342] Build status: STARTED
[19:18:28.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:93:0) after 2m26s
[19:20:54.360] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:93:0)
[19:20:54.389] Build status: STARTED
[19:20:54.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8876164141278397632:94:0) after 1m15s
[19:21:59.762] Received PubSub notification, asking Buildbucket for the build status
[19:21:59.781] Build:
{
"id": "8710734079335731713",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 27767,
"createdBy": "project:chromium",
"createTime": "2025-06-29T10:40:53.700670581Z",
"startTime": "2025-06-29T10:41:54.513970195Z",
"endTime": "2025-06-29T19:21:59.424782274Z",
"updateTime": "2025-06-29T19:21:59.424782274Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9e106f8a36c0804cc7cd978fd60acc4bb7fa71d2",
"ref": "refs/heads/main"
}
},
"canary": true
}
[19:21:59.781] Invocation finished in 8h41m7.31613868s with status FAILED