[22:12:55.300] New invocation is queued and will start shortly
[22:12:56.976] Starting the invocation (attempt 1)
[22:12:57.021] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d0c929ab0185ee67da52628645d0c315bac3d30f"
[22:12:57.022] Popped gitiles commit info from properties and tags
[22:12:57.022] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:12:57.022] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:12:57.022] Buildbucket request:
{
"requestId": "8945699071636558768",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d0c929ab0185ee67da52628645d0c315bac3d30f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8945699071636558768"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:12:58.008] Scheduled build:
{
"id": "8780269009072891409",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 19009,
"createdBy": "project:chromium",
"createTime": "2023-05-23T22:12:57.117319668Z",
"updateTime": "2023-05-23T22:12:57.117319668Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d0c929ab0185ee67da52628645d0c315bac3d30f",
"ref": "refs/heads/main"
}
},
"canary": true
}
[22:12:58.008] Task URL: https://cr-buildbucket.appspot.com/build/8780269009072891409
[22:12:58.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:2:0) after 3m47s
[22:16:45.569] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:2:0)
[22:16:45.590] Build status: SCHEDULED
[22:16:45.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:3:0) after 9m35s
[22:17:04.773] Received PubSub notification, asking Buildbucket for the build status
[22:17:04.830] Build status: STARTED
[22:26:20.941] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:3:0)
[22:26:20.976] Build status: STARTED
[22:26:20.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:5:0) after 8m50s
[22:35:10.978] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:5:0)
[22:35:11.007] Build status: STARTED
[22:35:11.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:6:0) after 9m54s
[22:45:05.265] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:6:0)
[22:45:05.302] Build status: STARTED
[22:45:05.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:7:0) after 5m37s
[22:50:42.512] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:7:0)
[22:50:42.532] Build status: STARTED
[22:50:42.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:8:0) after 2m20s
[22:53:03.552] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:8:0)
[22:53:03.578] Build status: STARTED
[22:53:03.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:9:0) after 8m12s
[23:01:16.106] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:9:0)
[23:01:16.149] Build status: STARTED
[23:01:16.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:10:0) after 2m42s
[23:03:58.261] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:10:0)
[23:03:58.277] Build status: STARTED
[23:03:58.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:11:0) after 2m2s
[23:06:00.428] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:11:0)
[23:06:00.481] Build status: STARTED
[23:06:00.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:12:0) after 4m59s
[23:11:00.078] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:12:0)
[23:11:00.099] Build status: STARTED
[23:11:00.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:13:0) after 7m37s
[23:18:37.129] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:13:0)
[23:18:37.149] Build status: STARTED
[23:18:37.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:14:0) after 5m24s
[23:24:01.202] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:14:0)
[23:24:01.225] Build status: STARTED
[23:24:01.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:15:0) after 3m12s
[23:27:13.335] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:15:0)
[23:27:13.355] Build status: STARTED
[23:27:13.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:16:0) after 4m31s
[23:31:44.698] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:16:0)
[23:31:44.718] Build status: STARTED
[23:31:44.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:17:0) after 1m24s
[23:33:08.790] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:17:0)
[23:33:08.809] Build status: STARTED
[23:33:08.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:18:0) after 6m37s
[23:39:45.840] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:18:0)
[23:39:45.858] Build status: STARTED
[23:39:45.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:19:0) after 1m31s
[23:41:16.949] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:19:0)
[23:41:16.969] Build status: STARTED
[23:41:16.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:20:0) after 9m32s
[23:50:49.058] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:20:0)
[23:50:49.148] Build status: STARTED
[23:50:49.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:21:0) after 7m56s
[23:58:45.316] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:21:0)
[23:58:45.334] Build status: STARTED
[23:58:45.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:22:0) after 7m46s
[00:06:31.370] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:22:0)
[00:06:31.399] Build status: STARTED
[00:06:31.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:23:0) after 7m20s
[00:13:51.394] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:23:0)
[00:13:51.414] Build status: STARTED
[00:13:51.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:24:0) after 2m59s
[00:16:50.638] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:24:0)
[00:16:50.714] Build status: STARTED
[00:16:50.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:25:0) after 6m36s
[00:23:26.952] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:25:0)
[00:23:26.972] Build status: STARTED
[00:23:26.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:26:0) after 2m51s
[00:26:18.143] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:26:0)
[00:26:18.165] Build status: STARTED
[00:26:18.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:27:0) after 1m37s
[00:27:55.288] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:27:0)
[00:27:55.308] Build status: STARTED
[00:27:55.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:28:0) after 6m9s
[00:34:04.335] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:28:0)
[00:34:04.353] Build status: STARTED
[00:34:04.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:29:0) after 9m3s
[00:43:07.494] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:29:0)
[00:43:07.522] Build status: STARTED
[00:43:07.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:30:0) after 3m41s
[00:46:48.906] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:30:0)
[00:46:48.929] Build status: STARTED
[00:46:48.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:31:0) after 3m36s
[00:50:25.062] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:31:0)
[00:50:25.117] Build status: STARTED
[00:50:25.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:32:0) after 1m14s
[00:51:39.159] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:32:0)
[00:51:39.177] Build status: STARTED
[00:51:39.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:33:0) after 3m59s
[00:55:38.217] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:33:0)
[00:55:38.245] Build status: STARTED
[00:55:38.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:34:0) after 3m27s
[00:59:05.498] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:34:0)
[00:59:05.544] Build status: STARTED
[00:59:05.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:35:0) after 6m43s
[01:05:48.608] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:35:0)
[01:05:48.637] Build status: STARTED
[01:05:48.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:36:0) after 9m42s
[01:15:31.042] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:36:0)
[01:15:31.063] Build status: STARTED
[01:15:31.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:37:0) after 7m26s
[01:22:57.148] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:37:0)
[01:22:57.197] Build status: STARTED
[01:22:57.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:38:0) after 7m53s
[01:30:50.327] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:38:0)
[01:30:50.351] Build status: STARTED
[01:30:50.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:39:0) after 8m13s
[01:39:03.416] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:39:0)
[01:39:03.436] Build status: STARTED
[01:39:03.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:40:0) after 7m45s
[01:46:48.700] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:40:0)
[01:46:48.723] Build status: STARTED
[01:46:48.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:41:0) after 2m12s
[01:49:00.801] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:41:0)
[01:49:00.819] Build status: STARTED
[01:49:00.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:42:0) after 7m52s
[01:56:53.405] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:42:0)
[01:56:53.461] Build status: STARTED
[01:56:53.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:43:0) after 5m44s
[02:02:37.585] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:43:0)
[02:02:37.607] Build status: STARTED
[02:02:37.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:44:0) after 4m6s
[02:06:43.634] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:44:0)
[02:06:43.679] Build status: STARTED
[02:06:43.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:45:0) after 2m31s
[02:09:14.724] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:45:0)
[02:09:14.742] Build status: STARTED
[02:09:14.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:46:0) after 8m16s
[02:17:30.975] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:46:0)
[02:17:30.996] Build status: STARTED
[02:17:30.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:47:0) after 3m10s
[02:20:41.043] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:47:0)
[02:20:41.065] Build status: STARTED
[02:20:41.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:48:0) after 7m5s
[02:27:46.349] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:48:0)
[02:27:46.372] Build status: STARTED
[02:27:46.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:49:0) after 8m55s
[02:36:41.394] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:49:0)
[02:36:41.426] Build status: STARTED
[02:36:41.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:50:0) after 1m26s
[02:38:07.461] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:50:0)
[02:38:07.486] Build status: STARTED
[02:38:07.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:51:0) after 6m13s
[02:44:20.620] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:51:0)
[02:44:20.648] Build status: STARTED
[02:44:20.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:52:0) after 4m45s
[02:49:05.833] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:52:0)
[02:49:05.853] Build status: STARTED
[02:49:05.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:53:0) after 6m10s
[02:55:15.900] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:53:0)
[02:55:15.921] Build status: STARTED
[02:55:15.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:54:0) after 3m6s
[02:58:21.947] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:54:0)
[02:58:21.966] Build status: STARTED
[02:58:21.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:55:0) after 3m18s
[03:01:40.005] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:55:0)
[03:01:40.050] Build status: STARTED
[03:01:40.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:56:0) after 7m11s
[03:08:51.197] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:56:0)
[03:08:51.259] Build status: STARTED
[03:08:51.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:57:0) after 4m26s
[03:13:17.363] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:57:0)
[03:13:17.382] Build status: STARTED
[03:13:17.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:58:0) after 7m9s
[03:20:26.584] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:58:0)
[03:20:26.619] Build status: STARTED
[03:20:26.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:59:0) after 3m55s
[03:24:21.776] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:59:0)
[03:24:21.805] Build status: STARTED
[03:24:21.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:60:0) after 7m55s
[03:32:16.835] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:60:0)
[03:32:16.855] Build status: STARTED
[03:32:16.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:61:0) after 5m31s
[03:37:48.142] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:61:0)
[03:37:48.250] Build status: STARTED
[03:37:48.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:62:0) after 7m30s
[03:45:18.398] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:62:0)
[03:45:18.416] Build status: STARTED
[03:45:18.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:63:0) after 7m42s
[03:53:00.416] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:63:0)
[03:53:00.440] Build status: STARTED
[03:53:00.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:64:0) after 4m57s
[03:57:57.467] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:64:0)
[03:57:57.493] Build status: STARTED
[03:57:57.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:65:0) after 6m21s
[04:04:18.574] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:65:0)
[04:04:18.592] Build status: STARTED
[04:04:18.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:66:0) after 2m3s
[04:06:21.804] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:66:0)
[04:06:21.827] Build status: STARTED
[04:06:21.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:67:0) after 1m2s
[04:07:23.969] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:67:0)
[04:07:23.988] Build status: STARTED
[04:07:23.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:68:0) after 8m23s
[04:15:47.020] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:68:0)
[04:15:47.040] Build status: STARTED
[04:15:47.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:69:0) after 8m39s
[04:24:26.292] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:69:0)
[04:24:26.316] Build status: STARTED
[04:24:26.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:70:0) after 4m39s
[04:29:05.623] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:70:0)
[04:29:05.639] Build status: STARTED
[04:29:05.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:71:0) after 7m18s
[04:36:23.680] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:71:0)
[04:36:23.720] Build status: STARTED
[04:36:23.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:72:0) after 4m39s
[04:41:02.778] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:72:0)
[04:41:02.799] Build status: STARTED
[04:41:02.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:73:0) after 2m4s
[04:43:06.846] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:73:0)
[04:43:06.892] Build status: STARTED
[04:43:06.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:74:0) after 3m5s
[04:46:11.981] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:74:0)
[04:46:11.999] Build status: STARTED
[04:46:11.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:75:0) after 6m27s
[04:52:39.288] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:75:0)
[04:52:39.318] Build status: STARTED
[04:52:39.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:76:0) after 2m41s
[04:55:20.371] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:76:0)
[04:55:20.393] Build status: STARTED
[04:55:20.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:77:0) after 4m59s
[05:00:19.586] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:77:0)
[05:00:19.651] Build status: STARTED
[05:00:19.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:78:0) after 3m12s
[05:03:31.682] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:78:0)
[05:03:31.704] Build status: STARTED
[05:03:31.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:79:0) after 7m13s
[05:10:44.759] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:79:0)
[05:10:44.852] Build status: STARTED
[05:10:44.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:80:0) after 3m58s
[05:14:42.854] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:80:0)
[05:14:42.890] Build status: STARTED
[05:14:42.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:81:0) after 1m34s
[05:16:16.917] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:81:0)
[05:16:16.938] Build status: STARTED
[05:16:16.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:82:0) after 5m40s
[05:21:57.111] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:82:0)
[05:21:57.133] Build status: STARTED
[05:21:57.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:83:0) after 1m43s
[05:23:40.387] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:83:0)
[05:23:40.405] Build status: STARTED
[05:23:40.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:84:0) after 2m53s
[05:26:33.540] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:84:0)
[05:26:33.689] Build status: STARTED
[05:26:33.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:85:0) after 2m44s
[05:29:17.720] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:85:0)
[05:29:17.747] Build status: STARTED
[05:29:17.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:86:0) after 7m18s
[05:36:35.866] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:86:0)
[05:36:35.892] Build status: STARTED
[05:36:35.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:87:0) after 5m40s
[05:42:15.940] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:87:0)
[05:42:15.963] Build status: STARTED
[05:42:15.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:88:0) after 1m21s
[05:43:37.000] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:88:0)
[05:43:37.025] Build status: STARTED
[05:43:37.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:89:0) after 3m25s
[05:47:02.418] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:89:0)
[05:47:02.438] Build status: STARTED
[05:47:02.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:90:0) after 3m55s
[05:50:57.548] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:90:0)
[05:50:57.762] Build status: STARTED
[05:50:57.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:91:0) after 5m33s
[05:56:30.783] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:91:0)
[05:56:30.803] Build status: STARTED
[05:56:30.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:92:0) after 3m38s
[06:00:09.040] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:92:0)
[06:00:09.068] Build status: STARTED
[06:00:09.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:93:0) after 4m33s
[06:04:42.098] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:93:0)
[06:04:42.208] Build status: STARTED
[06:04:42.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:94:0) after 7m16s
[06:11:58.251] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:94:0)
[06:11:58.269] Build status: STARTED
[06:11:58.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:95:0) after 7m37s
[06:19:35.456] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:95:0)
[06:19:35.475] Build status: STARTED
[06:19:35.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:96:0) after 9m5s
[06:28:40.540] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:96:0)
[06:28:40.565] Build status: STARTED
[06:28:40.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:97:0) after 6m23s
[06:35:03.886] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:97:0)
[06:35:03.947] Build status: STARTED
[06:35:03.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:98:0) after 6m35s
[06:41:39.089] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:98:0)
[06:41:39.109] Build status: STARTED
[06:41:39.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:99:0) after 6m13s
[06:47:52.176] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:99:0)
[06:47:52.196] Build status: STARTED
[06:47:52.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:100:0) after 7m24s
[06:55:16.503] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:100:0)
[06:55:16.526] Build status: STARTED
[06:55:16.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:101:0) after 1m29s
[06:56:45.565] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:101:0)
[06:56:45.588] Build status: STARTED
[06:56:45.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:102:0) after 8m46s
[07:05:31.637] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:102:0)
[07:05:31.661] Build status: STARTED
[07:05:31.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:103:0) after 1m31s
[07:07:02.651] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:103:0)
[07:07:02.722] Build status: STARTED
[07:07:02.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:104:0) after 6m9s
[07:13:11.763] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:104:0)
[07:13:11.788] Build status: STARTED
[07:13:11.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:105:0) after 5m2s
[07:18:13.827] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:105:0)
[07:18:13.850] Build status: STARTED
[07:18:13.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:106:0) after 6m51s
[07:25:05.100] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:106:0)
[07:25:05.198] Build status: STARTED
[07:25:05.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:107:0) after 8m1s
[07:33:06.244] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:107:0)
[07:33:06.408] Build status: STARTED
[07:33:06.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:108:0) after 8m32s
[07:41:38.445] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:108:0)
[07:41:38.464] Build status: STARTED
[07:41:38.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:109:0) after 2m7s
[07:43:45.614] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:109:0)
[07:43:45.636] Build status: STARTED
[07:43:45.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:110:0) after 4m28s
[07:48:13.772] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:110:0)
[07:48:13.792] Build status: STARTED
[07:48:13.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:111:0) after 7m59s
[07:56:12.829] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:111:0)
[07:56:12.865] Build status: STARTED
[07:56:12.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:112:0) after 2m25s
[07:58:37.910] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:112:0)
[07:58:37.939] Build status: STARTED
[07:58:37.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:113:0) after 8m35s
[08:07:13.254] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:113:0)
[08:07:13.273] Build status: STARTED
[08:07:13.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:114:0) after 2m31s
[08:09:44.301] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:114:0)
[08:09:44.320] Build status: STARTED
[08:09:44.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:115:0) after 9m28s
[08:19:12.353] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:115:0)
[08:19:12.371] Build status: STARTED
[08:19:12.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:116:0) after 4m42s
[08:23:54.535] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:116:0)
[08:23:54.715] Build status: STARTED
[08:23:54.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:117:0) after 6m18s
[08:30:12.836] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:117:0)
[08:30:12.857] Build status: STARTED
[08:30:12.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:118:0) after 9m45s
[08:39:58.033] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:118:0)
[08:39:58.052] Build status: STARTED
[08:39:58.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:119:0) after 9m11s
[08:49:09.592] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:119:0)
[08:49:09.612] Build status: STARTED
[08:49:09.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:120:0) after 1m36s
[08:50:45.661] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:120:0)
[08:50:45.695] Build status: STARTED
[08:50:45.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:121:0) after 6m8s
[08:56:53.689] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:121:0)
[08:56:53.709] Build status: STARTED
[08:56:53.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:122:0) after 9m40s
[09:06:34.061] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:122:0)
[09:06:34.081] Build status: STARTED
[09:06:34.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:123:0) after 4m11s
[09:10:45.207] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:123:0)
[09:10:45.229] Build status: STARTED
[09:10:45.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8945699071636558768:124:0) after 8m48s
[09:13:19.093] Received PubSub notification, asking Buildbucket for the build status
[09:13:19.117] Build:
{
"id": "8780269009072891409",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 19009,
"createdBy": "project:chromium",
"createTime": "2023-05-23T22:12:57.117319668Z",
"startTime": "2023-05-23T22:17:04.257515Z",
"endTime": "2023-05-24T09:13:12.442511215Z",
"updateTime": "2023-05-24T09:13:12.442511215Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d0c929ab0185ee67da52628645d0c315bac3d30f",
"ref": "refs/heads/main"
}
},
"canary": true
}
[09:13:19.117] Invocation finished in 11h0m23.829049685s with status FAILED