[00:40:58.692] New invocation is queued and will start shortly
[00:41:00.540] Starting the invocation (attempt 1)
[00:41:00.569] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/292ecfc92aa16741279bdfa7e2de06160e0263d6"
[00:41:00.569] Popped gitiles commit info from properties and tags
[00:41:00.569] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:41:00.569] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:41:00.569] Buildbucket request:
{
"requestId": "8947139308185528960",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "292ecfc92aa16741279bdfa7e2de06160e0263d6",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8947139308185528960"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:41:01.002] Scheduled build:
{
"id": "8781709245494005329",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 18968,
"createdBy": "project:chromium",
"createTime": "2023-05-08T00:41:00.633706458Z",
"updateTime": "2023-05-08T00:41:00.633706458Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "292ecfc92aa16741279bdfa7e2de06160e0263d6",
"ref": "refs/heads/main"
}
}
}
[00:41:01.002] Task URL: https://cr-buildbucket.appspot.com/build/8781709245494005329
[00:41:01.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:2:0) after 9m51s
[00:42:57.486] Received PubSub notification, asking Buildbucket for the build status
[00:42:57.504] Build status: STARTED
[00:50:52.019] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:2:0)
[00:50:52.037] Build status: STARTED
[00:50:52.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:4:0) after 5m38s
[00:56:30.105] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:4:0)
[00:56:30.137] Build status: STARTED
[00:56:30.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:5:0) after 4m28s
[01:00:58.226] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:5:0)
[01:00:58.258] Build status: STARTED
[01:00:58.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:6:0) after 2m38s
[01:03:36.282] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:6:0)
[01:03:36.352] Build status: STARTED
[01:03:36.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:7:0) after 1m23s
[01:04:59.565] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:7:0)
[01:04:59.584] Build status: STARTED
[01:04:59.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:8:0) after 9m14s
[01:14:13.605] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:8:0)
[01:14:13.622] Build status: STARTED
[01:14:13.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:9:0) after 3m28s
[01:17:41.639] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:9:0)
[01:17:41.659] Build status: STARTED
[01:17:41.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:10:0) after 7m47s
[01:25:28.716] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:10:0)
[01:25:28.739] Build status: STARTED
[01:25:28.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:11:0) after 2m53s
[01:28:21.754] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:11:0)
[01:28:21.837] Build status: STARTED
[01:28:21.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:12:0) after 2m2s
[01:30:23.994] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:12:0)
[01:30:24.021] Build status: STARTED
[01:30:24.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:13:0) after 5m9s
[01:35:33.025] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:13:0)
[01:35:33.048] Build status: STARTED
[01:35:33.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:14:0) after 7m15s
[01:42:48.085] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:14:0)
[01:42:48.116] Build status: STARTED
[01:42:48.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:15:0) after 6m56s
[01:49:44.216] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:15:0)
[01:49:44.247] Build status: STARTED
[01:49:44.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:16:0) after 3m39s
[01:53:23.313] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:16:0)
[01:53:23.336] Build status: STARTED
[01:53:23.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:17:0) after 2m39s
[01:56:02.402] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:17:0)
[01:56:02.482] Build status: STARTED
[01:56:02.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:18:0) after 7m29s
[02:03:31.595] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:18:0)
[02:03:31.617] Build status: STARTED
[02:03:31.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:19:0) after 6m29s
[02:10:00.630] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:19:0)
[02:10:00.646] Build status: STARTED
[02:10:00.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:20:0) after 9m56s
[02:19:56.766] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:20:0)
[02:19:56.785] Build status: STARTED
[02:19:56.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:21:0) after 1m13s
[02:21:09.909] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:21:0)
[02:21:09.934] Build status: STARTED
[02:21:09.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:22:0) after 1m45s
[02:22:55.049] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:22:0)
[02:22:55.067] Build status: STARTED
[02:22:55.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:23:0) after 2m12s
[02:25:07.139] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:23:0)
[02:25:07.157] Build status: STARTED
[02:25:07.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:24:0) after 6m44s
[02:31:51.173] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:24:0)
[02:31:51.205] Build status: STARTED
[02:31:51.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:25:0) after 3m5s
[02:34:56.310] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:25:0)
[02:34:56.330] Build status: STARTED
[02:34:56.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:26:0) after 3m13s
[02:38:09.507] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:26:0)
[02:38:09.524] Build status: STARTED
[02:38:09.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:27:0) after 9m2s
[02:47:11.544] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:27:0)
[02:47:11.564] Build status: STARTED
[02:47:11.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:28:0) after 1m23s
[02:48:34.589] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:28:0)
[02:48:34.608] Build status: STARTED
[02:48:34.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:29:0) after 8m20s
[02:56:54.641] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:29:0)
[02:56:54.659] Build status: STARTED
[02:56:54.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:30:0) after 2m12s
[02:59:06.722] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:30:0)
[02:59:06.739] Build status: STARTED
[02:59:06.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:31:0) after 6m41s
[03:05:47.762] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:31:0)
[03:05:47.788] Build status: STARTED
[03:05:47.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:32:0) after 8m33s
[03:14:20.834] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:32:0)
[03:14:20.874] Build status: STARTED
[03:14:20.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:33:0) after 7m6s
[03:21:27.010] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:33:0)
[03:21:27.052] Build status: STARTED
[03:21:27.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:34:0) after 1m33s
[03:23:00.068] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:34:0)
[03:23:00.089] Build status: STARTED
[03:23:00.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:35:0) after 8m56s
[03:31:56.208] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:35:0)
[03:31:56.233] Build status: STARTED
[03:31:56.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:36:0) after 8m52s
[03:40:48.250] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:36:0)
[03:40:48.270] Build status: STARTED
[03:40:48.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:37:0) after 8m1s
[03:48:49.286] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:37:0)
[03:48:49.321] Build status: STARTED
[03:48:49.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:38:0) after 8m52s
[03:57:41.357] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:38:0)
[03:57:41.405] Build status: STARTED
[03:57:41.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:39:0) after 2m47s
[04:00:28.471] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:39:0)
[04:00:28.495] Build status: STARTED
[04:00:28.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:40:0) after 1m19s
[04:01:47.513] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:40:0)
[04:01:47.542] Build status: STARTED
[04:01:47.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:41:0) after 9m0s
[04:10:47.579] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:41:0)
[04:10:47.601] Build status: STARTED
[04:10:47.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:42:0) after 5m40s
[04:16:27.735] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:42:0)
[04:16:27.759] Build status: STARTED
[04:16:27.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:43:0) after 2m51s
[04:19:18.777] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:43:0)
[04:19:18.794] Build status: STARTED
[04:19:18.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:44:0) after 7m49s
[04:27:08.012] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:44:0)
[04:27:08.054] Build status: STARTED
[04:27:08.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:45:0) after 7m18s
[04:34:26.064] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:45:0)
[04:34:26.083] Build status: STARTED
[04:34:26.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:46:0) after 8m28s
[04:42:54.212] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:46:0)
[04:42:54.230] Build status: STARTED
[04:42:54.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:47:0) after 5m38s
[04:48:32.248] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:47:0)
[04:48:32.264] Build status: STARTED
[04:48:32.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:48:0) after 9m36s
[04:58:08.446] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:48:0)
[04:58:08.465] Build status: STARTED
[04:58:08.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:49:0) after 2m42s
[05:00:50.492] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:49:0)
[05:00:50.524] Build status: STARTED
[05:00:50.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:50:0) after 5m10s
[05:06:00.540] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:50:0)
[05:06:00.559] Build status: STARTED
[05:06:00.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:51:0) after 4m2s
[05:10:02.613] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:51:0)
[05:10:02.642] Build status: STARTED
[05:10:02.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:52:0) after 3m22s
[05:13:24.665] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:52:0)
[05:13:24.742] Build status: STARTED
[05:13:24.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:53:0) after 9m50s
[05:23:14.942] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:53:0)
[05:23:14.962] Build status: STARTED
[05:23:14.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:54:0) after 5m3s
[05:28:18.088] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:54:0)
[05:28:18.113] Build status: STARTED
[05:28:18.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:55:0) after 7m4s
[05:35:22.225] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:55:0)
[05:35:22.249] Build status: STARTED
[05:35:22.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:56:0) after 5m34s
[05:40:56.297] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:56:0)
[05:40:56.316] Build status: STARTED
[05:40:56.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:57:0) after 3m22s
[05:44:18.340] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:57:0)
[05:44:18.360] Build status: STARTED
[05:44:18.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:58:0) after 1m44s
[05:46:02.381] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:58:0)
[05:46:02.407] Build status: STARTED
[05:46:02.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:59:0) after 2m37s
[05:48:39.528] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:59:0)
[05:48:39.543] Build status: STARTED
[05:48:39.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:60:0) after 9m46s
[05:58:25.574] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:60:0)
[05:58:25.590] Build status: STARTED
[05:58:25.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:61:0) after 5m43s
[06:04:08.834] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:61:0)
[06:04:08.853] Build status: STARTED
[06:04:08.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:62:0) after 4m57s
[06:09:05.979] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:62:0)
[06:09:05.998] Build status: STARTED
[06:09:05.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:63:0) after 7m4s
[06:16:10.311] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:63:0)
[06:16:10.331] Build status: STARTED
[06:16:10.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:64:0) after 7m20s
[06:23:30.394] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:64:0)
[06:23:30.423] Build status: STARTED
[06:23:30.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:65:0) after 4m38s
[06:28:08.448] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:65:0)
[06:28:08.497] Build status: STARTED
[06:28:08.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:66:0) after 6m47s
[06:34:55.525] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:66:0)
[06:34:55.550] Build status: STARTED
[06:34:55.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:67:0) after 7m52s
[06:42:47.568] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:67:0)
[06:42:47.587] Build status: STARTED
[06:42:47.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:68:0) after 7m53s
[06:50:40.604] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:68:0)
[06:50:40.622] Build status: STARTED
[06:50:40.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:69:0) after 4m16s
[06:54:56.794] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:69:0)
[06:54:56.839] Build status: STARTED
[06:54:56.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:70:0) after 1m25s
[06:56:21.864] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:70:0)
[06:56:21.880] Build status: STARTED
[06:56:21.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:71:0) after 2m4s
[06:58:25.862] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:71:0)
[06:58:25.886] Build status: STARTED
[06:58:25.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:72:0) after 6m15s
[07:04:40.903] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:72:0)
[07:04:40.930] Build status: STARTED
[07:04:40.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:73:0) after 8m54s
[07:13:35.056] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:73:0)
[07:13:35.080] Build status: STARTED
[07:13:35.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:74:0) after 4m42s
[07:18:17.121] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:74:0)
[07:18:17.142] Build status: STARTED
[07:18:17.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:75:0) after 1m50s
[07:20:07.172] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:75:0)
[07:20:07.209] Build status: STARTED
[07:20:07.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:76:0) after 5m32s
[07:25:39.339] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:76:0)
[07:25:39.359] Build status: STARTED
[07:25:39.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:77:0) after 8m58s
[07:34:37.401] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:77:0)
[07:34:37.477] Build status: STARTED
[07:34:37.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:78:0) after 7m21s
[07:41:58.757] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:78:0)
[07:41:58.780] Build status: STARTED
[07:41:58.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:79:0) after 9m47s
[07:51:45.907] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:79:0)
[07:51:45.925] Build status: STARTED
[07:51:45.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:80:0) after 4m24s
[07:56:10.037] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:80:0)
[07:56:10.106] Build status: STARTED
[07:56:10.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:81:0) after 3m13s
[07:59:23.262] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:81:0)
[07:59:23.277] Build status: STARTED
[07:59:23.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:82:0) after 4m22s
[08:03:45.487] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:82:0)
[08:03:45.508] Build status: STARTED
[08:03:45.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:83:0) after 3m52s
[08:07:37.529] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:83:0)
[08:07:37.549] Build status: STARTED
[08:07:37.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:84:0) after 4m18s
[08:11:55.598] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:84:0)
[08:11:55.619] Build status: STARTED
[08:11:55.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:85:0) after 4m10s
[08:16:05.689] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:85:0)
[08:16:05.708] Build status: STARTED
[08:16:05.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:86:0) after 5m32s
[08:21:37.682] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:86:0)
[08:21:37.730] Build status: STARTED
[08:21:37.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:87:0) after 5m11s
[08:26:48.765] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:87:0)
[08:26:48.787] Build status: STARTED
[08:26:48.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:88:0) after 7m14s
[08:34:02.918] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:88:0)
[08:34:02.944] Build status: STARTED
[08:34:02.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:89:0) after 9m56s
[08:43:58.921] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:89:0)
[08:43:58.940] Build status: STARTED
[08:43:58.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:90:0) after 2m5s
[08:46:03.959] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:90:0)
[08:46:03.989] Build status: STARTED
[08:46:03.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:91:0) after 5m56s
[08:52:00.060] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:91:0)
[08:52:00.078] Build status: STARTED
[08:52:00.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:92:0) after 2m58s
[08:54:58.118] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:92:0)
[08:54:58.147] Build status: STARTED
[08:54:58.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:93:0) after 3m42s
[08:58:40.218] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:93:0)
[08:58:40.235] Build status: STARTED
[08:58:40.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:94:0) after 9m3s
[09:07:43.408] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:94:0)
[09:07:43.426] Build status: STARTED
[09:07:43.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:95:0) after 2m15s
[09:09:58.445] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:95:0)
[09:09:58.469] Build status: STARTED
[09:09:58.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:96:0) after 5m39s
[09:15:37.508] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:96:0)
[09:15:37.527] Build status: STARTED
[09:15:37.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:97:0) after 5m17s
[09:20:54.600] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:97:0)
[09:20:54.621] Build status: STARTED
[09:20:54.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:98:0) after 6m23s
[09:27:17.823] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:98:0)
[09:27:17.841] Build status: STARTED
[09:27:17.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:99:0) after 5m5s
[09:32:23.064] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:99:0)
[09:32:23.088] Build status: STARTED
[09:32:23.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:100:0) after 9m40s
[09:42:03.550] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:100:0)
[09:42:03.575] Build status: STARTED
[09:42:03.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:101:0) after 4m45s
[09:46:48.800] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:101:0)
[09:46:48.825] Build status: STARTED
[09:46:48.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:102:0) after 5m6s
[09:51:54.999] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:102:0)
[09:51:55.019] Build status: STARTED
[09:51:55.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:103:0) after 8m23s
[10:00:18.049] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:103:0)
[10:00:18.077] Build status: STARTED
[10:00:18.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:104:0) after 3m24s
[10:03:42.377] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:104:0)
[10:03:42.399] Build status: STARTED
[10:03:42.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:105:0) after 7m43s
[10:11:25.429] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:105:0)
[10:11:25.453] Build status: STARTED
[10:11:25.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:106:0) after 3m14s
[10:14:39.481] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:106:0)
[10:14:39.504] Build status: STARTED
[10:14:39.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:107:0) after 8m50s
[10:23:29.699] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:107:0)
[10:23:29.720] Build status: STARTED
[10:23:29.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:108:0) after 3m44s
[10:27:13.740] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:108:0)
[10:27:13.764] Build status: STARTED
[10:27:13.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:109:0) after 6m47s
[10:34:00.790] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:109:0)
[10:34:00.834] Build status: STARTED
[10:34:00.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:110:0) after 2m13s
[10:36:14.076] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:110:0)
[10:36:14.092] Build status: STARTED
[10:36:14.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:111:0) after 9m35s
[10:45:49.278] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:111:0)
[10:45:49.294] Build status: STARTED
[10:45:49.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:112:0) after 2m33s
[10:48:22.357] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:112:0)
[10:48:22.377] Build status: STARTED
[10:48:22.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:113:0) after 7m22s
[10:55:44.406] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:113:0)
[10:55:44.439] Build status: STARTED
[10:55:44.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:114:0) after 3m46s
[10:59:30.587] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:114:0)
[10:59:30.609] Build status: STARTED
[10:59:30.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:115:0) after 6m42s
[11:06:12.663] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:115:0)
[11:06:12.681] Build status: STARTED
[11:06:12.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:116:0) after 3m53s
[11:10:06.145] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:116:0)
[11:10:06.166] Build status: STARTED
[11:10:06.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:117:0) after 6m7s
[11:16:13.587] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:117:0)
[11:16:13.676] Build status: STARTED
[11:16:13.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:118:0) after 5m30s
[11:21:43.820] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:118:0)
[11:21:43.840] Build status: STARTED
[11:21:43.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:119:0) after 3m40s
[11:25:24.392] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:119:0)
[11:25:24.430] Build status: STARTED
[11:25:24.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:120:0) after 8m52s
[11:34:16.463] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:120:0)
[11:34:16.481] Build status: STARTED
[11:34:16.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:121:0) after 4m56s
[11:39:12.548] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:121:0)
[11:39:12.565] Build status: STARTED
[11:39:12.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8947139308185528960:122:0) after 1m4s
[11:39:25.130] Received PubSub notification, asking Buildbucket for the build status
[11:39:25.167] Build:
{
"id": "8781709245494005329",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 18968,
"createdBy": "project:chromium",
"createTime": "2023-05-08T00:41:00.633706458Z",
"startTime": "2023-05-08T00:42:56.536459Z",
"endTime": "2023-05-08T11:39:24.859631144Z",
"updateTime": "2023-05-08T11:39:24.859631144Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "292ecfc92aa16741279bdfa7e2de06160e0263d6",
"ref": "refs/heads/main"
}
}
}
[11:39:25.167] Invocation finished in 10h58m26.484636161s with status FAILED