[21:48:48.128] New invocation is queued and will start shortly
[21:48:49.306] Starting the invocation (attempt 1)
[21:48:49.335] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/013d01e92722fe60be8658e3642410a5abbd6db6"
[21:48:49.335] Popped gitiles commit info from properties and tags
[21:48:49.335] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:48:49.336] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:48:49.336] Buildbucket request:
{
"requestId": "8938090443929365744",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "013d01e92722fe60be8658e3642410a5abbd6db6",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8938090443929365744"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:48:50.210] Scheduled build:
{
"id": "8772660381934522161",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 19736,
"createdBy": "project:chromium",
"createTime": "2023-08-15T21:48:49.402004852Z",
"updateTime": "2023-08-15T21:48:49.402004852Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "013d01e92722fe60be8658e3642410a5abbd6db6",
"ref": "refs/heads/main"
}
}
}
[21:48:50.210] Task URL: https://cr-buildbucket.appspot.com/build/8772660381934522161
[21:48:50.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:2:0) after 7m3s
[21:48:51.098] Received PubSub notification, asking Buildbucket for the build status
[21:48:51.182] Build status: SCHEDULED
[21:50:51.175] Received PubSub notification, asking Buildbucket for the build status
[21:50:51.273] Build status: STARTED
[21:55:53.309] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:2:0)
[21:55:53.341] Build status: STARTED
[21:55:53.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:5:0) after 4m40s
[22:00:33.380] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:5:0)
[22:00:33.415] Build status: STARTED
[22:00:33.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:6:0) after 1m27s
[22:02:00.546] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:6:0)
[22:02:00.581] Build status: STARTED
[22:02:00.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:7:0) after 7m25s
[22:09:25.715] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:7:0)
[22:09:25.743] Build status: STARTED
[22:09:25.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:8:0) after 8m22s
[22:17:48.254] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:8:0)
[22:17:48.278] Build status: STARTED
[22:17:48.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:9:0) after 6m56s
[22:24:44.308] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:9:0)
[22:24:44.336] Build status: STARTED
[22:24:44.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:10:0) after 5m39s
[22:30:23.579] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:10:0)
[22:30:23.623] Build status: STARTED
[22:30:23.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:11:0) after 6m44s
[22:37:07.745] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:11:0)
[22:37:07.762] Build status: STARTED
[22:37:07.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:12:0) after 1m7s
[22:38:14.955] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:12:0)
[22:38:14.973] Build status: STARTED
[22:38:14.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:13:0) after 4m17s
[22:42:32.126] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:13:0)
[22:42:32.163] Build status: STARTED
[22:42:32.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:14:0) after 7m41s
[22:50:13.500] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:14:0)
[22:50:13.528] Build status: STARTED
[22:50:13.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:15:0) after 4m43s
[22:54:56.532] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:15:0)
[22:54:56.552] Build status: STARTED
[22:54:56.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:16:0) after 3m13s
[22:58:09.580] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:16:0)
[22:58:09.600] Build status: STARTED
[22:58:09.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:17:0) after 3m54s
[23:02:04.172] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:17:0)
[23:02:04.192] Build status: STARTED
[23:02:04.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:18:0) after 7m44s
[23:09:48.555] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:18:0)
[23:09:48.590] Build status: STARTED
[23:09:48.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:19:0) after 1m24s
[23:11:12.784] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:19:0)
[23:11:12.821] Build status: STARTED
[23:11:12.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:20:0) after 6m25s
[23:17:37.940] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:20:0)
[23:17:37.965] Build status: STARTED
[23:17:37.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:21:0) after 8m5s
[23:25:42.990] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:21:0)
[23:25:43.043] Build status: STARTED
[23:25:43.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:22:0) after 9m47s
[23:35:30.282] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:22:0)
[23:35:30.356] Build status: STARTED
[23:35:30.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:23:0) after 1m39s
[23:37:09.490] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:23:0)
[23:37:09.507] Build status: STARTED
[23:37:09.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:24:0) after 2m47s
[23:39:56.900] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:24:0)
[23:39:56.922] Build status: STARTED
[23:39:56.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:25:0) after 2m18s
[23:42:15.370] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:25:0)
[23:42:15.394] Build status: STARTED
[23:42:15.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:26:0) after 3m37s
[23:45:52.596] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:26:0)
[23:45:52.719] Build status: STARTED
[23:45:52.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:27:0) after 1m51s
[23:47:43.876] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:27:0)
[23:47:43.894] Build status: STARTED
[23:47:43.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:28:0) after 7m20s
[23:55:04.034] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:28:0)
[23:55:04.057] Build status: STARTED
[23:55:04.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:29:0) after 1m30s
[23:56:34.386] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:29:0)
[23:56:34.770] Build status: STARTED
[23:56:34.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:30:0) after 4m54s
[00:01:29.208] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:30:0)
[00:01:29.229] Build status: STARTED
[00:01:29.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:31:0) after 2m52s
[00:04:21.576] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:31:0)
[00:04:21.596] Build status: STARTED
[00:04:21.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:32:0) after 2m16s
[00:06:37.693] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:32:0)
[00:06:37.718] Build status: STARTED
[00:06:37.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:33:0) after 6m51s
[00:13:29.016] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:33:0)
[00:13:29.038] Build status: STARTED
[00:13:29.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:34:0) after 4m55s
[00:18:24.117] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:34:0)
[00:18:24.138] Build status: STARTED
[00:18:24.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:35:0) after 9m17s
[00:27:41.366] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:35:0)
[00:27:41.415] Build status: STARTED
[00:27:41.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:36:0) after 7m31s
[00:35:12.906] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:36:0)
[00:35:12.980] Build status: STARTED
[00:35:12.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:37:0) after 8m40s
[00:43:53.198] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:37:0)
[00:43:53.370] Build status: STARTED
[00:43:53.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:38:0) after 8m49s
[00:52:42.607] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:38:0)
[00:52:42.628] Build status: STARTED
[00:52:42.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:39:0) after 2m39s
[00:55:21.794] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:39:0)
[00:55:21.814] Build status: STARTED
[00:55:21.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:40:0) after 8m8s
[01:03:29.838] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:40:0)
[01:03:29.861] Build status: STARTED
[01:03:29.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:41:0) after 6m45s
[01:10:14.882] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:41:0)
[01:10:14.910] Build status: STARTED
[01:10:14.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:42:0) after 1m22s
[01:11:37.126] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:42:0)
[01:11:37.145] Build status: STARTED
[01:11:37.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:43:0) after 8m28s
[01:20:05.324] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:43:0)
[01:20:05.351] Build status: STARTED
[01:20:05.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:44:0) after 5m14s
[01:25:19.387] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:44:0)
[01:25:19.404] Build status: STARTED
[01:25:19.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:45:0) after 3m8s
[01:28:27.757] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:45:0)
[01:28:27.779] Build status: STARTED
[01:28:27.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:46:0) after 9m38s
[01:38:05.906] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:46:0)
[01:38:05.930] Build status: STARTED
[01:38:05.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:47:0) after 9m42s
[01:47:48.069] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:47:0)
[01:47:48.157] Build status: STARTED
[01:47:48.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:48:0) after 8m22s
[01:56:10.320] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:48:0)
[01:56:10.343] Build status: STARTED
[01:56:10.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:49:0) after 8m19s
[02:04:29.385] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:49:0)
[02:04:29.403] Build status: STARTED
[02:04:29.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:50:0) after 2m12s
[02:06:41.571] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:50:0)
[02:06:41.593] Build status: STARTED
[02:06:41.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:51:0) after 2m32s
[02:09:13.710] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:51:0)
[02:09:13.727] Build status: STARTED
[02:09:13.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:52:0) after 8m39s
[02:17:52.829] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:52:0)
[02:17:52.859] Build status: STARTED
[02:17:52.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:53:0) after 8m20s
[02:26:12.968] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:53:0)
[02:26:12.994] Build status: STARTED
[02:26:12.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:54:0) after 4m58s
[02:31:11.032] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:54:0)
[02:31:11.059] Build status: STARTED
[02:31:11.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:55:0) after 1m7s
[02:32:18.084] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:55:0)
[02:32:18.106] Build status: STARTED
[02:32:18.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:56:0) after 1m22s
[02:33:40.434] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:56:0)
[02:33:40.456] Build status: STARTED
[02:33:40.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:57:0) after 7m28s
[02:41:08.485] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:57:0)
[02:41:08.509] Build status: STARTED
[02:41:08.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:58:0) after 2m57s
[02:44:05.540] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:58:0)
[02:44:05.562] Build status: STARTED
[02:44:05.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:59:0) after 6m54s
[02:50:59.603] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:59:0)
[02:50:59.621] Build status: STARTED
[02:50:59.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:60:0) after 7m59s
[02:58:58.650] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:60:0)
[02:58:58.672] Build status: STARTED
[02:58:58.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:61:0) after 5m43s
[03:04:41.739] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:61:0)
[03:04:41.759] Build status: STARTED
[03:04:41.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:62:0) after 2m32s
[03:07:14.169] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:62:0)
[03:07:14.235] Build status: STARTED
[03:07:14.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:63:0) after 2m30s
[03:09:44.258] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:63:0)
[03:09:44.281] Build status: STARTED
[03:09:44.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:64:0) after 3m31s
[03:13:15.617] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:64:0)
[03:13:15.635] Build status: STARTED
[03:13:15.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:65:0) after 1m49s
[03:15:05.077] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:65:0)
[03:15:05.191] Build status: STARTED
[03:15:05.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:66:0) after 1m52s
[03:16:57.222] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:66:0)
[03:16:57.247] Build status: STARTED
[03:16:57.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:67:0) after 2m30s
[03:19:27.368] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:67:0)
[03:19:27.444] Build status: STARTED
[03:19:27.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:68:0) after 9m49s
[03:29:16.655] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:68:0)
[03:29:16.673] Build status: STARTED
[03:29:16.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:69:0) after 9m33s
[03:38:49.797] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:69:0)
[03:38:49.823] Build status: STARTED
[03:38:49.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:70:0) after 3m5s
[03:41:54.904] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:70:0)
[03:41:54.925] Build status: STARTED
[03:41:54.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:71:0) after 4m23s
[03:46:18.133] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:71:0)
[03:46:18.151] Build status: STARTED
[03:46:18.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:72:0) after 1m36s
[03:47:54.326] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:72:0)
[03:47:54.374] Build status: STARTED
[03:47:54.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:73:0) after 8m57s
[03:56:51.399] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:73:0)
[03:56:51.419] Build status: STARTED
[03:56:51.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:74:0) after 8m28s
[04:05:19.443] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:74:0)
[04:05:19.473] Build status: STARTED
[04:05:19.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:75:0) after 1m16s
[04:06:35.631] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:75:0)
[04:06:35.650] Build status: STARTED
[04:06:35.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:76:0) after 4m1s
[04:10:36.821] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:76:0)
[04:10:36.845] Build status: STARTED
[04:10:36.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:77:0) after 6m2s
[04:16:38.978] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:77:0)
[04:16:39.000] Build status: STARTED
[04:16:39.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:78:0) after 1m46s
[04:18:25.086] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:78:0)
[04:18:25.102] Build status: STARTED
[04:18:25.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:79:0) after 6m6s
[04:24:31.123] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:79:0)
[04:24:31.149] Build status: STARTED
[04:24:31.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:80:0) after 2m10s
[04:26:41.267] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:80:0)
[04:26:41.303] Build status: STARTED
[04:26:41.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:81:0) after 4m39s
[04:31:20.466] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:81:0)
[04:31:20.555] Build status: STARTED
[04:31:20.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:82:0) after 9m47s
[04:41:07.578] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:82:0)
[04:41:07.603] Build status: STARTED
[04:41:07.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:83:0) after 7m5s
[04:48:12.661] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:83:0)
[04:48:12.678] Build status: STARTED
[04:48:12.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:84:0) after 4m25s
[04:52:37.757] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:84:0)
[04:52:37.782] Build status: STARTED
[04:52:37.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:85:0) after 3m54s
[04:56:32.006] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:85:0)
[04:56:32.072] Build status: STARTED
[04:56:32.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:86:0) after 7m51s
[05:04:23.054] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:86:0)
[05:04:23.080] Build status: STARTED
[05:04:23.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:87:0) after 1m48s
[05:06:11.107] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:87:0)
[05:06:11.128] Build status: STARTED
[05:06:11.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:88:0) after 1m4s
[05:07:15.186] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:88:0)
[05:07:15.203] Build status: STARTED
[05:07:15.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:89:0) after 5m32s
[05:12:47.366] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:89:0)
[05:12:47.395] Build status: STARTED
[05:12:47.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:90:0) after 8m18s
[05:21:05.417] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:90:0)
[05:21:05.508] Build status: STARTED
[05:21:05.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:91:0) after 5m24s
[05:26:29.631] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:91:0)
[05:26:29.650] Build status: STARTED
[05:26:29.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:92:0) after 6m13s
[05:32:42.880] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:92:0)
[05:32:42.906] Build status: STARTED
[05:32:42.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:93:0) after 5m11s
[05:37:53.895] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:93:0)
[05:37:53.914] Build status: STARTED
[05:37:53.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:94:0) after 9m21s
[05:47:15.132] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:94:0)
[05:47:15.161] Build status: STARTED
[05:47:15.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:95:0) after 7m48s
[05:55:03.246] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:95:0)
[05:55:03.265] Build status: STARTED
[05:55:03.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:96:0) after 2m51s
[05:57:54.392] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:96:0)
[05:57:54.503] Build status: STARTED
[05:57:54.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:97:0) after 6m23s
[06:04:17.527] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:97:0)
[06:04:17.550] Build status: STARTED
[06:04:17.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:98:0) after 1m34s
[06:05:51.581] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:98:0)
[06:05:51.605] Build status: STARTED
[06:05:51.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:99:0) after 8m14s
[06:14:05.777] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:99:0)
[06:14:05.797] Build status: STARTED
[06:14:05.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:100:0) after 8m31s
[06:22:37.144] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:100:0)
[06:22:37.162] Build status: STARTED
[06:22:37.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:101:0) after 2m47s
[06:25:24.396] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:101:0)
[06:25:24.418] Build status: STARTED
[06:25:24.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:102:0) after 1m12s
[06:26:36.473] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:102:0)
[06:26:36.498] Build status: STARTED
[06:26:36.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:103:0) after 6m52s
[06:33:28.842] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:103:0)
[06:33:28.868] Build status: STARTED
[06:33:28.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:104:0) after 2m45s
[06:36:13.919] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:104:0)
[06:36:13.949] Build status: STARTED
[06:36:13.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:105:0) after 6m16s
[06:42:29.976] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:105:0)
[06:42:29.992] Build status: STARTED
[06:42:29.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:106:0) after 7m15s
[06:49:45.097] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:106:0)
[06:49:45.135] Build status: STARTED
[06:49:45.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:107:0) after 2m17s
[06:52:02.259] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:107:0)
[06:52:02.277] Build status: STARTED
[06:52:02.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:108:0) after 8m14s
[07:00:16.348] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:108:0)
[07:00:16.371] Build status: STARTED
[07:00:16.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:109:0) after 1m16s
[07:01:32.516] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:109:0)
[07:01:32.568] Build status: STARTED
[07:01:32.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:110:0) after 2m5s
[07:03:37.611] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:110:0)
[07:03:37.639] Build status: STARTED
[07:03:37.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:111:0) after 4m30s
[07:08:07.671] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:111:0)
[07:08:07.704] Build status: STARTED
[07:08:07.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:112:0) after 8m11s
[07:16:18.839] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:112:0)
[07:16:18.884] Build status: STARTED
[07:16:18.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:113:0) after 4m37s
[07:20:56.298] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:113:0)
[07:20:56.324] Build status: STARTED
[07:20:56.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:114:0) after 1m8s
[07:22:04.384] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:114:0)
[07:22:04.415] Build status: STARTED
[07:22:04.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:115:0) after 7m32s
[07:29:36.593] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:115:0)
[07:29:36.612] Build status: STARTED
[07:29:36.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:116:0) after 3m1s
[07:32:37.727] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:116:0)
[07:32:37.762] Build status: STARTED
[07:32:37.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:117:0) after 6m20s
[07:38:58.149] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:117:0)
[07:38:58.168] Build status: STARTED
[07:38:58.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:118:0) after 2m17s
[07:41:15.192] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:118:0)
[07:41:15.209] Build status: STARTED
[07:41:15.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:119:0) after 1m0s
[07:42:15.319] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:119:0)
[07:42:15.353] Build status: STARTED
[07:42:15.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:120:0) after 4m27s
[07:46:42.380] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:120:0)
[07:46:42.396] Build status: STARTED
[07:46:42.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:121:0) after 7m5s
[07:53:47.535] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:121:0)
[07:53:47.553] Build status: STARTED
[07:53:47.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:122:0) after 5m0s
[07:58:47.578] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:122:0)
[07:58:47.613] Build status: STARTED
[07:58:47.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:123:0) after 6m52s
[08:05:39.643] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:123:0)
[08:05:39.662] Build status: STARTED
[08:05:39.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:124:0) after 5m33s
[08:11:12.697] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:124:0)
[08:11:12.737] Build status: STARTED
[08:11:12.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8938090443929365744:125:0) after 4m50s
[08:13:17.883] Received PubSub notification, asking Buildbucket for the build status
[08:13:17.929] Build:
{
"id": "8772660381934522161",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 19736,
"createdBy": "project:chromium",
"createTime": "2023-08-15T21:48:49.402004852Z",
"startTime": "2023-08-15T21:50:50.640620Z",
"endTime": "2023-08-16T08:13:17.474943348Z",
"updateTime": "2023-08-16T08:13:17.474943348Z",
"status": "SUCCESS",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "013d01e92722fe60be8658e3642410a5abbd6db6",
"ref": "refs/heads/main"
}
}
}
[08:13:17.929] Invocation finished in 10h24m29.813383382s with status SUCCEEDED