[14:57:26.632] New invocation is queued and will start shortly
[14:57:27.819] Starting the invocation (attempt 1)
[14:57:27.857] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5ed2ea20bdb932e5e7edaa91519317e8a4514baa"
[14:57:27.857] Popped gitiles commit info from properties and tags
[14:57:27.857] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:57:27.857] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:57:27.857] Buildbucket request:
{
"requestId": "8961490341679180656",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5ed2ea20bdb932e5e7edaa91519317e8a4514baa",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8961490341679180656"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:57:28.654] Scheduled build:
{
"id": "8796060279661430193",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 17448,
"createdBy": "project:chromium",
"createTime": "2022-11-30T14:57:27.933292572Z",
"updateTime": "2022-11-30T14:57:27.933292572Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5ed2ea20bdb932e5e7edaa91519317e8a4514baa",
"ref": "refs/heads/main"
}
}
}
[14:57:28.654] Task URL: https://cr-buildbucket.appspot.com/build/8796060279661430193
[14:57:28.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:2:0) after 1m59s
[14:58:30.662] Received PubSub notification, asking Buildbucket for the build status
[14:58:30.707] Build status: STARTED
[14:59:27.766] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:2:0)
[14:59:27.791] Build status: STARTED
[14:59:27.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:4:0) after 9m7s
[15:08:35.074] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:4:0)
[15:08:35.112] Build status: STARTED
[15:08:35.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:5:0) after 7m11s
[15:15:46.233] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:5:0)
[15:15:46.398] Build status: STARTED
[15:15:46.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:6:0) after 2m42s
[15:18:28.549] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:6:0)
[15:18:28.585] Build status: STARTED
[15:18:28.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:7:0) after 1m25s
[15:19:53.603] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:7:0)
[15:19:53.628] Build status: STARTED
[15:19:53.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:8:0) after 1m57s
[15:21:50.647] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:8:0)
[15:21:50.671] Build status: STARTED
[15:21:50.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:9:0) after 9m44s
[15:31:34.699] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:9:0)
[15:31:34.731] Build status: STARTED
[15:31:34.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:10:0) after 4m16s
[15:35:50.902] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:10:0)
[15:35:50.925] Build status: STARTED
[15:35:50.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:11:0) after 8m39s
[15:44:29.954] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:11:0)
[15:44:30.119] Build status: STARTED
[15:44:30.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:12:0) after 2m48s
[15:47:18.149] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:12:0)
[15:47:18.172] Build status: STARTED
[15:47:18.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:13:0) after 6m34s
[15:53:52.255] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:13:0)
[15:53:52.281] Build status: STARTED
[15:53:52.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:14:0) after 4m13s
[15:58:05.419] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:14:0)
[15:58:05.451] Build status: STARTED
[15:58:05.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:15:0) after 6m16s
[16:04:21.486] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:15:0)
[16:04:21.520] Build status: STARTED
[16:04:21.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:16:0) after 1m14s
[16:05:35.568] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:16:0)
[16:05:35.604] Build status: STARTED
[16:05:35.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:17:0) after 4m28s
[16:10:04.003] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:17:0)
[16:10:04.035] Build status: STARTED
[16:10:04.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:18:0) after 8m21s
[16:18:25.195] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:18:0)
[16:18:25.243] Build status: STARTED
[16:18:25.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:19:0) after 8m40s
[16:27:05.374] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:19:0)
[16:27:05.466] Build status: STARTED
[16:27:05.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:20:0) after 5m39s
[16:32:44.588] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:20:0)
[16:32:44.692] Build status: STARTED
[16:32:44.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:21:0) after 5m40s
[16:38:24.914] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:21:0)
[16:38:24.954] Build status: STARTED
[16:38:24.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:22:0) after 6m13s
[16:44:38.130] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:22:0)
[16:44:38.160] Build status: STARTED
[16:44:38.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:23:0) after 2m8s
[16:46:46.306] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:23:0)
[16:46:46.327] Build status: STARTED
[16:46:46.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:24:0) after 6m28s
[16:53:14.357] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:24:0)
[16:53:14.415] Build status: STARTED
[16:53:14.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:25:0) after 4m1s
[16:57:15.571] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:25:0)
[16:57:15.602] Build status: STARTED
[16:57:15.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:26:0) after 6m7s
[17:03:22.858] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:26:0)
[17:03:22.884] Build status: STARTED
[17:03:22.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:27:0) after 9m24s
[17:12:47.012] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:27:0)
[17:12:47.039] Build status: STARTED
[17:12:47.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:28:0) after 6m24s
[17:19:11.269] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:28:0)
[17:19:11.293] Build status: STARTED
[17:19:11.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:29:0) after 3m14s
[17:22:25.415] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:29:0)
[17:22:25.437] Build status: STARTED
[17:22:25.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:30:0) after 6m2s
[17:28:27.456] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:30:0)
[17:28:27.484] Build status: STARTED
[17:28:27.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:31:0) after 1m58s
[17:30:25.528] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:31:0)
[17:30:25.547] Build status: STARTED
[17:30:25.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:32:0) after 5m10s
[17:35:35.768] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:32:0)
[17:35:35.792] Build status: STARTED
[17:35:35.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:33:0) after 7m20s
[17:42:55.936] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:33:0)
[17:42:55.959] Build status: STARTED
[17:42:55.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:34:0) after 9m36s
[17:52:32.055] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:34:0)
[17:52:32.077] Build status: STARTED
[17:52:32.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:35:0) after 1m53s
[17:54:25.482] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:35:0)
[17:54:25.507] Build status: STARTED
[17:54:25.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:36:0) after 3m48s
[17:58:13.727] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:36:0)
[17:58:13.780] Build status: STARTED
[17:58:13.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:37:0) after 5m23s
[18:03:36.800] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:37:0)
[18:03:36.822] Build status: STARTED
[18:03:36.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:38:0) after 7m29s
[18:11:05.858] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:38:0)
[18:11:05.894] Build status: STARTED
[18:11:05.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:39:0) after 7m33s
[18:18:38.922] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:39:0)
[18:18:38.993] Build status: STARTED
[18:18:38.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:40:0) after 9m29s
[18:28:08.013] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:40:0)
[18:28:08.039] Build status: STARTED
[18:28:08.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:41:0) after 5m19s
[18:33:27.375] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:41:0)
[18:33:27.401] Build status: STARTED
[18:33:27.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:42:0) after 5m6s
[18:38:33.849] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:42:0)
[18:38:33.940] Build status: STARTED
[18:38:33.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:43:0) after 2m57s
[18:41:31.717] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:43:0)
[18:41:32.436] Build status: STARTED
[18:41:32.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:44:0) after 5m40s
[18:47:12.523] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:44:0)
[18:47:12.548] Build status: STARTED
[18:47:12.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:45:0) after 6m10s
[18:53:22.728] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:45:0)
[18:53:22.748] Build status: STARTED
[18:53:22.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:46:0) after 6m9s
[18:59:31.866] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:46:0)
[18:59:31.887] Build status: STARTED
[18:59:31.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:47:0) after 4m43s
[19:04:15.457] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:47:0)
[19:04:15.479] Build status: STARTED
[19:04:15.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:48:0) after 9m23s
[19:13:38.508] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:48:0)
[19:13:38.530] Build status: STARTED
[19:13:38.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:49:0) after 3m43s
[19:17:21.563] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:49:0)
[19:17:21.738] Build status: STARTED
[19:17:21.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:50:0) after 4m44s
[19:22:05.764] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:50:0)
[19:22:05.795] Build status: STARTED
[19:22:05.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:51:0) after 1m13s
[19:23:18.840] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:51:0)
[19:23:18.860] Build status: STARTED
[19:23:18.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:52:0) after 1m32s
[19:24:50.920] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:52:0)
[19:24:50.940] Build status: STARTED
[19:24:50.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:53:0) after 4m2s
[19:28:52.957] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:53:0)
[19:28:52.978] Build status: STARTED
[19:28:52.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:54:0) after 7m23s
[19:36:16.663] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:54:0)
[19:36:16.694] Build status: STARTED
[19:36:16.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:55:0) after 5m39s
[19:41:55.873] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:55:0)
[19:41:55.893] Build status: STARTED
[19:41:55.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:56:0) after 1m11s
[19:43:06.924] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:56:0)
[19:43:06.946] Build status: STARTED
[19:43:06.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:57:0) after 5m13s
[19:48:19.978] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:57:0)
[19:48:20.003] Build status: STARTED
[19:48:20.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:58:0) after 2m21s
[19:50:41.023] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:58:0)
[19:50:41.047] Build status: STARTED
[19:50:41.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:59:0) after 5m14s
[19:55:55.522] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:59:0)
[19:55:55.607] Build status: STARTED
[19:55:55.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:60:0) after 5m52s
[20:01:47.673] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:60:0)
[20:01:47.696] Build status: STARTED
[20:01:47.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:61:0) after 3m51s
[20:05:38.710] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:61:0)
[20:05:38.734] Build status: STARTED
[20:05:38.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:62:0) after 2m15s
[20:07:53.794] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:62:0)
[20:07:53.861] Build status: STARTED
[20:07:53.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:63:0) after 9m34s
[20:17:28.002] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:63:0)
[20:17:28.024] Build status: STARTED
[20:17:28.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:64:0) after 8m37s
[20:26:05.042] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:64:0)
[20:26:05.065] Build status: STARTED
[20:26:05.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:65:0) after 5m19s
[20:31:24.059] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:65:0)
[20:31:24.170] Build status: STARTED
[20:31:24.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:66:0) after 1m41s
[20:33:05.254] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:66:0)
[20:33:05.276] Build status: STARTED
[20:33:05.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:67:0) after 6m11s
[20:39:16.481] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:67:0)
[20:39:16.505] Build status: STARTED
[20:39:16.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:68:0) after 4m32s
[20:43:48.727] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:68:0)
[20:43:48.747] Build status: STARTED
[20:43:48.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:69:0) after 1m54s
[20:45:42.771] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:69:0)
[20:45:42.844] Build status: STARTED
[20:45:42.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:70:0) after 6m36s
[20:52:19.686] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:70:0)
[20:52:19.724] Build status: STARTED
[20:52:19.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:71:0) after 9m2s
[21:01:21.712] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:71:0)
[21:01:21.751] Build status: STARTED
[21:01:21.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:72:0) after 6m23s
[21:07:45.027] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:72:0)
[21:07:45.052] Build status: STARTED
[21:07:45.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:73:0) after 8m37s
[21:16:22.074] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:73:0)
[21:16:22.142] Build status: STARTED
[21:16:22.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:74:0) after 8m29s
[21:24:51.569] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:74:0)
[21:24:51.592] Build status: STARTED
[21:24:51.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:75:0) after 5m24s
[21:30:15.971] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:75:0)
[21:30:15.996] Build status: STARTED
[21:30:15.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:76:0) after 1m13s
[21:31:29.117] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:76:0)
[21:31:29.155] Build status: STARTED
[21:31:29.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:77:0) after 9m42s
[21:41:11.181] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:77:0)
[21:41:11.219] Build status: STARTED
[21:41:11.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:78:0) after 9m30s
[21:50:41.252] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:78:0)
[21:50:41.277] Build status: STARTED
[21:50:41.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:79:0) after 9m29s
[22:00:10.346] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:79:0)
[22:00:10.406] Build status: STARTED
[22:00:10.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:80:0) after 2m32s
[22:02:42.859] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:80:0)
[22:02:42.879] Build status: STARTED
[22:02:42.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:81:0) after 6m3s
[22:08:45.927] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:81:0)
[22:08:45.950] Build status: STARTED
[22:08:45.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:82:0) after 7m20s
[22:16:06.234] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:82:0)
[22:16:06.258] Build status: STARTED
[22:16:06.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:83:0) after 9m58s
[22:26:05.033] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:83:0)
[22:26:05.059] Build status: STARTED
[22:26:05.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:84:0) after 5m56s
[22:32:01.077] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:84:0)
[22:32:01.106] Build status: STARTED
[22:32:01.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:85:0) after 5m18s
[22:37:19.126] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:85:0)
[22:37:19.161] Build status: STARTED
[22:37:19.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:86:0) after 1m36s
[22:38:55.278] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:86:0)
[22:38:55.299] Build status: STARTED
[22:38:55.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:87:0) after 2m55s
[22:41:50.386] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:87:0)
[22:41:50.409] Build status: STARTED
[22:41:50.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:88:0) after 2m0s
[22:43:50.631] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:88:0)
[22:43:50.655] Build status: STARTED
[22:43:50.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:89:0) after 9m10s
[22:53:00.676] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:89:0)
[22:53:00.696] Build status: STARTED
[22:53:00.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:90:0) after 1m16s
[22:54:16.810] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:90:0)
[22:54:16.832] Build status: STARTED
[22:54:16.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:91:0) after 5m51s
[23:00:08.030] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:91:0)
[23:00:08.052] Build status: STARTED
[23:00:08.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:92:0) after 3m29s
[23:03:37.159] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:92:0)
[23:03:37.184] Build status: STARTED
[23:03:37.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:93:0) after 6m17s
[23:09:54.415] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:93:0)
[23:09:54.441] Build status: STARTED
[23:09:54.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:94:0) after 7m25s
[23:17:19.440] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:94:0)
[23:17:19.521] Build status: STARTED
[23:17:19.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:95:0) after 8m1s
[23:25:20.593] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:95:0)
[23:25:20.616] Build status: STARTED
[23:25:20.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:96:0) after 1m25s
[23:26:45.644] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:96:0)
[23:26:45.671] Build status: STARTED
[23:26:45.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:97:0) after 6m22s
[23:33:07.692] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:97:0)
[23:33:07.722] Build status: STARTED
[23:33:07.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:98:0) after 3m28s
[23:36:35.865] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:98:0)
[23:36:35.893] Build status: STARTED
[23:36:35.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:99:0) after 1m37s
[23:38:12.925] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:99:0)
[23:38:12.948] Build status: STARTED
[23:38:12.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:100:0) after 8m51s
[23:47:03.981] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:100:0)
[23:47:04.083] Build status: STARTED
[23:47:04.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:101:0) after 2m41s
[23:49:45.147] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:101:0)
[23:49:45.171] Build status: STARTED
[23:49:45.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:102:0) after 2m36s
[23:52:21.393] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:102:0)
[23:52:21.416] Build status: STARTED
[23:52:21.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:103:0) after 6m53s
[23:59:14.556] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:103:0)
[23:59:14.623] Build status: STARTED
[23:59:14.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:104:0) after 2m40s
[00:01:54.681] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:104:0)
[00:01:54.708] Build status: STARTED
[00:01:54.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:105:0) after 6m39s
[00:08:33.772] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:105:0)
[00:08:33.798] Build status: STARTED
[00:08:33.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:106:0) after 1m57s
[00:10:30.864] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:106:0)
[00:10:30.903] Build status: STARTED
[00:10:30.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:107:0) after 5m53s
[00:16:23.935] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:107:0)
[00:16:23.966] Build status: STARTED
[00:16:23.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:108:0) after 1m34s
[00:17:57.989] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:108:0)
[00:17:58.071] Build status: STARTED
[00:17:58.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:109:0) after 1m9s
[00:19:07.492] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:109:0)
[00:19:07.519] Build status: STARTED
[00:19:07.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:110:0) after 7m15s
[00:26:22.680] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:110:0)
[00:26:22.714] Build status: STARTED
[00:26:22.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:111:0) after 5m18s
[00:31:40.757] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:111:0)
[00:31:40.781] Build status: STARTED
[00:31:40.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:112:0) after 8m9s
[00:39:50.020] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:112:0)
[00:39:50.075] Build status: STARTED
[00:39:50.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:113:0) after 4m15s
[00:44:05.203] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:113:0)
[00:44:05.242] Build status: STARTED
[00:44:05.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:114:0) after 3m22s
[00:47:27.286] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:114:0)
[00:47:27.313] Build status: STARTED
[00:47:27.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:115:0) after 9m7s
[00:56:34.474] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:115:0)
[00:56:34.497] Build status: STARTED
[00:56:34.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:116:0) after 9m50s
[01:06:24.790] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:116:0)
[01:06:24.812] Build status: STARTED
[01:06:24.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:117:0) after 6m29s
[01:12:54.059] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:117:0)
[01:12:54.085] Build status: STARTED
[01:12:54.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:118:0) after 2m58s
[01:15:52.240] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:118:0)
[01:15:52.266] Build status: STARTED
[01:15:52.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:119:0) after 4m35s
[01:20:27.403] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:119:0)
[01:20:27.426] Build status: STARTED
[01:20:27.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:120:0) after 1m42s
[01:22:09.527] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:120:0)
[01:22:09.550] Build status: STARTED
[01:22:09.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:121:0) after 8m48s
[01:30:57.599] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:121:0)
[01:30:57.631] Build status: STARTED
[01:30:57.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:122:0) after 8m23s
[01:39:20.688] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:122:0)
[01:39:20.712] Build status: STARTED
[01:39:20.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:123:0) after 2m4s
[01:41:24.732] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:123:0)
[01:41:24.754] Build status: STARTED
[01:41:24.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:124:0) after 9m59s
[01:51:24.681] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:124:0)
[01:51:24.715] Build status: STARTED
[01:51:24.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:125:0) after 8m26s
[01:59:50.985] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:125:0)
[01:59:51.009] Build status: STARTED
[01:59:51.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:126:0) after 8m57s
[02:08:48.129] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:126:0)
[02:08:48.321] Build status: STARTED
[02:08:48.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8961490341679180656:127:0) after 5m38s
[02:11:39.428] Received PubSub notification, asking Buildbucket for the build status
[02:11:39.451] Build:
{
"id": "8796060279661430193",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 17448,
"createdBy": "project:chromium",
"createTime": "2022-11-30T14:57:27.933292572Z",
"startTime": "2022-11-30T14:58:29.953927Z",
"endTime": "2022-12-01T02:11:39.023865915Z",
"updateTime": "2022-12-01T02:11:39.023865915Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5ed2ea20bdb932e5e7edaa91519317e8a4514baa",
"ref": "refs/heads/main"
}
}
}
[02:11:39.451] Invocation finished in 11h14m12.826143714s with status FAILED