[09:21:23.217] New invocation is queued and will start shortly
[09:21:24.441] Starting the invocation (attempt 1)
[09:21:24.468] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/aac02e14d302cd849be98276df71b98018d7f7cb"
[09:21:24.468] Popped gitiles commit info from properties and tags
[09:21:24.468] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:21:24.468] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:21:24.468] Buildbucket request:
{
"requestId": "8952270593979342000",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "aac02e14d302cd849be98276df71b98018d7f7cb",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8952270593979342000"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:21:24.988] Scheduled build:
{
"id": "8786840531915475137",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 18586,
"createdBy": "project:chromium",
"createTime": "2023-03-12T09:21:24.562000237Z",
"updateTime": "2023-03-12T09:21:24.562000237Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "aac02e14d302cd849be98276df71b98018d7f7cb",
"ref": "refs/heads/main"
}
}
}
[09:21:24.988] Task URL: https://cr-buildbucket.appspot.com/build/8786840531915475137
[09:21:24.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:2:0) after 6m21s
[09:27:46.455] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:2:0)
[09:27:46.484] Build status: SCHEDULED
[09:27:46.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:3:0) after 3m26s
[09:29:43.837] Received PubSub notification, asking Buildbucket for the build status
[09:29:43.859] Build status: STARTED
[09:31:12.597] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:3:0)
[09:31:12.620] Build status: STARTED
[09:31:12.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:5:0) after 9m13s
[09:40:25.645] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:5:0)
[09:40:25.676] Build status: STARTED
[09:40:25.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:6:0) after 5m58s
[09:46:23.695] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:6:0)
[09:46:23.716] Build status: STARTED
[09:46:23.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:7:0) after 8m23s
[09:54:46.734] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:7:0)
[09:54:46.765] Build status: STARTED
[09:54:46.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:8:0) after 7m28s
[10:02:14.788] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:8:0)
[10:02:14.819] Build status: STARTED
[10:02:14.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:9:0) after 1m22s
[10:03:36.836] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:9:0)
[10:03:36.875] Build status: STARTED
[10:03:36.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:10:0) after 5m40s
[10:09:16.920] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:10:0)
[10:09:16.946] Build status: STARTED
[10:09:16.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:11:0) after 4m10s
[10:13:26.965] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:11:0)
[10:13:27.028] Build status: STARTED
[10:13:27.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:12:0) after 8m56s
[10:22:23.148] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:12:0)
[10:22:23.173] Build status: STARTED
[10:22:23.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:13:0) after 2m6s
[10:24:29.155] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:13:0)
[10:24:29.197] Build status: STARTED
[10:24:29.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:14:0) after 1m54s
[10:26:23.270] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:14:0)
[10:26:23.297] Build status: STARTED
[10:26:23.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:15:0) after 5m11s
[10:31:34.316] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:15:0)
[10:31:34.482] Build status: STARTED
[10:31:34.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:16:0) after 7m30s
[10:39:04.541] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:16:0)
[10:39:04.562] Build status: STARTED
[10:39:04.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:17:0) after 6m58s
[10:46:02.600] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:17:0)
[10:46:02.623] Build status: STARTED
[10:46:02.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:18:0) after 3m10s
[10:49:12.640] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:18:0)
[10:49:12.703] Build status: STARTED
[10:49:12.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:19:0) after 6m32s
[10:55:44.721] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:19:0)
[10:55:44.741] Build status: STARTED
[10:55:44.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:20:0) after 3m40s
[10:59:25.199] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:20:0)
[10:59:25.220] Build status: STARTED
[10:59:25.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:21:0) after 5m59s
[11:05:24.667] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:21:0)
[11:05:24.693] Build status: STARTED
[11:05:24.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:22:0) after 6m25s
[11:11:49.915] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:22:0)
[11:11:49.940] Build status: STARTED
[11:11:49.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:23:0) after 4m30s
[11:16:20.574] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:23:0)
[11:16:20.606] Build status: STARTED
[11:16:20.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:24:0) after 9m46s
[11:26:06.677] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:24:0)
[11:26:06.694] Build status: STARTED
[11:26:06.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:25:0) after 7m12s
[11:33:18.939] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:25:0)
[11:33:18.963] Build status: STARTED
[11:33:18.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:26:0) after 1m42s
[11:35:01.010] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:26:0)
[11:35:01.032] Build status: STARTED
[11:35:01.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:27:0) after 9m19s
[11:44:20.427] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:27:0)
[11:44:20.450] Build status: STARTED
[11:44:20.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:28:0) after 2m23s
[11:46:43.491] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:28:0)
[11:46:43.517] Build status: STARTED
[11:46:43.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:29:0) after 3m39s
[11:50:22.612] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:29:0)
[11:50:22.634] Build status: STARTED
[11:50:22.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:30:0) after 4m47s
[11:55:09.861] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:30:0)
[11:55:09.889] Build status: STARTED
[11:55:09.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:31:0) after 3m13s
[11:58:23.460] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:31:0)
[11:58:23.479] Build status: STARTED
[11:58:23.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:32:0) after 6m55s
[12:05:18.823] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:32:0)
[12:05:18.843] Build status: STARTED
[12:05:18.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:33:0) after 3m5s
[12:08:23.966] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:33:0)
[12:08:23.988] Build status: STARTED
[12:08:23.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:34:0) after 6m45s
[12:15:09.286] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:34:0)
[12:15:09.355] Build status: STARTED
[12:15:09.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:35:0) after 7m51s
[12:23:00.376] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:35:0)
[12:23:00.398] Build status: STARTED
[12:23:00.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:36:0) after 5m4s
[12:28:04.521] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:36:0)
[12:28:04.543] Build status: STARTED
[12:28:04.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:37:0) after 3m11s
[12:31:15.731] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:37:0)
[12:31:15.752] Build status: STARTED
[12:31:15.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:38:0) after 6m54s
[12:38:09.772] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:38:0)
[12:38:09.794] Build status: STARTED
[12:38:09.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:39:0) after 6m21s
[12:44:30.825] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:39:0)
[12:44:30.844] Build status: STARTED
[12:44:30.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:40:0) after 8m59s
[12:53:29.861] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:40:0)
[12:53:29.890] Build status: STARTED
[12:53:29.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:41:0) after 7m45s
[13:01:15.310] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:41:0)
[13:01:15.334] Build status: STARTED
[13:01:15.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:42:0) after 1m2s
[13:02:17.354] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:42:0)
[13:02:17.376] Build status: STARTED
[13:02:17.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:43:0) after 3m52s
[13:06:10.286] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:43:0)
[13:06:10.309] Build status: STARTED
[13:06:10.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:44:0) after 1m24s
[13:07:34.638] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:44:0)
[13:07:34.667] Build status: STARTED
[13:07:34.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:45:0) after 2m40s
[13:10:14.684] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:45:0)
[13:10:14.725] Build status: STARTED
[13:10:14.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:46:0) after 2m14s
[13:12:28.757] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:46:0)
[13:12:28.780] Build status: STARTED
[13:12:28.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:47:0) after 7m2s
[13:19:30.901] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:47:0)
[13:19:30.926] Build status: STARTED
[13:19:30.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:48:0) after 8m53s
[13:28:24.851] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:48:0)
[13:28:24.873] Build status: STARTED
[13:28:24.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:49:0) after 6m51s
[13:35:15.885] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:49:0)
[13:35:15.913] Build status: STARTED
[13:35:15.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:50:0) after 8m7s
[13:43:23.003] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:50:0)
[13:43:23.026] Build status: STARTED
[13:43:23.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:51:0) after 7m13s
[13:50:36.060] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:51:0)
[13:50:36.081] Build status: STARTED
[13:50:36.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:52:0) after 7m48s
[13:58:24.099] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:52:0)
[13:58:24.135] Build status: STARTED
[13:58:24.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:53:0) after 4m42s
[14:03:06.296] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:53:0)
[14:03:06.321] Build status: STARTED
[14:03:06.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:54:0) after 7m15s
[14:10:21.341] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:54:0)
[14:10:21.366] Build status: STARTED
[14:10:21.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:55:0) after 4m5s
[14:14:26.476] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:55:0)
[14:14:26.499] Build status: STARTED
[14:14:26.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:56:0) after 6m51s
[14:21:17.556] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:56:0)
[14:21:17.680] Build status: STARTED
[14:21:17.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:57:0) after 2m58s
[14:24:15.913] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:57:0)
[14:24:15.937] Build status: STARTED
[14:24:15.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:58:0) after 3m4s
[14:27:19.956] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:58:0)
[14:27:19.978] Build status: STARTED
[14:27:19.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:59:0) after 1m57s
[14:29:16.996] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:59:0)
[14:29:17.018] Build status: STARTED
[14:29:17.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:60:0) after 7m4s
[14:36:21.047] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:60:0)
[14:36:21.069] Build status: STARTED
[14:36:21.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:61:0) after 9m46s
[14:46:07.094] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:61:0)
[14:46:07.115] Build status: STARTED
[14:46:07.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:62:0) after 8m16s
[14:54:23.135] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:62:0)
[14:54:23.169] Build status: STARTED
[14:54:23.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:63:0) after 7m36s
[15:01:59.157] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:63:0)
[15:01:59.180] Build status: STARTED
[15:01:59.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:64:0) after 3m46s
[15:05:45.204] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:64:0)
[15:05:45.227] Build status: STARTED
[15:05:45.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:65:0) after 4m21s
[15:10:06.271] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:65:0)
[15:10:06.340] Build status: STARTED
[15:10:06.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:66:0) after 3m30s
[15:13:36.370] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:66:0)
[15:13:36.462] Build status: STARTED
[15:13:36.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:67:0) after 7m8s
[15:20:44.488] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:67:0)
[15:20:44.592] Build status: STARTED
[15:20:44.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:68:0) after 1m35s
[15:22:19.622] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:68:0)
[15:22:19.648] Build status: STARTED
[15:22:19.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:69:0) after 2m25s
[15:24:44.781] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:69:0)
[15:24:44.801] Build status: STARTED
[15:24:44.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:70:0) after 1m32s
[15:26:16.833] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:70:0)
[15:26:16.853] Build status: STARTED
[15:26:16.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:71:0) after 8m5s
[15:34:21.876] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:71:0)
[15:34:21.902] Build status: STARTED
[15:34:21.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:72:0) after 7m35s
[15:41:56.917] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:72:0)
[15:41:56.940] Build status: STARTED
[15:41:56.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:73:0) after 9m47s
[15:51:43.961] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:73:0)
[15:51:44.003] Build status: STARTED
[15:51:44.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:74:0) after 5m23s
[15:57:07.211] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:74:0)
[15:57:07.235] Build status: STARTED
[15:57:07.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:75:0) after 6m32s
[16:03:39.376] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:75:0)
[16:03:39.400] Build status: STARTED
[16:03:39.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:76:0) after 9m40s
[16:13:19.432] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:76:0)
[16:13:19.456] Build status: STARTED
[16:13:19.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:77:0) after 4m11s
[16:17:30.436] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:77:0)
[16:17:30.457] Build status: STARTED
[16:17:30.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:78:0) after 4m16s
[16:21:46.564] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:78:0)
[16:21:46.587] Build status: STARTED
[16:21:46.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:79:0) after 7m52s
[16:29:38.603] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:79:0)
[16:29:38.661] Build status: STARTED
[16:29:38.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:80:0) after 2m31s
[16:32:09.693] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:80:0)
[16:32:09.716] Build status: STARTED
[16:32:09.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:81:0) after 7m25s
[16:39:34.952] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:81:0)
[16:39:34.976] Build status: STARTED
[16:39:34.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:82:0) after 7m51s
[16:47:26.000] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:82:0)
[16:47:26.041] Build status: STARTED
[16:47:26.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:83:0) after 9m40s
[16:57:06.484] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:83:0)
[16:57:06.508] Build status: STARTED
[16:57:06.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:84:0) after 5m6s
[17:02:12.659] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:84:0)
[17:02:12.683] Build status: STARTED
[17:02:12.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:85:0) after 9m43s
[17:11:55.807] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:85:0)
[17:11:55.830] Build status: STARTED
[17:11:55.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:86:0) after 5m10s
[17:17:05.852] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:86:0)
[17:17:05.880] Build status: STARTED
[17:17:05.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:87:0) after 6m7s
[17:23:12.917] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:87:0)
[17:23:13.074] Build status: STARTED
[17:23:13.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:88:0) after 4m9s
[17:27:22.099] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:88:0)
[17:27:22.159] Build status: STARTED
[17:27:22.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:89:0) after 2m30s
[17:29:52.394] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:89:0)
[17:29:52.445] Build status: STARTED
[17:29:52.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:90:0) after 8m40s
[17:38:32.466] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:90:0)
[17:38:32.492] Build status: STARTED
[17:38:32.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:91:0) after 4m34s
[17:43:06.521] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:91:0)
[17:43:06.543] Build status: STARTED
[17:43:06.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:92:0) after 4m15s
[17:47:21.563] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:92:0)
[17:47:21.586] Build status: STARTED
[17:47:21.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:93:0) after 4m5s
[17:51:26.610] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:93:0)
[17:51:26.631] Build status: STARTED
[17:51:26.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:94:0) after 9m12s
[18:00:38.781] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:94:0)
[18:00:38.807] Build status: STARTED
[18:00:38.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:95:0) after 1m41s
[18:02:19.882] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:95:0)
[18:02:19.916] Build status: STARTED
[18:02:19.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:96:0) after 3m26s
[18:05:45.931] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:96:0)
[18:05:45.962] Build status: STARTED
[18:05:45.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:97:0) after 4m2s
[18:09:47.980] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:97:0)
[18:09:48.003] Build status: STARTED
[18:09:48.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:98:0) after 8m13s
[18:18:01.148] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:98:0)
[18:18:01.175] Build status: STARTED
[18:18:01.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:99:0) after 5m29s
[18:23:30.209] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:99:0)
[18:23:30.251] Build status: STARTED
[18:23:30.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:100:0) after 9m55s
[18:33:25.318] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:100:0)
[18:33:25.344] Build status: STARTED
[18:33:25.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:101:0) after 5m17s
[18:38:42.675] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:101:0)
[18:38:42.705] Build status: STARTED
[18:38:42.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:102:0) after 1m30s
[18:40:12.726] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:102:0)
[18:40:12.754] Build status: STARTED
[18:40:12.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:103:0) after 5m43s
[18:45:55.773] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:103:0)
[18:45:55.810] Build status: STARTED
[18:45:55.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:104:0) after 4m22s
[18:50:18.226] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:104:0)
[18:50:18.278] Build status: STARTED
[18:50:18.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:105:0) after 2m22s
[18:52:40.299] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:105:0)
[18:52:40.326] Build status: STARTED
[18:52:40.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:106:0) after 9m20s
[19:02:00.453] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:106:0)
[19:02:00.482] Build status: STARTED
[19:02:00.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:107:0) after 5m23s
[19:07:23.509] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:107:0)
[19:07:23.530] Build status: STARTED
[19:07:23.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:108:0) after 7m2s
[19:14:25.549] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:108:0)
[19:14:25.578] Build status: STARTED
[19:14:25.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:109:0) after 2m48s
[19:17:13.611] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:109:0)
[19:17:13.632] Build status: STARTED
[19:17:13.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8952270593979342000:110:0) after 9m7s
[19:17:50.946] Received PubSub notification, asking Buildbucket for the build status
[19:17:50.967] Build:
{
"id": "8786840531915475137",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 18586,
"createdBy": "project:chromium",
"createTime": "2023-03-12T09:21:24.562000237Z",
"startTime": "2023-03-12T09:29:43.239423Z",
"endTime": "2023-03-12T19:17:50.577876274Z",
"updateTime": "2023-03-12T19:17:50.577876274Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "aac02e14d302cd849be98276df71b98018d7f7cb",
"ref": "refs/heads/main"
}
}
}
[19:17:50.967] Invocation finished in 9h56m27.756906926s with status FAILED