[15:48:27.274] New invocation is queued and will start shortly
[15:48:28.788] Starting the invocation (attempt 1)
[15:48:28.836] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/91613e67932b82d800d0bb483c41a679a096af1b"
[15:48:28.836] Popped gitiles commit info from properties and tags
[15:48:28.836] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:48:28.836] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:48:28.837] Buildbucket request:
{
"requestId": "8963299071697153280",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "91613e67932b82d800d0bb483c41a679a096af1b",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8963299071697153280"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:48:29.444] Scheduled build:
{
"id": "8797869009297894113",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 17354,
"createdBy": "project:chromium",
"createTime": "2022-11-10T15:48:28.934292204Z",
"updateTime": "2022-11-10T15:48:28.934292204Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "91613e67932b82d800d0bb483c41a679a096af1b",
"ref": "refs/heads/main"
}
}
}
[15:48:29.444] Task URL: https://cr-buildbucket.appspot.com/build/8797869009297894113
[15:48:29.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:2:0) after 6m36s
[15:49:16.910] Received PubSub notification, asking Buildbucket for the build status
[15:49:16.932] Build status: STARTED
[15:55:05.752] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:2:0)
[15:55:05.795] Build status: STARTED
[15:55:05.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:4:0) after 2m17s
[15:57:22.990] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:4:0)
[15:57:23.013] Build status: STARTED
[15:57:23.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:5:0) after 4m24s
[16:01:47.983] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:5:0)
[16:01:48.009] Build status: STARTED
[16:01:48.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:6:0) after 8m23s
[16:10:11.466] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:6:0)
[16:10:11.508] Build status: STARTED
[16:10:11.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:7:0) after 1m9s
[16:11:20.821] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:7:0)
[16:11:20.863] Build status: STARTED
[16:11:20.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:8:0) after 6m25s
[16:17:45.910] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:8:0)
[16:17:45.950] Build status: STARTED
[16:17:45.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:9:0) after 1m1s
[16:18:47.081] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:9:0)
[16:18:47.123] Build status: STARTED
[16:18:47.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:10:0) after 4m27s
[16:23:14.298] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:10:0)
[16:23:14.363] Build status: STARTED
[16:23:14.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:11:0) after 9m45s
[16:33:00.099] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:11:0)
[16:33:00.449] Build status: STARTED
[16:33:00.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:12:0) after 5m42s
[16:38:42.452] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:12:0)
[16:38:42.479] Build status: STARTED
[16:38:42.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:13:0) after 3m40s
[16:42:22.528] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:13:0)
[16:42:22.554] Build status: STARTED
[16:42:22.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:14:0) after 8m21s
[16:50:43.579] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:14:0)
[16:50:43.603] Build status: STARTED
[16:50:43.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:15:0) after 5m58s
[16:56:41.730] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:15:0)
[16:56:41.782] Build status: STARTED
[16:56:41.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:16:0) after 5m41s
[17:02:22.818] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:16:0)
[17:02:22.842] Build status: STARTED
[17:02:22.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:17:0) after 5m47s
[17:08:10.458] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:17:0)
[17:08:10.485] Build status: STARTED
[17:08:10.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:18:0) after 3m12s
[17:11:22.634] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:18:0)
[17:11:22.658] Build status: STARTED
[17:11:22.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:19:0) after 4m32s
[17:15:54.775] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:19:0)
[17:15:54.797] Build status: STARTED
[17:15:54.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:20:0) after 2m17s
[17:18:11.932] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:20:0)
[17:18:11.962] Build status: STARTED
[17:18:11.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:21:0) after 7m58s
[17:26:10.118] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:21:0)
[17:26:10.142] Build status: STARTED
[17:26:10.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:22:0) after 2m8s
[17:28:18.176] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:22:0)
[17:28:18.204] Build status: STARTED
[17:28:18.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:23:0) after 6m48s
[17:35:06.297] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:23:0)
[17:35:06.336] Build status: STARTED
[17:35:06.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:24:0) after 8m18s
[17:43:24.384] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:24:0)
[17:43:24.407] Build status: STARTED
[17:43:24.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:25:0) after 4m34s
[17:47:58.451] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:25:0)
[17:47:58.477] Build status: STARTED
[17:47:58.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:26:0) after 5m20s
[17:53:18.623] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:26:0)
[17:53:18.669] Build status: STARTED
[17:53:18.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:27:0) after 8m28s
[18:01:46.756] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:27:0)
[18:01:46.783] Build status: STARTED
[18:01:46.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:28:0) after 3m56s
[18:05:42.918] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:28:0)
[18:05:42.943] Build status: STARTED
[18:05:42.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:29:0) after 1m51s
[18:07:33.979] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:29:0)
[18:07:34.000] Build status: STARTED
[18:07:34.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:30:0) after 5m54s
[18:13:28.145] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:30:0)
[18:13:28.174] Build status: STARTED
[18:13:28.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:31:0) after 4m24s
[18:17:52.201] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:31:0)
[18:17:52.253] Build status: STARTED
[18:17:52.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:32:0) after 5m7s
[18:22:59.335] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:32:0)
[18:22:59.364] Build status: STARTED
[18:22:59.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:33:0) after 6m9s
[18:29:08.424] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:33:0)
[18:29:08.460] Build status: STARTED
[18:29:08.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:34:0) after 5m36s
[18:34:44.659] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:34:0)
[18:34:44.683] Build status: STARTED
[18:34:44.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:35:0) after 6m40s
[18:41:24.996] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:35:0)
[18:41:25.039] Build status: STARTED
[18:41:25.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:36:0) after 2m15s
[18:43:40.064] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:36:0)
[18:43:40.101] Build status: STARTED
[18:43:40.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:37:0) after 9m46s
[18:53:26.274] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:37:0)
[18:53:26.327] Build status: STARTED
[18:53:26.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:38:0) after 7m32s
[19:00:58.694] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:38:0)
[19:00:58.852] Build status: STARTED
[19:00:58.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:39:0) after 7m16s
[19:08:14.903] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:39:0)
[19:08:14.927] Build status: STARTED
[19:08:14.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:40:0) after 3m18s
[19:11:33.263] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:40:0)
[19:11:33.292] Build status: STARTED
[19:11:33.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:41:0) after 5m16s
[19:16:49.341] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:41:0)
[19:16:49.381] Build status: STARTED
[19:16:49.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:42:0) after 6m59s
[19:23:48.678] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:42:0)
[19:23:48.713] Build status: STARTED
[19:23:48.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:43:0) after 7m7s
[19:30:55.756] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:43:0)
[19:30:55.788] Build status: STARTED
[19:30:55.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:44:0) after 8m15s
[19:39:10.844] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:44:0)
[19:39:10.874] Build status: STARTED
[19:39:10.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:45:0) after 9m4s
[19:48:14.935] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:45:0)
[19:48:14.995] Build status: STARTED
[19:48:14.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:46:0) after 9m58s
[19:58:13.124] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:46:0)
[19:58:13.149] Build status: STARTED
[19:58:13.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:47:0) after 3m17s
[20:01:30.278] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:47:0)
[20:01:30.312] Build status: STARTED
[20:01:30.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:48:0) after 2m44s
[20:04:15.034] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:48:0)
[20:04:15.098] Build status: STARTED
[20:04:15.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:49:0) after 3m41s
[20:07:56.293] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:49:0)
[20:07:56.327] Build status: STARTED
[20:07:56.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:50:0) after 1m36s
[20:09:32.992] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:50:0)
[20:09:33.018] Build status: STARTED
[20:09:33.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:51:0) after 6m31s
[20:16:04.112] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:51:0)
[20:16:04.136] Build status: STARTED
[20:16:04.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:52:0) after 4m44s
[20:20:48.172] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:52:0)
[20:20:48.198] Build status: STARTED
[20:20:48.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:53:0) after 6m17s
[20:27:05.578] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:53:0)
[20:27:05.607] Build status: STARTED
[20:27:05.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:54:0) after 4m47s
[20:31:52.664] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:54:0)
[20:31:52.688] Build status: STARTED
[20:31:52.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:55:0) after 3m43s
[20:35:35.741] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:55:0)
[20:35:35.769] Build status: STARTED
[20:35:35.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:56:0) after 8m5s
[20:43:40.886] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:56:0)
[20:43:40.913] Build status: STARTED
[20:43:40.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:57:0) after 6m47s
[20:50:27.944] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:57:0)
[20:50:27.969] Build status: STARTED
[20:50:27.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:58:0) after 7m15s
[20:57:42.999] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:58:0)
[20:57:43.035] Build status: STARTED
[20:57:43.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:59:0) after 3m21s
[21:01:04.063] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:59:0)
[21:01:04.088] Build status: STARTED
[21:01:04.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:60:0) after 9m32s
[21:10:36.114] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:60:0)
[21:10:36.138] Build status: STARTED
[21:10:36.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:61:0) after 5m57s
[21:16:33.267] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:61:0)
[21:16:33.290] Build status: STARTED
[21:16:33.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:62:0) after 7m33s
[21:24:06.348] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:62:0)
[21:24:06.378] Build status: STARTED
[21:24:06.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:63:0) after 4m12s
[21:28:18.712] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:63:0)
[21:28:18.744] Build status: STARTED
[21:28:18.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:64:0) after 9m34s
[21:37:52.924] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:64:0)
[21:37:52.949] Build status: STARTED
[21:37:52.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:65:0) after 4m41s
[21:42:34.464] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:65:0)
[21:42:34.489] Build status: STARTED
[21:42:34.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:66:0) after 9m38s
[21:52:12.575] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:66:0)
[21:52:12.608] Build status: STARTED
[21:52:12.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:67:0) after 8m35s
[22:00:47.630] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:67:0)
[22:00:47.654] Build status: STARTED
[22:00:47.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:68:0) after 3m49s
[22:04:36.730] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:68:0)
[22:04:36.760] Build status: STARTED
[22:04:36.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:69:0) after 2m27s
[22:07:04.454] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:69:0)
[22:07:04.479] Build status: STARTED
[22:07:04.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:70:0) after 2m53s
[22:09:57.469] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:70:0)
[22:09:57.490] Build status: STARTED
[22:09:57.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:71:0) after 5m31s
[22:15:28.624] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:71:0)
[22:15:28.649] Build status: STARTED
[22:15:28.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:72:0) after 9m38s
[22:25:06.793] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:72:0)
[22:25:06.817] Build status: STARTED
[22:25:06.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:73:0) after 2m8s
[22:27:14.862] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:73:0)
[22:27:14.889] Build status: STARTED
[22:27:14.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:74:0) after 5m18s
[22:32:32.920] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:74:0)
[22:32:33.051] Build status: STARTED
[22:32:33.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:75:0) after 3m50s
[22:36:23.139] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:75:0)
[22:36:23.159] Build status: STARTED
[22:36:23.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:76:0) after 4m7s
[22:40:30.292] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:76:0)
[22:40:30.352] Build status: STARTED
[22:40:30.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:77:0) after 5m38s
[22:46:08.377] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:77:0)
[22:46:08.402] Build status: STARTED
[22:46:08.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:78:0) after 8m2s
[22:54:10.448] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:78:0)
[22:54:10.474] Build status: STARTED
[22:54:10.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:79:0) after 5m53s
[23:00:03.537] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:79:0)
[23:00:03.572] Build status: STARTED
[23:00:03.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:80:0) after 4m30s
[23:04:34.366] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:80:0)
[23:04:34.389] Build status: STARTED
[23:04:34.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:81:0) after 3m18s
[23:07:53.159] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:81:0)
[23:07:53.184] Build status: STARTED
[23:07:53.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:82:0) after 1m54s
[23:09:47.293] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:82:0)
[23:09:47.316] Build status: STARTED
[23:09:47.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:83:0) after 8m55s
[23:18:43.349] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:83:0)
[23:18:43.402] Build status: STARTED
[23:18:43.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:84:0) after 8m11s
[23:26:54.563] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:84:0)
[23:26:54.586] Build status: STARTED
[23:26:54.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:85:0) after 2m4s
[23:28:58.796] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:85:0)
[23:28:58.825] Build status: STARTED
[23:28:58.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:86:0) after 6m6s
[23:35:04.971] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:86:0)
[23:35:04.990] Build status: STARTED
[23:35:04.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:87:0) after 8m18s
[23:43:23.285] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:87:0)
[23:43:23.308] Build status: STARTED
[23:43:23.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:88:0) after 9m7s
[23:52:30.376] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:88:0)
[23:52:30.400] Build status: STARTED
[23:52:30.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:89:0) after 9m34s
[00:02:04.784] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:89:0)
[00:02:04.813] Build status: STARTED
[00:02:04.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:90:0) after 4m10s
[00:06:15.359] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:90:0)
[00:06:15.392] Build status: STARTED
[00:06:15.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:91:0) after 2m49s
[00:09:04.441] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:91:0)
[00:09:04.468] Build status: STARTED
[00:09:04.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:92:0) after 8m7s
[00:17:11.503] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:92:0)
[00:17:11.536] Build status: STARTED
[00:17:11.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:93:0) after 8m28s
[00:25:39.588] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:93:0)
[00:25:39.611] Build status: STARTED
[00:25:39.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:94:0) after 8m32s
[00:34:11.719] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:94:0)
[00:34:11.744] Build status: STARTED
[00:34:11.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:95:0) after 9m25s
[00:43:37.216] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:95:0)
[00:43:37.239] Build status: STARTED
[00:43:37.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:96:0) after 3m23s
[00:47:00.261] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:96:0)
[00:47:00.289] Build status: STARTED
[00:47:00.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:97:0) after 5m43s
[00:52:43.493] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:97:0)
[00:52:43.518] Build status: STARTED
[00:52:43.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:98:0) after 7m20s
[01:00:03.609] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:98:0)
[01:00:03.636] Build status: STARTED
[01:00:03.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:99:0) after 1m38s
[01:01:41.672] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:99:0)
[01:01:41.749] Build status: STARTED
[01:01:41.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:100:0) after 9m53s
[01:11:34.756] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:100:0)
[01:11:34.780] Build status: STARTED
[01:11:34.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:101:0) after 8m40s
[01:20:14.899] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:101:0)
[01:20:14.957] Build status: STARTED
[01:20:14.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:102:0) after 9m48s
[01:30:03.047] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:102:0)
[01:30:03.070] Build status: STARTED
[01:30:03.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:103:0) after 8m42s
[01:38:45.292] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:103:0)
[01:38:45.364] Build status: STARTED
[01:38:45.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:104:0) after 1m43s
[01:40:28.608] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:104:0)
[01:40:28.638] Build status: STARTED
[01:40:28.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:105:0) after 3m25s
[01:43:53.951] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:105:0)
[01:43:53.976] Build status: STARTED
[01:43:53.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:106:0) after 1m25s
[01:45:19.011] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:106:0)
[01:45:19.034] Build status: STARTED
[01:45:19.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:107:0) after 3m36s
[01:48:55.064] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:107:0)
[01:48:55.105] Build status: STARTED
[01:48:55.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:108:0) after 4m36s
[01:53:31.253] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:108:0)
[01:53:31.275] Build status: STARTED
[01:53:31.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:109:0) after 6m33s
[02:00:04.532] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:109:0)
[02:00:04.739] Build status: STARTED
[02:00:04.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:110:0) after 7m52s
[02:07:56.765] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:110:0)
[02:07:56.807] Build status: STARTED
[02:07:56.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:111:0) after 2m10s
[02:10:06.831] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:111:0)
[02:10:06.859] Build status: STARTED
[02:10:06.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:112:0) after 8m29s
[02:18:35.942] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:112:0)
[02:18:35.982] Build status: STARTED
[02:18:35.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:113:0) after 1m6s
[02:19:42.065] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:113:0)
[02:19:42.091] Build status: STARTED
[02:19:42.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:114:0) after 2m58s
[02:22:40.150] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:114:0)
[02:22:40.178] Build status: STARTED
[02:22:40.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:115:0) after 2m38s
[02:25:18.208] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:115:0)
[02:25:18.232] Build status: STARTED
[02:25:18.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:116:0) after 2m58s
[02:28:16.273] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:116:0)
[02:28:16.361] Build status: STARTED
[02:28:16.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:117:0) after 1m23s
[02:29:39.388] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:117:0)
[02:29:39.413] Build status: STARTED
[02:29:39.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:118:0) after 2m14s
[02:31:53.500] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:118:0)
[02:31:53.526] Build status: STARTED
[02:31:53.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:119:0) after 6m53s
[02:38:46.624] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:119:0)
[02:38:46.649] Build status: STARTED
[02:38:46.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:120:0) after 9m33s
[02:48:19.684] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:120:0)
[02:48:19.707] Build status: STARTED
[02:48:19.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:121:0) after 9m38s
[02:57:57.754] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:121:0)
[02:57:57.781] Build status: STARTED
[02:57:57.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:122:0) after 8m9s
[03:06:06.761] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:122:0)
[03:06:06.788] Build status: STARTED
[03:06:06.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:123:0) after 4m43s
[03:10:49.816] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:123:0)
[03:10:49.848] Build status: STARTED
[03:10:49.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:124:0) after 4m31s
[03:15:20.951] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:124:0)
[03:15:20.998] Build status: STARTED
[03:15:20.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8963299071697153280:125:0) after 5m46s
[03:15:32.804] Received PubSub notification, asking Buildbucket for the build status
[03:15:32.828] Build:
{
"id": "8797869009297894113",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 17354,
"createdBy": "project:chromium",
"createTime": "2022-11-10T15:48:28.934292204Z",
"startTime": "2022-11-10T15:49:12.651891Z",
"endTime": "2022-11-11T03:15:32.546419945Z",
"updateTime": "2022-11-11T03:15:32.546419945Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "91613e67932b82d800d0bb483c41a679a096af1b",
"ref": "refs/heads/main"
}
}
}
[03:15:32.828] Invocation finished in 11h27m5.566079136s with status FAILED