[13:29:16.407] New invocation is queued and will start shortly
[13:29:17.487] Starting the invocation (attempt 1)
[13:29:17.517] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/7cb29b1cc84e6dbf699611a50ac9989b3a7d1c53"
[13:29:17.517] Popped gitiles commit info from properties and tags
[13:29:17.517] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:29:17.517] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:29:17.517] Buildbucket request:
{
"requestId": "8910761587721577824",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7cb29b1cc84e6dbf699611a50ac9989b3a7d1c53",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8910761587721577824"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:29:18.182] Scheduled build:
{
"id": "8745331525815372817",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 23542,
"createdBy": "project:chromium",
"createTime": "2024-06-12T13:29:17.579909004Z",
"updateTime": "2024-06-12T13:29:17.579909004Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7cb29b1cc84e6dbf699611a50ac9989b3a7d1c53",
"ref": "refs/heads/main"
}
}
}
[13:29:18.182] Task URL: https://cr-buildbucket.appspot.com/build/8745331525815372817
[13:29:18.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:2:0) after 7m27s
[13:29:18.274] Received PubSub notification, asking Buildbucket for the build status
[13:29:18.290] Build status: SCHEDULED
[13:31:06.234] Received PubSub notification, asking Buildbucket for the build status
[13:31:06.251] Build status: STARTED
[13:36:45.208] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:2:0)
[13:36:45.235] Build status: STARTED
[13:36:45.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:5:0) after 4m46s
[13:41:31.261] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:5:0)
[13:41:31.280] Build status: STARTED
[13:41:31.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:6:0) after 3m8s
[13:44:39.302] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:6:0)
[13:44:39.322] Build status: STARTED
[13:44:39.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:7:0) after 5m22s
[13:50:01.315] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:7:0)
[13:50:01.335] Build status: STARTED
[13:50:01.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:8:0) after 8m29s
[13:58:30.454] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:8:0)
[13:58:30.536] Build status: STARTED
[13:58:30.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:9:0) after 3m37s
[14:02:07.561] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:9:0)
[14:02:07.580] Build status: STARTED
[14:02:07.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:10:0) after 3m25s
[14:05:32.598] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:10:0)
[14:05:32.631] Build status: STARTED
[14:05:32.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:11:0) after 3m47s
[14:09:19.659] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:11:0)
[14:09:19.677] Build status: STARTED
[14:09:19.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:12:0) after 7m59s
[14:17:18.713] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:12:0)
[14:17:18.733] Build status: STARTED
[14:17:18.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:13:0) after 3m52s
[14:21:10.798] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:13:0)
[14:21:10.817] Build status: STARTED
[14:21:10.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:14:0) after 7m56s
[14:29:06.862] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:14:0)
[14:29:06.890] Build status: STARTED
[14:29:06.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:15:0) after 4m15s
[14:33:21.919] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:15:0)
[14:33:21.939] Build status: STARTED
[14:33:21.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:16:0) after 8m36s
[14:41:57.952] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:16:0)
[14:41:58.001] Build status: STARTED
[14:41:58.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:17:0) after 6m39s
[14:48:37.032] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:17:0)
[14:48:37.050] Build status: STARTED
[14:48:37.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:18:0) after 8m58s
[14:57:35.070] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:18:0)
[14:57:35.109] Build status: STARTED
[14:57:35.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:19:0) after 4m43s
[15:02:18.128] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:19:0)
[15:02:18.149] Build status: STARTED
[15:02:18.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:20:0) after 8m42s
[15:11:00.194] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:20:0)
[15:11:00.214] Build status: STARTED
[15:11:00.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:21:0) after 5m31s
[15:16:31.272] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:21:0)
[15:16:31.301] Build status: STARTED
[15:16:31.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:22:0) after 5m7s
[15:21:38.500] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:22:0)
[15:21:38.525] Build status: STARTED
[15:21:38.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:23:0) after 9m50s
[15:31:28.599] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:23:0)
[15:31:28.631] Build status: STARTED
[15:31:28.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:24:0) after 7m57s
[15:39:25.674] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:24:0)
[15:39:25.952] Build status: STARTED
[15:39:25.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:25:0) after 2m22s
[15:41:47.978] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:25:0)
[15:41:47.994] Build status: STARTED
[15:41:47.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:26:0) after 4m32s
[15:46:20.014] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:26:0)
[15:46:20.065] Build status: STARTED
[15:46:20.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:27:0) after 7m26s
[15:53:46.083] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:27:0)
[15:53:46.102] Build status: STARTED
[15:53:46.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:28:0) after 8m23s
[16:02:09.154] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:28:0)
[16:02:09.171] Build status: STARTED
[16:02:09.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:29:0) after 8m20s
[16:10:29.231] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:29:0)
[16:10:29.257] Build status: STARTED
[16:10:29.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:30:0) after 9m43s
[16:20:12.317] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:30:0)
[16:20:12.338] Build status: STARTED
[16:20:12.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:31:0) after 1m13s
[16:21:25.428] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:31:0)
[16:21:25.468] Build status: STARTED
[16:21:25.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:32:0) after 4m3s
[16:25:28.494] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:32:0)
[16:25:28.535] Build status: STARTED
[16:25:28.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:33:0) after 8m20s
[16:33:48.563] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:33:0)
[16:33:48.615] Build status: STARTED
[16:33:48.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:34:0) after 4m58s
[16:38:46.635] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:34:0)
[16:38:46.654] Build status: STARTED
[16:38:46.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:35:0) after 5m41s
[16:44:27.656] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:35:0)
[16:44:27.738] Build status: STARTED
[16:44:27.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:36:0) after 2m20s
[16:46:47.755] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:36:0)
[16:46:47.774] Build status: STARTED
[16:46:47.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:37:0) after 8m3s
[16:54:50.845] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:37:0)
[16:54:50.867] Build status: STARTED
[16:54:50.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:38:0) after 8m53s
[17:03:43.957] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:38:0)
[17:03:43.987] Build status: STARTED
[17:03:43.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:39:0) after 6m26s
[17:10:10.007] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:39:0)
[17:10:10.025] Build status: STARTED
[17:10:10.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:40:0) after 1m53s
[17:12:03.093] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:40:0)
[17:12:03.113] Build status: STARTED
[17:12:03.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:41:0) after 4m46s
[17:16:49.190] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:41:0)
[17:16:49.212] Build status: STARTED
[17:16:49.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:42:0) after 9m37s
[17:26:26.288] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:42:0)
[17:26:26.308] Build status: STARTED
[17:26:26.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:43:0) after 2m47s
[17:29:13.360] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:43:0)
[17:29:13.378] Build status: STARTED
[17:29:13.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:44:0) after 4m54s
[17:34:07.460] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:44:0)
[17:34:07.480] Build status: STARTED
[17:34:07.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:45:0) after 3m42s
[17:37:49.540] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:45:0)
[17:37:49.557] Build status: STARTED
[17:37:49.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:46:0) after 8m9s
[17:45:58.590] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:46:0)
[17:45:58.608] Build status: STARTED
[17:45:58.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:47:0) after 9m26s
[17:55:24.698] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:47:0)
[17:55:24.720] Build status: STARTED
[17:55:24.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:48:0) after 3m12s
[17:58:36.742] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:48:0)
[17:58:36.768] Build status: STARTED
[17:58:36.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:49:0) after 7m48s
[18:06:24.812] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:49:0)
[18:06:24.888] Build status: STARTED
[18:06:24.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:50:0) after 1m7s
[18:07:31.914] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:50:0)
[18:07:31.938] Build status: STARTED
[18:07:31.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:51:0) after 2m0s
[18:09:31.966] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:51:0)
[18:09:31.985] Build status: STARTED
[18:09:31.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:52:0) after 8m26s
[18:17:58.104] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:52:0)
[18:17:58.123] Build status: STARTED
[18:17:58.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:53:0) after 5m54s
[18:23:52.143] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:53:0)
[18:23:52.158] Build status: STARTED
[18:23:52.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:54:0) after 1m53s
[18:25:45.188] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:54:0)
[18:25:45.218] Build status: STARTED
[18:25:45.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:55:0) after 6m13s
[18:31:58.284] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:55:0)
[18:31:58.445] Build status: STARTED
[18:31:58.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8910761587721577824:56:0) after 3m55s
[18:35:19.368] Received PubSub notification, asking Buildbucket for the build status
[18:35:19.388] Build:
{
"id": "8745331525815372817",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 23542,
"createdBy": "project:chromium",
"createTime": "2024-06-12T13:29:17.579909004Z",
"startTime": "2024-06-12T13:31:05.963365800Z",
"endTime": "2024-06-12T18:35:13.217274754Z",
"updateTime": "2024-06-12T18:35:13.217274754Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7cb29b1cc84e6dbf699611a50ac9989b3a7d1c53",
"ref": "refs/heads/main"
}
}
}
[18:35:19.388] Invocation finished in 5h6m3.010538319s with status FAILED