[15:55:27.860] New invocation is queued and will start shortly
[15:55:29.063] Starting the invocation (attempt 1)
[15:55:29.102] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/514b17f8f8e83c0551b762cf91000847f14b4242"
[15:55:29.102] Popped gitiles commit info from properties and tags
[15:55:29.102] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:55:29.103] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:55:29.103] Buildbucket request:
{
"requestId": "8916369402084230832",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "514b17f8f8e83c0551b762cf91000847f14b4242",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8916369402084230832"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:55:30.126] Scheduled build:
{
"id": "8750939339813423153",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 22358,
"createdBy": "project:chromium",
"createTime": "2024-04-11T15:55:29.398224860Z",
"updateTime": "2024-04-11T15:55:29.398224860Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "514b17f8f8e83c0551b762cf91000847f14b4242",
"ref": "refs/heads/main"
}
}
}
[15:55:30.126] Task URL: https://cr-buildbucket.appspot.com/build/8750939339813423153
[15:55:30.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:2:0) after 4m18s
[15:55:31.043] Received PubSub notification, asking Buildbucket for the build status
[15:55:31.090] Build status: SCHEDULED
[15:57:06.608] Received PubSub notification, asking Buildbucket for the build status
[15:57:06.632] Build status: STARTED
[15:59:48.295] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:2:0)
[15:59:48.316] Build status: STARTED
[15:59:48.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:5:0) after 6m24s
[16:06:12.413] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:5:0)
[16:06:12.461] Build status: STARTED
[16:06:12.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:6:0) after 1m24s
[16:07:36.519] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:6:0)
[16:07:36.577] Build status: STARTED
[16:07:36.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:7:0) after 5m55s
[16:13:31.651] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:7:0)
[16:13:31.698] Build status: STARTED
[16:13:31.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:8:0) after 3m57s
[16:17:28.761] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:8:0)
[16:17:28.783] Build status: STARTED
[16:17:28.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:9:0) after 1m21s
[16:18:49.794] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:9:0)
[16:18:49.832] Build status: STARTED
[16:18:49.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:10:0) after 4m56s
[16:23:45.853] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:10:0)
[16:23:45.991] Build status: STARTED
[16:23:45.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:11:0) after 3m1s
[16:26:46.984] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:11:0)
[16:26:47.067] Build status: STARTED
[16:26:47.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:12:0) after 7m27s
[16:34:14.264] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:12:0)
[16:34:14.292] Build status: STARTED
[16:34:14.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:13:0) after 3m41s
[16:37:55.377] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:13:0)
[16:37:55.437] Build status: STARTED
[16:37:55.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:14:0) after 5m7s
[16:43:02.522] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:14:0)
[16:43:02.542] Build status: STARTED
[16:43:02.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:15:0) after 1m57s
[16:44:59.564] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:15:0)
[16:44:59.581] Build status: STARTED
[16:44:59.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:16:0) after 2m28s
[16:47:27.605] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:16:0)
[16:47:27.642] Build status: STARTED
[16:47:27.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:17:0) after 5m39s
[16:53:06.632] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:17:0)
[16:53:06.710] Build status: STARTED
[16:53:06.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:18:0) after 5m33s
[16:58:39.790] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:18:0)
[16:58:39.837] Build status: STARTED
[16:58:39.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:19:0) after 9m17s
[17:07:56.937] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:19:0)
[17:07:56.977] Build status: STARTED
[17:07:56.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:20:0) after 8m0s
[17:15:57.089] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:20:0)
[17:15:57.113] Build status: STARTED
[17:15:57.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:21:0) after 1m15s
[17:17:12.148] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:21:0)
[17:17:12.180] Build status: STARTED
[17:17:12.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:22:0) after 5m11s
[17:22:23.256] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:22:0)
[17:22:23.285] Build status: STARTED
[17:22:23.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:23:0) after 3m3s
[17:25:26.369] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:23:0)
[17:25:26.393] Build status: STARTED
[17:25:26.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:24:0) after 4m50s
[17:30:16.426] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:24:0)
[17:30:16.445] Build status: STARTED
[17:30:16.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:25:0) after 6m28s
[17:36:44.508] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:25:0)
[17:36:44.530] Build status: STARTED
[17:36:44.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:26:0) after 4m27s
[17:41:11.579] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:26:0)
[17:41:11.603] Build status: STARTED
[17:41:11.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:27:0) after 5m15s
[17:46:26.676] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:27:0)
[17:46:26.700] Build status: STARTED
[17:46:26.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:28:0) after 8m47s
[17:55:13.737] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:28:0)
[17:55:13.757] Build status: STARTED
[17:55:13.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:29:0) after 9m6s
[18:04:19.775] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:29:0)
[18:04:19.803] Build status: STARTED
[18:04:19.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:30:0) after 1m43s
[18:06:02.919] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:30:0)
[18:06:02.972] Build status: STARTED
[18:06:02.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:31:0) after 2m4s
[18:08:07.153] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:31:0)
[18:08:07.177] Build status: STARTED
[18:08:07.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:32:0) after 5m10s
[18:13:17.240] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:32:0)
[18:13:17.278] Build status: STARTED
[18:13:17.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:33:0) after 8m17s
[18:21:34.460] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:33:0)
[18:21:34.486] Build status: STARTED
[18:21:34.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:34:0) after 3m5s
[18:24:39.509] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:34:0)
[18:24:39.582] Build status: STARTED
[18:24:39.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:35:0) after 6m48s
[18:31:27.607] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:35:0)
[18:31:27.669] Build status: STARTED
[18:31:27.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:36:0) after 3m5s
[18:34:32.695] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:36:0)
[18:34:32.727] Build status: STARTED
[18:34:32.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:37:0) after 3m40s
[18:38:12.801] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:37:0)
[18:38:12.817] Build status: STARTED
[18:38:12.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:38:0) after 7m23s
[18:45:35.857] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:38:0)
[18:45:35.902] Build status: STARTED
[18:45:35.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:39:0) after 7m35s
[18:53:10.957] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:39:0)
[18:53:11.018] Build status: STARTED
[18:53:11.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:40:0) after 1m28s
[18:54:39.041] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:40:0)
[18:54:39.062] Build status: STARTED
[18:54:39.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:41:0) after 5m2s
[18:59:41.088] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:41:0)
[18:59:41.116] Build status: STARTED
[18:59:41.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:42:0) after 5m1s
[19:04:42.153] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:42:0)
[19:04:42.197] Build status: STARTED
[19:04:42.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:43:0) after 9m43s
[19:14:25.326] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:43:0)
[19:14:25.356] Build status: STARTED
[19:14:25.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:44:0) after 8m53s
[19:23:18.425] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:44:0)
[19:23:18.447] Build status: STARTED
[19:23:18.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:45:0) after 7m58s
[19:31:16.480] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:45:0)
[19:31:16.504] Build status: STARTED
[19:31:16.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:46:0) after 7m14s
[19:38:30.580] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:46:0)
[19:38:30.690] Build status: STARTED
[19:38:30.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:47:0) after 7m51s
[19:46:21.741] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:47:0)
[19:46:21.768] Build status: STARTED
[19:46:21.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:48:0) after 8m46s
[19:55:07.852] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:48:0)
[19:55:07.875] Build status: STARTED
[19:55:07.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:49:0) after 5m30s
[20:00:37.899] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:49:0)
[20:00:37.935] Build status: STARTED
[20:00:37.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:50:0) after 4m15s
[20:04:53.038] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:50:0)
[20:04:53.157] Build status: STARTED
[20:04:53.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:51:0) after 1m3s
[20:05:56.258] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:51:0)
[20:05:56.298] Build status: STARTED
[20:05:56.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:52:0) after 7m2s
[20:12:58.647] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:52:0)
[20:12:58.718] Build status: STARTED
[20:12:58.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:53:0) after 4m3s
[20:17:02.089] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:53:0)
[20:17:02.117] Build status: STARTED
[20:17:02.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:54:0) after 4m35s
[20:21:37.132] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:54:0)
[20:21:37.156] Build status: STARTED
[20:21:37.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:55:0) after 6m25s
[20:28:02.219] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:55:0)
[20:28:02.241] Build status: STARTED
[20:28:02.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:56:0) after 4m30s
[20:32:32.339] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:56:0)
[20:32:32.408] Build status: STARTED
[20:32:32.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:57:0) after 2m28s
[20:35:00.545] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:57:0)
[20:35:00.579] Build status: STARTED
[20:35:00.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8916369402084230832:58:0) after 6m31s
[20:36:20.356] Received PubSub notification, asking Buildbucket for the build status
[20:36:20.394] Build:
{
"id": "8750939339813423153",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 22358,
"createdBy": "project:chromium",
"createTime": "2024-04-11T15:55:29.398224860Z",
"startTime": "2024-04-11T15:57:06.232187453Z",
"endTime": "2024-04-11T20:36:19.980530182Z",
"updateTime": "2024-04-11T20:36:19.980530182Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "514b17f8f8e83c0551b762cf91000847f14b4242",
"ref": "refs/heads/main"
}
}
}
[20:36:20.394] Invocation finished in 4h40m52.544876977s with status FAILED