[22:30:20.357] New invocation is queued and will start shortly
[22:30:21.514] Starting the invocation (attempt 1)
[22:30:21.545] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/1bb24d47946695201fabc91f3e10671a6ca90097"
[22:30:21.545] Popped gitiles commit info from properties and tags
[22:30:21.545] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:30:21.545] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:30:21.546] Buildbucket request:
{
"requestId": "8931746042992888000",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1bb24d47946695201fabc91f3e10671a6ca90097",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8931746042992888000"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:30:22.552] Scheduled build:
{
"id": "8766315980979774321",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 20467,
"createdBy": "project:chromium",
"createTime": "2023-10-24T22:30:21.645727530Z",
"updateTime": "2023-10-24T22:30:21.645727530Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1bb24d47946695201fabc91f3e10671a6ca90097",
"ref": "refs/heads/main"
}
}
}
[22:30:22.552] Task URL: https://cr-buildbucket.appspot.com/build/8766315980979774321
[22:30:22.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:2:0) after 6m15s
[22:30:23.396] Received PubSub notification, asking Buildbucket for the build status
[22:30:23.416] Build status: SCHEDULED
[22:33:22.283] Received PubSub notification, asking Buildbucket for the build status
[22:33:22.378] Build status: STARTED
[22:36:38.032] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:2:0)
[22:36:38.061] Build status: STARTED
[22:36:38.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:5:0) after 8m31s
[22:45:09.117] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:5:0)
[22:45:09.137] Build status: STARTED
[22:45:09.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:6:0) after 1m54s
[22:47:03.333] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:6:0)
[22:47:03.350] Build status: STARTED
[22:47:03.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:7:0) after 2m38s
[22:49:41.564] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:7:0)
[22:49:41.588] Build status: STARTED
[22:49:41.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:8:0) after 5m14s
[22:54:56.119] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:8:0)
[22:54:56.146] Build status: STARTED
[22:54:56.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:9:0) after 5m18s
[23:00:14.463] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:9:0)
[23:00:14.481] Build status: STARTED
[23:00:14.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:10:0) after 2m33s
[23:02:48.044] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:10:0)
[23:02:48.067] Build status: STARTED
[23:02:48.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:11:0) after 2m45s
[23:05:33.089] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:11:0)
[23:05:33.117] Build status: STARTED
[23:05:33.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:12:0) after 8m43s
[23:14:16.206] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:12:0)
[23:14:16.229] Build status: STARTED
[23:14:16.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:13:0) after 7m21s
[23:21:37.460] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:13:0)
[23:21:37.483] Build status: STARTED
[23:21:37.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:14:0) after 1m45s
[23:23:22.503] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:14:0)
[23:23:22.523] Build status: STARTED
[23:23:22.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:15:0) after 8m44s
[23:32:06.644] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:15:0)
[23:32:06.665] Build status: STARTED
[23:32:06.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:16:0) after 6m15s
[23:38:21.811] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:16:0)
[23:38:21.830] Build status: STARTED
[23:38:21.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:17:0) after 5m6s
[23:43:27.961] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:17:0)
[23:43:27.979] Build status: STARTED
[23:43:27.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:18:0) after 8m29s
[23:51:57.108] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:18:0)
[23:51:57.136] Build status: STARTED
[23:51:57.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:19:0) after 6m46s
[23:58:43.343] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:19:0)
[23:58:43.368] Build status: STARTED
[23:58:43.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:20:0) after 7m53s
[00:06:36.509] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:20:0)
[00:06:36.532] Build status: STARTED
[00:06:36.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:21:0) after 5m14s
[00:11:50.530] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:21:0)
[00:11:50.550] Build status: STARTED
[00:11:50.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:22:0) after 7m36s
[00:19:26.549] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:22:0)
[00:19:26.571] Build status: STARTED
[00:19:26.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:23:0) after 2m29s
[00:21:55.643] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:23:0)
[00:21:55.660] Build status: STARTED
[00:21:55.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:24:0) after 1m27s
[00:23:22.684] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:24:0)
[00:23:22.722] Build status: STARTED
[00:23:22.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:25:0) after 8m52s
[00:32:14.832] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:25:0)
[00:32:14.852] Build status: STARTED
[00:32:14.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:26:0) after 1m12s
[00:33:26.935] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:26:0)
[00:33:26.958] Build status: STARTED
[00:33:26.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:27:0) after 9m51s
[00:43:17.953] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:27:0)
[00:43:17.995] Build status: STARTED
[00:43:17.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:28:0) after 7m10s
[00:50:28.269] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:28:0)
[00:50:28.307] Build status: STARTED
[00:50:28.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:29:0) after 5m55s
[00:56:23.787] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:29:0)
[00:56:23.808] Build status: STARTED
[00:56:23.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:30:0) after 2m20s
[00:58:43.869] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:30:0)
[00:58:43.938] Build status: STARTED
[00:58:43.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:31:0) after 5m27s
[01:04:10.958] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:31:0)
[01:04:10.984] Build status: STARTED
[01:04:10.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:32:0) after 3m25s
[01:07:36.073] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:32:0)
[01:07:36.113] Build status: STARTED
[01:07:36.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:33:0) after 1m3s
[01:08:39.246] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:33:0)
[01:08:39.269] Build status: STARTED
[01:08:39.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:34:0) after 2m44s
[01:11:23.390] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:34:0)
[01:11:23.413] Build status: STARTED
[01:11:23.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:35:0) after 8m58s
[01:20:21.448] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:35:0)
[01:20:21.471] Build status: STARTED
[01:20:21.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:36:0) after 5m22s
[01:25:43.803] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:36:0)
[01:25:43.831] Build status: STARTED
[01:25:43.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:37:0) after 3m20s
[01:29:04.214] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:37:0)
[01:29:04.301] Build status: STARTED
[01:29:04.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:38:0) after 9m3s
[01:38:07.533] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:38:0)
[01:38:07.553] Build status: STARTED
[01:38:07.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:39:0) after 4m54s
[01:43:01.679] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:39:0)
[01:43:01.708] Build status: STARTED
[01:43:01.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:40:0) after 8m15s
[01:51:16.882] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:40:0)
[01:51:16.953] Build status: STARTED
[01:51:16.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:41:0) after 7m27s
[01:58:43.956] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:41:0)
[01:58:43.972] Build status: STARTED
[01:58:43.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:42:0) after 1m2s
[01:59:46.327] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:42:0)
[01:59:46.348] Build status: STARTED
[01:59:46.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:43:0) after 2m24s
[02:02:10.357] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:43:0)
[02:02:10.374] Build status: STARTED
[02:02:10.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:44:0) after 9m13s
[02:11:23.541] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:44:0)
[02:11:23.565] Build status: STARTED
[02:11:23.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:45:0) after 9m5s
[02:20:28.728] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:45:0)
[02:20:28.742] Build status: STARTED
[02:20:28.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:46:0) after 7m29s
[02:27:57.827] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:46:0)
[02:27:57.849] Build status: STARTED
[02:27:57.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:47:0) after 6m8s
[02:34:05.871] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:47:0)
[02:34:06.033] Build status: STARTED
[02:34:06.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:48:0) after 7m53s
[02:41:59.278] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:48:0)
[02:41:59.308] Build status: STARTED
[02:41:59.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:49:0) after 8m45s
[02:50:44.444] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:49:0)
[02:50:44.622] Build status: STARTED
[02:50:44.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8931746042992888000:50:0) after 8m6s
[02:54:09.131] Received PubSub notification, asking Buildbucket for the build status
[02:54:09.187] Build:
{
"id": "8766315980979774321",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 20467,
"createdBy": "project:chromium",
"createTime": "2023-10-24T22:30:21.645727530Z",
"startTime": "2023-10-24T22:33:21.499515Z",
"endTime": "2023-10-25T02:54:08.703515583Z",
"updateTime": "2023-10-25T02:54:08.703515583Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1bb24d47946695201fabc91f3e10671a6ca90097",
"ref": "refs/heads/main"
}
}
}
[02:54:09.187] Invocation finished in 4h23m48.84463452s with status FAILED