[14:42:55.315] New invocation is queued and will start shortly
[14:42:56.446] Starting the invocation (attempt 1)
[14:42:56.475] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3714914231ebfdf2d3fd5e63229ae2e2bc96b9d0"
[14:42:56.475] Popped gitiles commit info from properties and tags
[14:42:56.475] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:42:56.475] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:42:56.475] Buildbucket request:
{
"requestId": "8923259335499509328",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3714914231ebfdf2d3fd5e63229ae2e2bc96b9d0",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8923259335499509328"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:42:57.059] Scheduled build:
{
"id": "8757829273550090033",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 21405,
"createdBy": "project:chromium",
"createTime": "2024-01-26T14:42:56.552266354Z",
"updateTime": "2024-01-26T14:42:56.552266354Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3714914231ebfdf2d3fd5e63229ae2e2bc96b9d0",
"ref": "refs/heads/main"
}
}
}
[14:42:57.059] Task URL: https://cr-buildbucket.appspot.com/build/8757829273550090033
[14:42:57.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:2:0) after 8m2s
[14:42:57.375] Received PubSub notification, asking Buildbucket for the build status
[14:42:57.393] Build status: SCHEDULED
[14:44:45.757] Received PubSub notification, asking Buildbucket for the build status
[14:44:45.786] Build status: STARTED
[14:50:59.089] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:2:0)
[14:50:59.119] Build status: STARTED
[14:50:59.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:5:0) after 2m49s
[14:53:48.152] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:5:0)
[14:53:48.168] Build status: STARTED
[14:53:48.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:6:0) after 8m8s
[15:01:56.233] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:6:0)
[15:01:56.255] Build status: STARTED
[15:01:56.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:7:0) after 9m56s
[15:11:52.282] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:7:0)
[15:11:52.413] Build status: STARTED
[15:11:52.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:8:0) after 3m13s
[15:15:05.434] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:8:0)
[15:15:05.472] Build status: STARTED
[15:15:05.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:9:0) after 1m38s
[15:16:43.490] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:9:0)
[15:16:43.522] Build status: STARTED
[15:16:43.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:10:0) after 3m56s
[15:20:39.792] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:10:0)
[15:20:39.815] Build status: STARTED
[15:20:39.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:11:0) after 1m16s
[15:21:56.414] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:11:0)
[15:21:56.442] Build status: STARTED
[15:21:56.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:12:0) after 9m27s
[15:31:23.545] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:12:0)
[15:31:23.577] Build status: STARTED
[15:31:23.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:13:0) after 5m47s
[15:37:10.608] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:13:0)
[15:37:10.636] Build status: STARTED
[15:37:10.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:14:0) after 6m38s
[15:43:48.670] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:14:0)
[15:43:48.746] Build status: STARTED
[15:43:48.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:15:0) after 6m26s
[15:50:14.779] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:15:0)
[15:50:14.812] Build status: STARTED
[15:50:14.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:16:0) after 6m32s
[15:56:47.143] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:16:0)
[15:56:47.168] Build status: STARTED
[15:56:47.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:17:0) after 1m48s
[15:58:35.184] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:17:0)
[15:58:35.203] Build status: STARTED
[15:58:35.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:18:0) after 6m20s
[16:04:55.233] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:18:0)
[16:04:55.343] Build status: STARTED
[16:04:55.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:19:0) after 8m47s
[16:13:42.512] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:19:0)
[16:13:42.627] Build status: STARTED
[16:13:42.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:20:0) after 8m36s
[16:22:18.795] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:20:0)
[16:22:18.923] Build status: STARTED
[16:22:18.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:21:0) after 6m27s
[16:28:45.947] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:21:0)
[16:28:45.969] Build status: STARTED
[16:28:45.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:22:0) after 9m28s
[16:38:14.017] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:22:0)
[16:38:14.053] Build status: STARTED
[16:38:14.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:23:0) after 5m44s
[16:43:58.080] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:23:0)
[16:43:58.148] Build status: STARTED
[16:43:58.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:24:0) after 2m18s
[16:46:16.549] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:24:0)
[16:46:16.570] Build status: STARTED
[16:46:16.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:25:0) after 2m11s
[16:48:27.590] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:25:0)
[16:48:27.615] Build status: STARTED
[16:48:27.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:26:0) after 3m43s
[16:52:10.730] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:26:0)
[16:52:10.754] Build status: STARTED
[16:52:10.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:27:0) after 5m21s
[16:57:31.772] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:27:0)
[16:57:31.794] Build status: STARTED
[16:57:31.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:28:0) after 6m28s
[17:03:59.868] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:28:0)
[17:03:59.900] Build status: STARTED
[17:03:59.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:29:0) after 3m32s
[17:07:31.916] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:29:0)
[17:07:31.974] Build status: STARTED
[17:07:31.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:30:0) after 9m46s
[17:17:18.038] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:30:0)
[17:17:18.065] Build status: STARTED
[17:17:18.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:31:0) after 9m24s
[17:26:42.087] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:31:0)
[17:26:42.108] Build status: STARTED
[17:26:42.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:32:0) after 3m43s
[17:30:25.204] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:32:0)
[17:30:25.261] Build status: STARTED
[17:30:25.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:33:0) after 8m58s
[17:39:23.341] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:33:0)
[17:39:23.413] Build status: STARTED
[17:39:23.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:34:0) after 9m40s
[17:49:03.478] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:34:0)
[17:49:03.499] Build status: STARTED
[17:49:03.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:35:0) after 8m37s
[17:57:40.609] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:35:0)
[17:57:40.639] Build status: STARTED
[17:57:40.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:36:0) after 2m8s
[17:59:48.662] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:36:0)
[17:59:48.681] Build status: STARTED
[17:59:48.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:37:0) after 7m10s
[18:06:58.803] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:37:0)
[18:06:58.826] Build status: STARTED
[18:06:58.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:38:0) after 8m22s
[18:15:20.847] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:38:0)
[18:15:20.869] Build status: STARTED
[18:15:20.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:39:0) after 5m51s
[18:21:11.984] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:39:0)
[18:21:12.005] Build status: STARTED
[18:21:12.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:40:0) after 7m35s
[18:28:47.033] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:40:0)
[18:28:47.062] Build status: STARTED
[18:28:47.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:41:0) after 8m56s
[18:37:43.151] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:41:0)
[18:37:43.168] Build status: STARTED
[18:37:43.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:42:0) after 8m44s
[18:46:27.189] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:42:0)
[18:46:27.205] Build status: STARTED
[18:46:27.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:43:0) after 9m34s
[18:56:01.321] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:43:0)
[18:56:01.393] Build status: STARTED
[18:56:01.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:44:0) after 5m45s
[19:01:46.445] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:44:0)
[19:01:46.466] Build status: STARTED
[19:01:46.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:45:0) after 8m23s
[19:10:09.593] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:45:0)
[19:10:09.642] Build status: STARTED
[19:10:09.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:46:0) after 2m2s
[19:12:11.689] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:46:0)
[19:12:11.709] Build status: STARTED
[19:12:11.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:47:0) after 7m0s
[19:19:11.741] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:47:0)
[19:19:11.774] Build status: STARTED
[19:19:11.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:48:0) after 8m59s
[19:28:10.878] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:48:0)
[19:28:10.898] Build status: STARTED
[19:28:10.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:49:0) after 5m48s
[19:33:58.918] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:49:0)
[19:33:58.935] Build status: STARTED
[19:33:58.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:50:0) after 6m10s
[19:40:08.959] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:50:0)
[19:40:08.978] Build status: STARTED
[19:40:08.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8923259335499509328:51:0) after 6m2s
[19:42:09.493] Received PubSub notification, asking Buildbucket for the build status
[19:42:09.519] Build:
{
"id": "8757829273550090033",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 21405,
"createdBy": "project:chromium",
"createTime": "2024-01-26T14:42:56.552266354Z",
"startTime": "2024-01-26T14:44:45.177472Z",
"endTime": "2024-01-26T19:42:08.918315Z",
"updateTime": "2024-01-26T19:42:08.918315Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3714914231ebfdf2d3fd5e63229ae2e2bc96b9d0",
"ref": "refs/heads/main"
}
}
}
[19:42:09.519] Invocation finished in 4h59m14.210572022s with status FAILED