[23:27:57.429] New invocation is queued and will start shortly
[23:27:58.980] Starting the invocation (attempt 1)
[23:27:59.012] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/56ba5d6992b488aec2567eee1ec482019eec3291"
[23:27:59.012] Popped gitiles commit info from properties and tags
[23:27:59.012] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:27:59.012] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:27:59.012] Buildbucket request:
{
"requestId": "8902479597844305136",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "56ba5d6992b488aec2567eee1ec482019eec3291",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8902479597844305136"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:27:59.712] Scheduled build:
{
"id": "8737049535460657985",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 24395,
"createdBy": "project:chromium",
"createTime": "2024-09-11T23:27:59.070383130Z",
"updateTime": "2024-09-11T23:27:59.070383130Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "56ba5d6992b488aec2567eee1ec482019eec3291",
"ref": "refs/heads/main"
}
}
}
[23:27:59.712] Task URL: https://cr-buildbucket.appspot.com/build/8737049535460657985
[23:27:59.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:2:0) after 7m10s
[23:28:00.657] Received PubSub notification, asking Buildbucket for the build status
[23:28:00.681] Build status: SCHEDULED
[23:29:32.135] Received PubSub notification, asking Buildbucket for the build status
[23:29:32.158] Build status: STARTED
[23:35:09.784] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:2:0)
[23:35:09.803] Build status: STARTED
[23:35:09.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:5:0) after 2m9s
[23:37:18.821] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:5:0)
[23:37:18.856] Build status: STARTED
[23:37:18.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:6:0) after 3m44s
[23:41:02.877] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:6:0)
[23:41:02.895] Build status: STARTED
[23:41:02.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:7:0) after 6m22s
[23:47:24.891] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:7:0)
[23:47:24.916] Build status: STARTED
[23:47:24.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:8:0) after 2m1s
[23:49:26.066] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:8:0)
[23:49:26.079] Build status: STARTED
[23:49:26.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:9:0) after 7m19s
[23:56:45.133] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:9:0)
[23:56:45.193] Build status: STARTED
[23:56:45.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:10:0) after 3m22s
[00:00:07.218] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:10:0)
[00:00:07.234] Build status: STARTED
[00:00:07.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:11:0) after 8m36s
[00:08:43.281] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:11:0)
[00:08:43.350] Build status: STARTED
[00:08:43.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:12:0) after 6m44s
[00:15:27.433] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:12:0)
[00:15:27.460] Build status: STARTED
[00:15:27.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:13:0) after 3m28s
[00:18:55.448] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:13:0)
[00:18:55.505] Build status: STARTED
[00:18:55.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:14:0) after 9m7s
[00:28:02.550] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:14:0)
[00:28:02.603] Build status: STARTED
[00:28:02.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:15:0) after 6m18s
[00:34:20.690] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:15:0)
[00:34:20.707] Build status: STARTED
[00:34:20.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:16:0) after 1m44s
[00:36:04.740] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:16:0)
[00:36:04.758] Build status: STARTED
[00:36:04.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:17:0) after 7m41s
[00:43:45.790] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:17:0)
[00:43:45.816] Build status: STARTED
[00:43:45.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:18:0) after 2m10s
[00:45:55.838] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:18:0)
[00:45:55.855] Build status: STARTED
[00:45:55.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:19:0) after 2m0s
[00:47:55.877] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:19:0)
[00:47:55.893] Build status: STARTED
[00:47:55.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:20:0) after 4m19s
[00:52:14.913] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:20:0)
[00:52:14.929] Build status: STARTED
[00:52:14.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:21:0) after 3m19s
[00:55:33.957] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:21:0)
[00:55:33.974] Build status: STARTED
[00:55:33.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:22:0) after 5m47s
[01:01:20.994] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:22:0)
[01:01:21.021] Build status: STARTED
[01:01:21.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:23:0) after 3m23s
[01:04:44.162] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:23:0)
[01:04:44.220] Build status: STARTED
[01:04:44.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:24:0) after 8m57s
[01:13:41.276] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:24:0)
[01:13:41.292] Build status: STARTED
[01:13:41.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:25:0) after 4m17s
[01:17:58.309] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:25:0)
[01:17:58.335] Build status: STARTED
[01:17:58.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:26:0) after 9m8s
[01:27:06.410] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:26:0)
[01:27:06.427] Build status: STARTED
[01:27:06.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:27:0) after 4m32s
[01:31:38.485] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:27:0)
[01:31:38.507] Build status: STARTED
[01:31:38.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:28:0) after 8m14s
[01:39:52.567] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:28:0)
[01:39:52.586] Build status: STARTED
[01:39:52.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:29:0) after 2m46s
[01:42:38.637] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:29:0)
[01:42:38.703] Build status: STARTED
[01:42:38.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:30:0) after 7m44s
[01:50:22.719] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:30:0)
[01:50:22.750] Build status: STARTED
[01:50:22.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:31:0) after 4m18s
[01:54:40.780] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:31:0)
[01:54:40.796] Build status: STARTED
[01:54:40.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:32:0) after 1m33s
[01:56:13.912] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:32:0)
[01:56:13.942] Build status: STARTED
[01:56:13.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:33:0) after 6m20s
[02:02:33.966] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:33:0)
[02:02:34.019] Build status: STARTED
[02:02:34.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:34:0) after 3m40s
[02:06:14.088] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:34:0)
[02:06:14.109] Build status: STARTED
[02:06:14.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:35:0) after 1m46s
[02:08:00.177] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:35:0)
[02:08:00.235] Build status: STARTED
[02:08:00.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:36:0) after 6m17s
[02:14:17.269] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:36:0)
[02:14:17.292] Build status: STARTED
[02:14:17.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:37:0) after 9m18s
[02:23:35.378] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:37:0)
[02:23:35.406] Build status: STARTED
[02:23:35.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:38:0) after 4m31s
[02:28:06.467] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:38:0)
[02:28:06.496] Build status: STARTED
[02:28:06.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:39:0) after 1m9s
[02:29:15.555] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:39:0)
[02:29:15.751] Build status: STARTED
[02:29:15.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:40:0) after 7m44s
[02:36:59.759] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:40:0)
[02:36:59.824] Build status: STARTED
[02:36:59.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:41:0) after 8m58s
[02:45:57.925] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:41:0)
[02:45:57.943] Build status: STARTED
[02:45:57.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:42:0) after 7m4s
[02:53:02.414] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:42:0)
[02:53:02.433] Build status: STARTED
[02:53:02.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:43:0) after 1m19s
[02:54:21.610] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:43:0)
[02:54:21.630] Build status: STARTED
[02:54:21.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:44:0) after 1m4s
[02:55:25.977] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:44:0)
[02:55:25.995] Build status: STARTED
[02:55:25.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:45:0) after 8m42s
[03:04:08.038] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:45:0)
[03:04:08.054] Build status: STARTED
[03:04:08.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:46:0) after 4m16s
[03:08:24.246] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:46:0)
[03:08:24.278] Build status: STARTED
[03:08:24.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:47:0) after 2m10s
[03:10:34.838] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:47:0)
[03:10:34.862] Build status: STARTED
[03:10:34.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:48:0) after 6m37s
[03:17:11.884] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:48:0)
[03:17:11.901] Build status: STARTED
[03:17:11.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:49:0) after 9m39s
[03:26:50.884] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:49:0)
[03:26:50.900] Build status: STARTED
[03:26:50.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:50:0) after 6m22s
[03:33:12.921] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:50:0)
[03:33:12.942] Build status: STARTED
[03:33:12.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:51:0) after 8m6s
[03:41:19.074] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:51:0)
[03:41:19.176] Build status: STARTED
[03:41:19.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:52:0) after 1m56s
[03:43:15.233] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:52:0)
[03:43:15.259] Build status: STARTED
[03:43:15.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8902479597844305136:53:0) after 4m44s
[03:43:47.542] Received PubSub notification, asking Buildbucket for the build status
[03:43:47.564] Build:
{
"id": "8737049535460657985",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 24395,
"createdBy": "project:chromium",
"createTime": "2024-09-11T23:27:59.070383130Z",
"startTime": "2024-09-11T23:29:31.923056226Z",
"endTime": "2024-09-12T03:43:47.289885260Z",
"updateTime": "2024-09-12T03:43:47.289885260Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "56ba5d6992b488aec2567eee1ec482019eec3291",
"ref": "refs/heads/main"
}
}
}
[03:43:47.564] Invocation finished in 4h15m50.151572134s with status FAILED