[15:05:44.090] New invocation is queued and will start shortly
[15:05:45.134] Starting the invocation (attempt 1)
[15:05:45.160] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/ec2546ce3d3329a0b37e865499d28c23d7ef5226"
[15:05:45.160] Popped gitiles commit info from properties and tags
[15:05:45.160] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:05:45.160] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:05:45.160] Buildbucket request:
{
"requestId": "8911933279433928720",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ec2546ce3d3329a0b37e865499d28c23d7ef5226",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8911933279433928720"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:05:45.853] Scheduled build:
{
"id": "8746503217539810513",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 21459,
"createdBy": "project:chromium",
"createTime": "2024-05-30T15:05:45.275538805Z",
"updateTime": "2024-05-30T15:05:45.275538805Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ec2546ce3d3329a0b37e865499d28c23d7ef5226",
"ref": "refs/heads/main"
}
}
}
[15:05:45.854] Task URL: https://cr-buildbucket.appspot.com/build/8746503217539810513
[15:05:45.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:2:0) after 7m20s
[15:06:26.967] Received PubSub notification, asking Buildbucket for the build status
[15:06:26.998] Build status: SCHEDULED
[15:07:30.598] Received PubSub notification, asking Buildbucket for the build status
[15:07:30.635] Build status: STARTED
[15:13:05.886] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:2:0)
[15:13:05.908] Build status: STARTED
[15:13:05.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:5:0) after 5m31s
[15:18:36.934] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:5:0)
[15:18:36.954] Build status: STARTED
[15:18:36.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:6:0) after 8m46s
[15:27:22.995] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:6:0)
[15:27:23.081] Build status: STARTED
[15:27:23.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:7:0) after 3m19s
[15:30:42.114] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:7:0)
[15:30:42.129] Build status: STARTED
[15:30:42.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:8:0) after 7m18s
[15:38:00.132] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:8:0)
[15:38:00.148] Build status: STARTED
[15:38:00.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:9:0) after 3m15s
[15:41:15.205] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:9:0)
[15:41:15.227] Build status: STARTED
[15:41:15.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:10:0) after 2m44s
[15:43:59.530] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:10:0)
[15:43:59.545] Build status: STARTED
[15:43:59.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:11:0) after 4m4s
[15:48:03.673] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:11:0)
[15:48:03.692] Build status: STARTED
[15:48:03.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:12:0) after 4m8s
[15:52:11.806] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:12:0)
[15:52:11.827] Build status: STARTED
[15:52:11.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:13:0) after 9m49s
[16:02:00.892] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:13:0)
[16:02:00.915] Build status: STARTED
[16:02:00.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:14:0) after 2m54s
[16:04:55.473] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:14:0)
[16:04:55.493] Build status: STARTED
[16:04:55.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:15:0) after 7m19s
[16:12:14.512] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:15:0)
[16:12:14.530] Build status: STARTED
[16:12:14.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:16:0) after 2m8s
[16:14:22.596] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:16:0)
[16:14:22.617] Build status: STARTED
[16:14:22.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:17:0) after 3m18s
[16:17:40.636] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:17:0)
[16:17:40.657] Build status: STARTED
[16:17:40.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:18:0) after 8m7s
[16:25:47.712] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:18:0)
[16:25:47.737] Build status: STARTED
[16:25:47.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:19:0) after 9m11s
[16:34:58.817] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:19:0)
[16:34:58.833] Build status: STARTED
[16:34:58.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:20:0) after 8m39s
[16:43:37.861] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:20:0)
[16:43:37.884] Build status: STARTED
[16:43:37.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:21:0) after 6m22s
[16:49:59.902] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:21:0)
[16:49:59.918] Build status: STARTED
[16:49:59.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:22:0) after 4m34s
[16:54:34.021] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:22:0)
[16:54:34.039] Build status: STARTED
[16:54:34.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:23:0) after 9m3s
[17:03:37.058] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:23:0)
[17:03:37.075] Build status: STARTED
[17:03:37.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:24:0) after 1m58s
[17:05:35.096] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:24:0)
[17:05:35.113] Build status: STARTED
[17:05:35.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:25:0) after 7m9s
[17:12:44.185] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:25:0)
[17:12:44.202] Build status: STARTED
[17:12:44.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:26:0) after 6m54s
[17:19:38.215] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:26:0)
[17:19:38.233] Build status: STARTED
[17:19:38.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:27:0) after 7m39s
[17:27:17.358] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:27:0)
[17:27:17.396] Build status: STARTED
[17:27:17.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:28:0) after 7m42s
[17:34:59.465] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:28:0)
[17:34:59.511] Build status: STARTED
[17:34:59.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:29:0) after 8m19s
[17:43:18.581] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:29:0)
[17:43:18.749] Build status: STARTED
[17:43:18.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:30:0) after 9m32s
[17:52:50.768] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:30:0)
[17:52:50.798] Build status: STARTED
[17:52:50.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:31:0) after 9m48s
[18:02:38.870] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:31:0)
[18:02:38.889] Build status: STARTED
[18:02:38.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:32:0) after 2m51s
[18:05:29.965] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:32:0)
[18:05:29.988] Build status: STARTED
[18:05:29.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:33:0) after 2m55s
[18:08:25.012] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:33:0)
[18:08:25.034] Build status: STARTED
[18:08:25.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:34:0) after 4m37s
[18:13:02.005] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:34:0)
[18:13:02.024] Build status: STARTED
[18:13:02.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:35:0) after 1m2s
[18:14:04.041] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:35:0)
[18:14:04.229] Build status: STARTED
[18:14:04.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:36:0) after 8m30s
[18:22:34.316] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:36:0)
[18:22:34.338] Build status: STARTED
[18:22:34.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:37:0) after 1m2s
[18:23:36.405] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:37:0)
[18:23:36.555] Build status: STARTED
[18:23:36.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:38:0) after 1m50s
[18:25:26.584] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:38:0)
[18:25:26.606] Build status: STARTED
[18:25:26.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:39:0) after 6m59s
[18:32:25.624] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:39:0)
[18:32:25.647] Build status: STARTED
[18:32:25.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:40:0) after 1m39s
[18:34:04.688] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:40:0)
[18:34:04.714] Build status: STARTED
[18:34:04.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:41:0) after 8m19s
[18:42:23.734] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:41:0)
[18:42:23.758] Build status: STARTED
[18:42:23.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:42:0) after 1m6s
[18:43:29.779] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:42:0)
[18:43:29.799] Build status: STARTED
[18:43:29.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:43:0) after 9m15s
[18:52:44.821] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:43:0)
[18:52:44.839] Build status: STARTED
[18:52:44.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:44:0) after 5m14s
[18:57:58.859] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:44:0)
[18:57:58.887] Build status: STARTED
[18:57:58.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:45:0) after 7m50s
[19:05:48.909] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:45:0)
[19:05:48.945] Build status: STARTED
[19:05:48.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:46:0) after 8m36s
[19:14:24.966] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:46:0)
[19:14:24.995] Build status: STARTED
[19:14:24.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:47:0) after 8m20s
[19:22:45.147] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:47:0)
[19:22:45.167] Build status: STARTED
[19:22:45.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:48:0) after 5m27s
[19:28:12.187] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:48:0)
[19:28:12.310] Build status: STARTED
[19:28:12.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:49:0) after 2m33s
[19:30:45.330] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:49:0)
[19:30:45.443] Build status: STARTED
[19:30:45.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:50:0) after 7m38s
[19:38:23.535] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:50:0)
[19:38:23.564] Build status: STARTED
[19:38:23.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:51:0) after 9m16s
[19:47:39.636] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:51:0)
[19:47:39.656] Build status: STARTED
[19:47:39.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:52:0) after 6m27s
[19:54:06.724] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:52:0)
[19:54:06.747] Build status: STARTED
[19:54:06.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8911933279433928720:53:0) after 7m34s
[19:58:15.550] Received PubSub notification, asking Buildbucket for the build status
[19:58:15.567] Build:
{
"id": "8746503217539810513",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 21459,
"createdBy": "project:chromium",
"createTime": "2024-05-30T15:05:45.275538805Z",
"startTime": "2024-05-30T15:06:49.307376239Z",
"endTime": "2024-05-30T19:58:15.018230500Z",
"updateTime": "2024-05-30T19:58:15.018230500Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ec2546ce3d3329a0b37e865499d28c23d7ef5226",
"ref": "refs/heads/main"
}
}
}
[19:58:15.567] Invocation finished in 4h52m31.482872953s with status FAILED