[18:24:40.472] New invocation is queued and will start shortly
[18:24:41.969] Starting the invocation (attempt 1)
[18:24:41.997] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/1b644f55d105cad0ba249a557e599e1670d939bd"
[18:24:41.997] Popped gitiles commit info from properties and tags
[18:24:41.997] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:24:41.997] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:24:41.997] Buildbucket request:
{
"requestId": "8886100627814478352",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1b644f55d105cad0ba249a557e599e1670d939bd",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8886100627814478352"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:24:42.716] Scheduled build:
{
"id": "8720670565462877425",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 24808,
"createdBy": "project:chromium",
"createTime": "2025-03-11T18:24:42.086792616Z",
"updateTime": "2025-03-11T18:24:42.086792616Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1b644f55d105cad0ba249a557e599e1670d939bd",
"ref": "refs/heads/main"
}
}
}
[18:24:42.716] Task URL: https://cr-buildbucket.appspot.com/build/8720670565462877425
[18:24:42.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:2:0) after 3m8s
[18:24:43.818] Received PubSub notification, asking Buildbucket for the build status
[18:24:43.838] Build status: SCHEDULED
[18:25:46.286] Received PubSub notification, asking Buildbucket for the build status
[18:25:46.309] Build status: STARTED
[18:27:50.785] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:2:0)
[18:27:50.806] Build status: STARTED
[18:27:50.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:5:0) after 3m19s
[18:31:09.888] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:5:0)
[18:31:09.933] Build status: STARTED
[18:31:09.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:6:0) after 2m13s
[18:33:22.973] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:6:0)
[18:33:23.002] Build status: STARTED
[18:33:23.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:7:0) after 5m28s
[18:38:51.098] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:7:0)
[18:38:51.170] Build status: STARTED
[18:38:51.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:8:0) after 3m49s
[18:42:40.232] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:8:0)
[18:42:40.288] Build status: STARTED
[18:42:40.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:9:0) after 9m19s
[18:51:59.279] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:9:0)
[18:51:59.306] Build status: STARTED
[18:51:59.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:10:0) after 2m28s
[18:54:27.383] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:10:0)
[18:54:27.429] Build status: STARTED
[18:54:27.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:11:0) after 6m27s
[19:00:54.453] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:11:0)
[19:00:54.486] Build status: STARTED
[19:00:54.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:12:0) after 6m42s
[19:07:36.563] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:12:0)
[19:07:36.587] Build status: STARTED
[19:07:36.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:13:0) after 5m14s
[19:12:50.588] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:13:0)
[19:12:50.604] Build status: STARTED
[19:12:50.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:14:0) after 8m32s
[19:21:22.603] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:14:0)
[19:21:22.622] Build status: STARTED
[19:21:22.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:15:0) after 2m8s
[19:23:30.679] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:15:0)
[19:23:30.720] Build status: STARTED
[19:23:30.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:16:0) after 8m39s
[19:32:09.745] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:16:0)
[19:32:09.765] Build status: STARTED
[19:32:09.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:17:0) after 4m13s
[19:36:22.896] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:17:0)
[19:36:22.915] Build status: STARTED
[19:36:22.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:18:0) after 5m28s
[19:41:50.937] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:18:0)
[19:41:50.954] Build status: STARTED
[19:41:50.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:19:0) after 9m27s
[19:51:18.036] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:19:0)
[19:51:18.052] Build status: STARTED
[19:51:18.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:20:0) after 8m27s
[19:59:45.122] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:20:0)
[19:59:45.208] Build status: STARTED
[19:59:45.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:21:0) after 6m17s
[20:06:02.225] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:21:0)
[20:06:02.243] Build status: STARTED
[20:06:02.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:22:0) after 3m40s
[20:09:42.228] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:22:0)
[20:09:42.244] Build status: STARTED
[20:09:42.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:23:0) after 6m28s
[20:16:10.275] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:23:0)
[20:16:10.303] Build status: STARTED
[20:16:10.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:24:0) after 6m52s
[20:23:02.339] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:24:0)
[20:23:02.354] Build status: STARTED
[20:23:02.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:25:0) after 5m33s
[20:28:35.387] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:25:0)
[20:28:35.403] Build status: STARTED
[20:28:35.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:26:0) after 3m54s
[20:32:29.441] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:26:0)
[20:32:29.464] Build status: STARTED
[20:32:29.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:27:0) after 1m22s
[20:33:51.588] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:27:0)
[20:33:51.649] Build status: STARTED
[20:33:51.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:28:0) after 1m50s
[20:35:41.640] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:28:0)
[20:35:41.665] Build status: STARTED
[20:35:41.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:29:0) after 1m30s
[20:37:11.748] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:29:0)
[20:37:11.766] Build status: STARTED
[20:37:11.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:30:0) after 3m49s
[20:41:00.792] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:30:0)
[20:41:00.813] Build status: STARTED
[20:41:00.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:31:0) after 2m35s
[20:43:35.966] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:31:0)
[20:43:35.991] Build status: STARTED
[20:43:35.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:32:0) after 3m8s
[20:46:44.033] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:32:0)
[20:46:44.050] Build status: STARTED
[20:46:44.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:33:0) after 6m18s
[20:53:02.098] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:33:0)
[20:53:02.119] Build status: STARTED
[20:53:02.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:34:0) after 1m28s
[20:54:30.174] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:34:0)
[20:54:30.250] Build status: STARTED
[20:54:30.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:35:0) after 5m57s
[21:00:27.278] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:35:0)
[21:00:27.297] Build status: STARTED
[21:00:27.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:36:0) after 8m48s
[21:09:15.322] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:36:0)
[21:09:15.340] Build status: STARTED
[21:09:15.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:37:0) after 7m13s
[21:16:28.462] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:37:0)
[21:16:28.523] Build status: STARTED
[21:16:28.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:38:0) after 6m12s
[21:22:40.600] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:38:0)
[21:22:40.614] Build status: STARTED
[21:22:40.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:39:0) after 9m14s
[21:31:54.632] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:39:0)
[21:31:54.676] Build status: STARTED
[21:31:54.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:40:0) after 3m13s
[21:35:07.692] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:40:0)
[21:35:07.720] Build status: STARTED
[21:35:07.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:41:0) after 5m2s
[21:40:09.833] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:41:0)
[21:40:09.852] Build status: STARTED
[21:40:09.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:42:0) after 1m1s
[21:41:10.952] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:42:0)
[21:41:10.989] Build status: STARTED
[21:41:10.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8886100627814478352:43:0) after 7m14s
[21:43:50.904] Received PubSub notification, asking Buildbucket for the build status
[21:43:50.917] Build:
{
"id": "8720670565462877425",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 24808,
"createdBy": "project:chromium",
"createTime": "2025-03-11T18:24:42.086792616Z",
"startTime": "2025-03-11T18:25:46.088693424Z",
"endTime": "2025-03-11T21:43:50.570008683Z",
"updateTime": "2025-03-11T21:43:50.570008683Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1b644f55d105cad0ba249a557e599e1670d939bd",
"ref": "refs/heads/main"
}
}
}
[21:43:50.917] Invocation finished in 3h19m10.457883313s with status FAILED