[21:00:50.442] New invocation is queued and will start shortly
[21:00:51.575] Starting the invocation (attempt 1)
[21:00:51.602] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9b7c49f4358c282e16cbfd0176dba35f1c4306be"
[21:00:51.602] Popped gitiles commit info from properties and tags
[21:00:51.602] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:00:51.602] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:00:51.602] Buildbucket request:
{
"requestId": "8923144961945643392",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9b7c49f4358c282e16cbfd0176dba35f1c4306be",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8923144961945643392"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:00:52.683] Scheduled build:
{
"id": "8757714899965909217",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 19327,
"createdBy": "project:chromium",
"createTime": "2024-01-27T21:00:51.702808817Z",
"updateTime": "2024-01-27T21:00:51.702808817Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9b7c49f4358c282e16cbfd0176dba35f1c4306be",
"ref": "refs/heads/main"
}
}
}
[21:00:52.683] Task URL: https://cr-buildbucket.appspot.com/build/8757714899965909217
[21:00:52.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:2:0) after 5m32s
[21:00:53.432] Received PubSub notification, asking Buildbucket for the build status
[21:00:53.460] Build status: SCHEDULED
[21:02:15.933] Received PubSub notification, asking Buildbucket for the build status
[21:02:15.950] Build status: STARTED
[21:06:24.754] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:2:0)
[21:06:24.793] Build status: STARTED
[21:06:24.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:5:0) after 9m5s
[21:15:29.852] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:5:0)
[21:15:29.872] Build status: STARTED
[21:15:29.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:6:0) after 5m28s
[21:20:58.037] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:6:0)
[21:20:58.083] Build status: STARTED
[21:20:58.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:7:0) after 1m17s
[21:22:15.229] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:7:0)
[21:22:15.268] Build status: STARTED
[21:22:15.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:8:0) after 4m44s
[21:26:59.347] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:8:0)
[21:26:59.365] Build status: STARTED
[21:26:59.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:9:0) after 1m31s
[21:28:30.379] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:9:0)
[21:28:30.409] Build status: STARTED
[21:28:30.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:10:0) after 1m24s
[21:29:54.506] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:10:0)
[21:29:54.529] Build status: STARTED
[21:29:54.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:11:0) after 8m52s
[21:38:46.607] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:11:0)
[21:38:46.658] Build status: STARTED
[21:38:46.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:12:0) after 8m51s
[21:47:37.772] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:12:0)
[21:47:37.790] Build status: STARTED
[21:47:37.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:13:0) after 1m1s
[21:48:38.812] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:13:0)
[21:48:38.888] Build status: STARTED
[21:48:38.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:14:0) after 6m51s
[21:55:29.902] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:14:0)
[21:55:29.920] Build status: STARTED
[21:55:29.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:15:0) after 9m26s
[22:04:55.941] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:15:0)
[22:04:55.962] Build status: STARTED
[22:04:55.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:16:0) after 3m58s
[22:08:54.062] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:16:0)
[22:08:54.090] Build status: STARTED
[22:08:54.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:17:0) after 7m39s
[22:16:33.132] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:17:0)
[22:16:33.149] Build status: STARTED
[22:16:33.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:18:0) after 1m36s
[22:18:09.248] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:18:0)
[22:18:09.272] Build status: STARTED
[22:18:09.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:19:0) after 7m31s
[22:25:40.314] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:19:0)
[22:25:40.337] Build status: STARTED
[22:25:40.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:20:0) after 5m38s
[22:31:18.632] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:20:0)
[22:31:18.655] Build status: STARTED
[22:31:18.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:21:0) after 7m11s
[22:38:29.671] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:21:0)
[22:38:29.699] Build status: STARTED
[22:38:29.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:22:0) after 9m17s
[22:47:47.366] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:22:0)
[22:47:47.387] Build status: STARTED
[22:47:47.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:23:0) after 2m11s
[22:49:58.783] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:23:0)
[22:49:58.804] Build status: STARTED
[22:49:58.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:24:0) after 6m11s
[22:56:10.839] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:24:0)
[22:56:10.867] Build status: STARTED
[22:56:10.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:25:0) after 3m32s
[22:59:42.886] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:25:0)
[22:59:42.905] Build status: STARTED
[22:59:42.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:26:0) after 1m35s
[23:01:18.954] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:26:0)
[23:01:19.102] Build status: STARTED
[23:01:19.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:27:0) after 8m51s
[23:10:10.198] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:27:0)
[23:10:10.215] Build status: STARTED
[23:10:10.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:28:0) after 3m57s
[23:14:07.681] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:28:0)
[23:14:07.766] Build status: STARTED
[23:14:07.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:29:0) after 1m58s
[23:16:05.784] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:29:0)
[23:16:05.805] Build status: STARTED
[23:16:05.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:30:0) after 3m24s
[23:19:30.125] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:30:0)
[23:19:30.200] Build status: STARTED
[23:19:30.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:31:0) after 7m10s
[23:26:40.618] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:31:0)
[23:26:40.637] Build status: STARTED
[23:26:40.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:32:0) after 6m19s
[23:32:59.628] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:32:0)
[23:32:59.646] Build status: STARTED
[23:32:59.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:33:0) after 8m13s
[23:41:12.703] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:33:0)
[23:41:12.721] Build status: STARTED
[23:41:12.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:34:0) after 4m47s
[23:45:59.742] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:34:0)
[23:45:59.766] Build status: STARTED
[23:45:59.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:35:0) after 3m38s
[23:49:37.909] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:35:0)
[23:49:37.935] Build status: STARTED
[23:49:37.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:36:0) after 9m55s
[23:59:32.956] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:36:0)
[23:59:32.973] Build status: STARTED
[23:59:32.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:37:0) after 9m9s
[00:08:42.397] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:37:0)
[00:08:42.415] Build status: STARTED
[00:08:42.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:38:0) after 9m15s
[00:17:57.474] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:38:0)
[00:17:57.508] Build status: STARTED
[00:17:57.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:39:0) after 4m15s
[00:22:12.528] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:39:0)
[00:22:12.545] Build status: STARTED
[00:22:12.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:40:0) after 1m9s
[00:23:21.615] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:40:0)
[00:23:21.632] Build status: STARTED
[00:23:21.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:41:0) after 8m56s
[00:32:17.647] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:41:0)
[00:32:17.838] Build status: STARTED
[00:32:17.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:42:0) after 5m12s
[00:37:29.856] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:42:0)
[00:37:29.878] Build status: STARTED
[00:37:29.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:43:0) after 4m12s
[00:41:42.297] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:43:0)
[00:41:42.321] Build status: STARTED
[00:41:42.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:44:0) after 5m12s
[00:46:54.522] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:44:0)
[00:46:54.541] Build status: STARTED
[00:46:54.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:45:0) after 1m51s
[00:48:45.607] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:45:0)
[00:48:45.641] Build status: STARTED
[00:48:45.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:46:0) after 4m5s
[00:52:50.658] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:46:0)
[00:52:50.679] Build status: STARTED
[00:52:50.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:47:0) after 8m55s
[01:01:45.700] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:47:0)
[01:01:45.727] Build status: STARTED
[01:01:45.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:48:0) after 1m34s
[01:03:19.743] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:48:0)
[01:03:19.764] Build status: STARTED
[01:03:19.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:49:0) after 3m19s
[01:06:38.981] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:49:0)
[01:06:39.003] Build status: STARTED
[01:06:39.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:50:0) after 7m39s
[01:14:18.032] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:50:0)
[01:14:18.052] Build status: STARTED
[01:14:18.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8923144961945643392:51:0) after 8m22s
[01:22:00.667] Received PubSub notification, asking Buildbucket for the build status
[01:22:00.691] Build:
{
"id": "8757714899965909217",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 19327,
"createdBy": "project:chromium",
"createTime": "2024-01-27T21:00:51.702808817Z",
"startTime": "2024-01-27T21:02:15.405481Z",
"endTime": "2024-01-28T01:21:59.780004Z",
"updateTime": "2024-01-28T01:21:59.780004Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9b7c49f4358c282e16cbfd0176dba35f1c4306be",
"ref": "refs/heads/main"
}
}
}
[01:22:00.691] Invocation finished in 4h21m10.260914421s with status FAILED