[12:43:57.192] New invocation is queued and will start shortly
[12:43:58.301] Starting the invocation (attempt 1)
[12:43:58.337] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/35b1006e03caa0d99e557480737cc3e4debd9ba0"
[12:43:58.337] Popped gitiles commit info from properties and tags
[12:43:58.337] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[12:43:58.337] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[12:43:58.337] Buildbucket request:
{
"requestId": "8955519340405163616",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "35b1006e03caa0d99e557480737cc3e4debd9ba0",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8955519340405163616"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[12:43:58.802] Scheduled build:
{
"id": "8790089278421509057",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 18483,
"createdBy": "project:chromium",
"createTime": "2023-02-04T12:43:58.459344366Z",
"updateTime": "2023-02-04T12:43:58.459344366Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "35b1006e03caa0d99e557480737cc3e4debd9ba0",
"ref": "refs/heads/main"
}
}
}
[12:43:58.802] Task URL: https://cr-buildbucket.appspot.com/build/8790089278421509057
[12:43:58.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:2:0) after 5m30s
[12:49:28.886] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:2:0)
[12:49:28.910] Build status: SCHEDULED
[12:49:28.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:3:0) after 6m51s
[12:50:48.943] Received PubSub notification, asking Buildbucket for the build status
[12:50:49.014] Build status: STARTED
[12:56:20.255] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:3:0)
[12:56:20.276] Build status: STARTED
[12:56:20.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:5:0) after 9m30s
[13:05:50.328] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:5:0)
[13:05:50.357] Build status: STARTED
[13:05:50.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:6:0) after 7m30s
[13:13:20.761] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:6:0)
[13:13:20.790] Build status: STARTED
[13:13:20.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:7:0) after 8m13s
[13:21:33.808] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:7:0)
[13:21:33.837] Build status: STARTED
[13:21:33.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:8:0) after 7m33s
[13:29:06.898] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:8:0)
[13:29:06.920] Build status: STARTED
[13:29:06.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:9:0) after 5m3s
[13:34:09.945] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:9:0)
[13:34:09.973] Build status: STARTED
[13:34:09.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:10:0) after 5m7s
[13:39:16.990] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:10:0)
[13:39:17.022] Build status: STARTED
[13:39:17.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:11:0) after 2m33s
[13:41:50.240] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:11:0)
[13:41:50.280] Build status: STARTED
[13:41:50.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:12:0) after 3m46s
[13:45:36.298] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:12:0)
[13:45:36.321] Build status: STARTED
[13:45:36.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:13:0) after 8m37s
[13:54:13.359] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:13:0)
[13:54:13.383] Build status: STARTED
[13:54:13.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:14:0) after 6m3s
[14:00:16.840] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:14:0)
[14:00:16.932] Build status: STARTED
[14:00:16.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:15:0) after 7m42s
[14:07:59.013] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:15:0)
[14:07:59.069] Build status: STARTED
[14:07:59.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:16:0) after 6m32s
[14:14:31.098] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:16:0)
[14:14:31.122] Build status: STARTED
[14:14:31.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:17:0) after 9m19s
[14:23:50.298] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:17:0)
[14:23:50.318] Build status: STARTED
[14:23:50.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:18:0) after 2m39s
[14:26:30.018] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:18:0)
[14:26:30.038] Build status: STARTED
[14:26:30.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:19:0) after 3m2s
[14:29:32.347] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:19:0)
[14:29:32.388] Build status: STARTED
[14:29:32.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:20:0) after 5m3s
[14:34:35.412] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:20:0)
[14:34:35.436] Build status: STARTED
[14:34:35.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:21:0) after 4m7s
[14:38:42.655] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:21:0)
[14:38:42.682] Build status: STARTED
[14:38:42.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:22:0) after 3m58s
[14:42:40.703] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:22:0)
[14:42:40.725] Build status: STARTED
[14:42:40.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:23:0) after 6m32s
[14:49:12.743] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:23:0)
[14:49:12.781] Build status: STARTED
[14:49:12.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:24:0) after 1m14s
[14:50:26.998] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:24:0)
[14:50:27.022] Build status: STARTED
[14:50:27.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:25:0) after 3m34s
[14:54:01.171] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:25:0)
[14:54:01.208] Build status: STARTED
[14:54:01.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:26:0) after 6m50s
[15:00:51.301] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:26:0)
[15:00:51.335] Build status: STARTED
[15:00:51.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:27:0) after 9m45s
[15:10:36.321] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:27:0)
[15:10:36.346] Build status: STARTED
[15:10:36.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:28:0) after 8m19s
[15:18:55.398] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:28:0)
[15:18:55.442] Build status: STARTED
[15:18:55.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:29:0) after 5m46s
[15:24:41.462] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:29:0)
[15:24:41.491] Build status: STARTED
[15:24:41.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:30:0) after 2m16s
[15:26:57.512] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:30:0)
[15:26:57.536] Build status: STARTED
[15:26:57.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:31:0) after 4m56s
[15:31:53.739] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:31:0)
[15:31:53.785] Build status: STARTED
[15:31:53.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:32:0) after 3m55s
[15:35:48.803] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:32:0)
[15:35:48.824] Build status: STARTED
[15:35:48.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:33:0) after 5m48s
[15:41:36.864] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:33:0)
[15:41:36.894] Build status: STARTED
[15:41:36.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:34:0) after 4m34s
[15:46:10.914] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:34:0)
[15:46:10.936] Build status: STARTED
[15:46:10.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:35:0) after 9m9s
[15:55:19.959] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:35:0)
[15:55:19.982] Build status: STARTED
[15:55:19.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:36:0) after 8m3s
[16:03:23.192] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:36:0)
[16:03:23.215] Build status: STARTED
[16:03:23.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:37:0) after 7m27s
[16:10:50.251] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:37:0)
[16:10:50.274] Build status: STARTED
[16:10:50.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:38:0) after 9m19s
[16:20:09.302] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:38:0)
[16:20:09.366] Build status: STARTED
[16:20:09.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:39:0) after 1m39s
[16:21:48.382] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:39:0)
[16:21:48.404] Build status: STARTED
[16:21:48.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:40:0) after 2m17s
[16:24:05.530] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:40:0)
[16:24:05.578] Build status: STARTED
[16:24:05.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:41:0) after 9m11s
[16:33:16.610] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:41:0)
[16:33:16.635] Build status: STARTED
[16:33:16.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:42:0) after 5m18s
[16:38:34.653] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:42:0)
[16:38:34.681] Build status: STARTED
[16:38:34.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:43:0) after 4m17s
[16:42:51.742] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:43:0)
[16:42:51.764] Build status: STARTED
[16:42:51.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:44:0) after 3m14s
[16:46:05.787] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:44:0)
[16:46:05.816] Build status: STARTED
[16:46:05.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:45:0) after 2m30s
[16:48:35.987] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:45:0)
[16:48:36.009] Build status: STARTED
[16:48:36.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:46:0) after 7m12s
[16:55:48.042] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:46:0)
[16:55:48.066] Build status: STARTED
[16:55:48.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:47:0) after 5m31s
[17:01:19.100] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:47:0)
[17:01:19.122] Build status: STARTED
[17:01:19.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:48:0) after 9m19s
[17:10:38.144] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:48:0)
[17:10:38.166] Build status: STARTED
[17:10:38.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:49:0) after 5m51s
[17:16:29.487] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:49:0)
[17:16:29.521] Build status: STARTED
[17:16:29.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:50:0) after 3m29s
[17:19:58.546] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:50:0)
[17:19:58.571] Build status: STARTED
[17:19:58.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:51:0) after 9m36s
[17:29:34.751] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:51:0)
[17:29:34.779] Build status: STARTED
[17:29:34.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:52:0) after 1m22s
[17:30:57.383] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:52:0)
[17:30:57.418] Build status: STARTED
[17:30:57.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:53:0) after 5m55s
[17:36:52.472] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:53:0)
[17:36:52.495] Build status: STARTED
[17:36:52.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:54:0) after 9m7s
[17:45:59.977] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:54:0)
[17:46:00.004] Build status: STARTED
[17:46:00.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:55:0) after 6m50s
[17:52:50.802] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:55:0)
[17:52:50.823] Build status: STARTED
[17:52:50.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8955519340405163616:56:0) after 6m11s
[17:57:41.172] Received PubSub notification, asking Buildbucket for the build status
[17:57:41.267] Build:
{
"id": "8790089278421509057",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 18483,
"createdBy": "project:chromium",
"createTime": "2023-02-04T12:43:58.459344366Z",
"startTime": "2023-02-04T12:50:48.386197Z",
"endTime": "2023-02-04T17:57:40.971893699Z",
"updateTime": "2023-02-04T17:57:40.971893699Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "35b1006e03caa0d99e557480737cc3e4debd9ba0",
"ref": "refs/heads/main"
}
}
}
[17:57:41.267] Invocation finished in 5h13m44.08270585s with status FAILED