[16:11:59.117] New invocation is queued and will start shortly
[16:12:00.301] Starting the invocation (attempt 1)
[16:12:00.334] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9adead45d3bad5ecaade40afd938627c93d6ba88"
[16:12:00.334] Popped gitiles commit info from properties and tags
[16:12:00.334] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:12:00.334] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:12:00.334] Buildbucket request:
{
"requestId": "8906674487267416048",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9adead45d3bad5ecaade40afd938627c93d6ba88",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8906674487267416048"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:12:00.954] Scheduled build:
{
"id": "8741244425265324977",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 24020,
"createdBy": "project:chromium",
"createTime": "2024-07-27T16:12:00.403032378Z",
"updateTime": "2024-07-27T16:12:00.403032378Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9adead45d3bad5ecaade40afd938627c93d6ba88",
"ref": "refs/heads/main"
}
},
"canary": true
}
[16:12:00.954] Task URL: https://cr-buildbucket.appspot.com/build/8741244425265324977
[16:12:00.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:2:0) after 2m24s
[16:12:01.890] Received PubSub notification, asking Buildbucket for the build status
[16:12:01.929] Build status: SCHEDULED
[16:13:43.203] Received PubSub notification, asking Buildbucket for the build status
[16:13:43.219] Build status: STARTED
[16:14:24.920] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:2:0)
[16:14:24.944] Build status: STARTED
[16:14:24.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:5:0) after 7m4s
[16:21:28.962] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:5:0)
[16:21:29.005] Build status: STARTED
[16:21:29.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:6:0) after 4m30s
[16:25:59.057] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:6:0)
[16:25:59.082] Build status: STARTED
[16:25:59.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:7:0) after 9m22s
[16:35:21.164] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:7:0)
[16:35:21.192] Build status: STARTED
[16:35:21.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:8:0) after 5m43s
[16:41:04.300] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:8:0)
[16:41:04.323] Build status: STARTED
[16:41:04.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:9:0) after 7m23s
[16:48:27.338] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:9:0)
[16:48:27.359] Build status: STARTED
[16:48:27.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:10:0) after 2m7s
[16:50:34.373] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:10:0)
[16:50:34.390] Build status: STARTED
[16:50:34.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:11:0) after 3m15s
[16:53:49.585] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:11:0)
[16:53:49.610] Build status: STARTED
[16:53:49.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:12:0) after 1m3s
[16:54:52.644] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:12:0)
[16:54:52.666] Build status: STARTED
[16:54:52.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:13:0) after 1m58s
[16:56:50.708] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:13:0)
[16:56:50.722] Build status: STARTED
[16:56:50.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:14:0) after 7m47s
[17:04:37.787] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:14:0)
[17:04:37.822] Build status: STARTED
[17:04:37.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:15:0) after 2m7s
[17:06:44.798] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:15:0)
[17:06:44.814] Build status: STARTED
[17:06:44.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:16:0) after 4m10s
[17:10:54.908] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:16:0)
[17:10:54.928] Build status: STARTED
[17:10:54.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:17:0) after 4m7s
[17:15:01.994] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:17:0)
[17:15:02.045] Build status: STARTED
[17:15:02.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:18:0) after 9m51s
[17:24:53.156] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:18:0)
[17:24:53.176] Build status: STARTED
[17:24:53.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:19:0) after 9m3s
[17:33:56.197] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:19:0)
[17:33:56.216] Build status: STARTED
[17:33:56.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:20:0) after 1m52s
[17:35:48.246] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:20:0)
[17:35:48.261] Build status: STARTED
[17:35:48.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:21:0) after 6m0s
[17:41:48.385] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:21:0)
[17:41:48.457] Build status: STARTED
[17:41:48.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:22:0) after 9m1s
[17:50:49.554] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:22:0)
[17:50:49.578] Build status: STARTED
[17:50:49.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:23:0) after 1m58s
[17:52:47.595] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:23:0)
[17:52:47.614] Build status: STARTED
[17:52:47.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:24:0) after 6m47s
[17:59:34.705] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:24:0)
[17:59:34.720] Build status: STARTED
[17:59:34.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:25:0) after 6m17s
[18:05:51.737] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:25:0)
[18:05:51.760] Build status: STARTED
[18:05:51.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:26:0) after 2m3s
[18:07:54.847] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:26:0)
[18:07:54.863] Build status: STARTED
[18:07:54.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:27:0) after 3m17s
[18:11:12.381] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:27:0)
[18:11:12.401] Build status: STARTED
[18:11:12.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:28:0) after 8m11s
[18:19:23.421] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:28:0)
[18:19:23.444] Build status: STARTED
[18:19:23.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:29:0) after 5m14s
[18:24:37.460] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:29:0)
[18:24:37.481] Build status: STARTED
[18:24:37.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:30:0) after 1m30s
[18:26:07.496] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:30:0)
[18:26:07.556] Build status: STARTED
[18:26:07.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:31:0) after 7m53s
[18:34:00.775] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:31:0)
[18:34:00.838] Build status: STARTED
[18:34:00.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:32:0) after 7m46s
[18:41:46.852] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:32:0)
[18:41:46.872] Build status: STARTED
[18:41:46.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:33:0) after 3m33s
[18:45:20.060] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:33:0)
[18:45:20.083] Build status: STARTED
[18:45:20.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:34:0) after 6m32s
[18:51:52.187] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:34:0)
[18:51:52.204] Build status: STARTED
[18:51:52.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:35:0) after 1m12s
[18:53:04.281] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:35:0)
[18:53:04.314] Build status: STARTED
[18:53:04.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:36:0) after 1m34s
[18:54:38.362] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:36:0)
[18:54:38.380] Build status: STARTED
[18:54:38.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8906674487267416048:37:0) after 8m59s
[19:01:57.791] Received PubSub notification, asking Buildbucket for the build status
[19:01:57.809] Build:
{
"id": "8741244425265324977",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 24020,
"createdBy": "project:chromium",
"createTime": "2024-07-27T16:12:00.403032378Z",
"startTime": "2024-07-27T16:13:42.973107141Z",
"endTime": "2024-07-27T19:01:57.487524686Z",
"updateTime": "2024-07-27T19:01:57.487524686Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9adead45d3bad5ecaade40afd938627c93d6ba88",
"ref": "refs/heads/main"
}
},
"canary": true
}
[19:01:57.809] Invocation finished in 2h49m58.699019622s with status FAILED