[03:11:04.388] New invocation is queued and will start shortly
[03:11:05.748] Starting the invocation (attempt 1)
[03:11:05.787] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c38c9f1b832ecf792d3f8dcdbf131ef45b353d86"
[03:11:05.787] Popped gitiles commit info from properties and tags
[03:11:05.787] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:11:05.788] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:11:05.788] Buildbucket request:
{
"requestId": "8988170290813640080",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c38c9f1b832ecf792d3f8dcdbf131ef45b353d86",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8988170290813640080"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxMSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:11:06.370] Scheduled build:
{
"id": "8822740228601440721",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 14729,
"createdBy": "project:chromium",
"createTime": "2022-02-09T03:11:05.866687029Z",
"updateTime": "2022-02-09T03:11:05.866687029Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c38c9f1b832ecf792d3f8dcdbf131ef45b353d86",
"ref": "refs/heads/main"
}
}
}
[03:11:06.370] Task URL: https://cr-buildbucket.appspot.com/build/8822740228601440721
[03:11:06.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:2:0) after 6m25s
[03:13:18.732] Received PubSub notification, asking Buildbucket for the build status
[03:13:18.751] Build status: STARTED
[03:17:31.479] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:2:0)
[03:17:31.499] Build status: STARTED
[03:17:31.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:4:0) after 6m26s
[03:23:57.522] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:4:0)
[03:23:57.541] Build status: STARTED
[03:23:57.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:5:0) after 9m44s
[03:33:41.545] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:5:0)
[03:33:41.578] Build status: STARTED
[03:33:41.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:6:0) after 9m4s
[03:42:45.709] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:6:0)
[03:42:45.731] Build status: STARTED
[03:42:45.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:7:0) after 2m52s
[03:45:37.859] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:7:0)
[03:45:37.902] Build status: STARTED
[03:45:37.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:8:0) after 9m44s
[03:55:22.133] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:8:0)
[03:55:22.156] Build status: STARTED
[03:55:22.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:9:0) after 3m5s
[03:58:27.333] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:9:0)
[03:58:27.352] Build status: STARTED
[03:58:27.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:10:0) after 2m0s
[04:00:27.427] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:10:0)
[04:00:27.451] Build status: STARTED
[04:00:27.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:11:0) after 7m21s
[04:07:48.477] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:11:0)
[04:07:48.500] Build status: STARTED
[04:07:48.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:12:0) after 3m58s
[04:11:46.576] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:12:0)
[04:11:46.597] Build status: STARTED
[04:11:46.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:13:0) after 9m8s
[04:20:54.631] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:13:0)
[04:20:54.657] Build status: STARTED
[04:20:54.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:14:0) after 3m59s
[04:24:53.781] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:14:0)
[04:24:53.813] Build status: STARTED
[04:24:53.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:15:0) after 3m26s
[04:28:19.813] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:15:0)
[04:28:19.837] Build status: STARTED
[04:28:19.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:16:0) after 5m53s
[04:34:12.880] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:16:0)
[04:34:12.911] Build status: STARTED
[04:34:12.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:17:0) after 3m0s
[04:37:12.934] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:17:0)
[04:37:12.955] Build status: STARTED
[04:37:12.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:18:0) after 4m48s
[04:42:01.032] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:18:0)
[04:42:01.067] Build status: STARTED
[04:42:01.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:19:0) after 6m57s
[04:48:58.403] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:19:0)
[04:48:58.423] Build status: STARTED
[04:48:58.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:20:0) after 2m45s
[04:51:43.482] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:20:0)
[04:51:43.555] Build status: STARTED
[04:51:43.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:21:0) after 3m13s
[04:54:56.591] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:21:0)
[04:54:56.618] Build status: STARTED
[04:54:56.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:22:0) after 4m29s
[04:59:25.644] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:22:0)
[04:59:25.678] Build status: STARTED
[04:59:25.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:23:0) after 1m46s
[05:01:11.878] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:23:0)
[05:01:11.902] Build status: STARTED
[05:01:11.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:24:0) after 7m13s
[05:08:24.946] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:24:0)
[05:08:25.002] Build status: STARTED
[05:08:25.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:25:0) after 6m44s
[05:15:09.156] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:25:0)
[05:15:09.226] Build status: STARTED
[05:15:09.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:26:0) after 9m39s
[05:24:48.288] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:26:0)
[05:24:48.475] Build status: STARTED
[05:24:48.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:27:0) after 2m10s
[05:26:58.505] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:27:0)
[05:26:58.533] Build status: STARTED
[05:26:58.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:28:0) after 3m51s
[05:30:49.819] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:28:0)
[05:30:49.851] Build status: STARTED
[05:30:49.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:29:0) after 2m44s
[05:33:34.084] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:29:0)
[05:33:34.109] Build status: STARTED
[05:33:34.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:30:0) after 5m24s
[05:38:58.437] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:30:0)
[05:38:58.458] Build status: STARTED
[05:38:58.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:31:0) after 2m7s
[05:41:05.580] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:31:0)
[05:41:05.615] Build status: STARTED
[05:41:05.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:32:0) after 2m28s
[05:43:33.759] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:32:0)
[05:43:33.779] Build status: STARTED
[05:43:33.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:33:0) after 7m53s
[05:51:26.812] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:33:0)
[05:51:26.849] Build status: STARTED
[05:51:26.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:34:0) after 3m4s
[05:54:30.878] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:34:0)
[05:54:30.901] Build status: STARTED
[05:54:30.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:35:0) after 9m12s
[06:03:42.931] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:35:0)
[06:03:42.963] Build status: STARTED
[06:03:42.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:36:0) after 8m14s
[06:11:56.993] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:36:0)
[06:11:57.028] Build status: STARTED
[06:11:57.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:37:0) after 7m42s
[06:19:39.108] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:37:0)
[06:19:39.166] Build status: STARTED
[06:19:39.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:38:0) after 7m1s
[06:26:40.214] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:38:0)
[06:26:40.250] Build status: STARTED
[06:26:40.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:39:0) after 2m13s
[06:28:53.389] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:39:0)
[06:28:53.408] Build status: STARTED
[06:28:53.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:40:0) after 6m51s
[06:35:44.538] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:40:0)
[06:35:44.585] Build status: STARTED
[06:35:44.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:41:0) after 4m57s
[06:40:41.796] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:41:0)
[06:40:41.832] Build status: STARTED
[06:40:41.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:42:0) after 2m40s
[06:43:22.257] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:42:0)
[06:43:22.278] Build status: STARTED
[06:43:22.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:43:0) after 4m36s
[06:47:58.434] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:43:0)
[06:47:58.471] Build status: STARTED
[06:47:58.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:44:0) after 4m28s
[06:52:26.589] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:44:0)
[06:52:26.618] Build status: STARTED
[06:52:26.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:45:0) after 4m58s
[06:57:24.667] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:45:0)
[06:57:24.748] Build status: STARTED
[06:57:24.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:46:0) after 2m0s
[06:59:24.906] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:46:0)
[06:59:24.925] Build status: STARTED
[06:59:24.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:47:0) after 3m24s
[07:02:48.974] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:47:0)
[07:02:48.998] Build status: STARTED
[07:02:48.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:48:0) after 5m37s
[07:08:26.023] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:48:0)
[07:08:26.046] Build status: STARTED
[07:08:26.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:49:0) after 7m2s
[07:15:28.082] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:49:0)
[07:15:28.116] Build status: STARTED
[07:15:28.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:50:0) after 4m17s
[07:19:45.143] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:50:0)
[07:19:45.163] Build status: STARTED
[07:19:45.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:51:0) after 6m27s
[07:26:12.209] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:51:0)
[07:26:12.228] Build status: STARTED
[07:26:12.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:52:0) after 2m5s
[07:28:17.254] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:52:0)
[07:28:17.274] Build status: STARTED
[07:28:17.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:53:0) after 1m15s
[07:29:32.395] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:53:0)
[07:29:32.423] Build status: STARTED
[07:29:32.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:54:0) after 5m12s
[07:34:44.462] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:54:0)
[07:34:44.483] Build status: STARTED
[07:34:44.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:55:0) after 1m21s
[07:36:05.512] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:55:0)
[07:36:05.545] Build status: STARTED
[07:36:05.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:56:0) after 6m51s
[07:42:56.872] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:56:0)
[07:42:56.945] Build status: STARTED
[07:42:56.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:57:0) after 3m58s
[07:46:54.974] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:57:0)
[07:46:54.996] Build status: STARTED
[07:46:54.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:58:0) after 4m10s
[07:51:05.091] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:58:0)
[07:51:05.109] Build status: STARTED
[07:51:05.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:59:0) after 3m3s
[07:54:08.272] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:59:0)
[07:54:08.294] Build status: STARTED
[07:54:08.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:60:0) after 9m24s
[08:03:32.381] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:60:0)
[08:03:32.403] Build status: STARTED
[08:03:32.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:61:0) after 2m37s
[08:06:09.686] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:61:0)
[08:06:09.705] Build status: STARTED
[08:06:09.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:62:0) after 8m54s
[08:15:03.898] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:62:0)
[08:15:03.918] Build status: STARTED
[08:15:03.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:63:0) after 6m4s
[08:21:07.949] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:63:0)
[08:21:07.977] Build status: STARTED
[08:21:07.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:64:0) after 2m1s
[08:23:09.139] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:64:0)
[08:23:09.170] Build status: STARTED
[08:23:09.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:65:0) after 3m30s
[08:26:39.297] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:65:0)
[08:26:39.321] Build status: STARTED
[08:26:39.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:66:0) after 8m8s
[08:34:47.370] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:66:0)
[08:34:47.397] Build status: STARTED
[08:34:47.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:67:0) after 6m4s
[08:40:51.499] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:67:0)
[08:40:51.558] Build status: STARTED
[08:40:51.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:68:0) after 1m1s
[08:41:52.595] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:68:0)
[08:41:52.712] Build status: STARTED
[08:41:52.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:69:0) after 5m18s
[08:47:10.773] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:69:0)
[08:47:10.794] Build status: STARTED
[08:47:10.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:70:0) after 8m1s
[08:55:11.924] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:70:0)
[08:55:11.958] Build status: STARTED
[08:55:11.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:71:0) after 7m17s
[09:02:28.984] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:71:0)
[09:02:29.046] Build status: STARTED
[09:02:29.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:72:0) after 4m13s
[09:06:42.051] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:72:0)
[09:06:42.072] Build status: STARTED
[09:06:42.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:73:0) after 5m37s
[09:12:19.100] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:73:0)
[09:12:19.136] Build status: STARTED
[09:12:19.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:74:0) after 1m14s
[09:13:33.233] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:74:0)
[09:13:33.261] Build status: STARTED
[09:13:33.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:75:0) after 3m30s
[09:17:03.357] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:75:0)
[09:17:03.389] Build status: STARTED
[09:17:03.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:76:0) after 7m1s
[09:24:04.416] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:76:0)
[09:24:04.434] Build status: STARTED
[09:24:04.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:77:0) after 8m4s
[09:32:08.473] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:77:0)
[09:32:08.503] Build status: STARTED
[09:32:08.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:78:0) after 8m22s
[09:40:30.609] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:78:0)
[09:40:30.645] Build status: STARTED
[09:40:30.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:79:0) after 7m33s
[09:48:03.675] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:79:0)
[09:48:03.693] Build status: STARTED
[09:48:03.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:80:0) after 1m10s
[09:49:13.728] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:80:0)
[09:49:13.768] Build status: STARTED
[09:49:13.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:81:0) after 2m13s
[09:51:26.801] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:81:0)
[09:51:26.822] Build status: STARTED
[09:51:26.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:82:0) after 9m7s
[10:00:33.854] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:82:0)
[10:00:33.872] Build status: STARTED
[10:00:33.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:83:0) after 1m22s
[10:01:55.961] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:83:0)
[10:01:55.985] Build status: STARTED
[10:01:55.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:84:0) after 4m56s
[10:06:52.409] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:84:0)
[10:06:52.463] Build status: STARTED
[10:06:52.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:85:0) after 2m4s
[10:08:56.591] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:85:0)
[10:08:56.608] Build status: STARTED
[10:08:56.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:86:0) after 3m40s
[10:12:36.672] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:86:0)
[10:12:36.695] Build status: STARTED
[10:12:36.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:87:0) after 8m58s
[10:21:34.733] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:87:0)
[10:21:34.781] Build status: STARTED
[10:21:34.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:88:0) after 8m0s
[10:29:34.823] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:88:0)
[10:29:34.846] Build status: STARTED
[10:29:34.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:89:0) after 7m19s
[10:36:54.256] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:89:0)
[10:36:54.289] Build status: STARTED
[10:36:54.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:90:0) after 5m17s
[10:42:11.320] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:90:0)
[10:42:11.353] Build status: STARTED
[10:42:11.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:91:0) after 7m28s
[10:49:39.401] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:91:0)
[10:49:39.437] Build status: STARTED
[10:49:39.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:92:0) after 6m17s
[10:55:56.541] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:92:0)
[10:55:56.568] Build status: STARTED
[10:55:56.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:93:0) after 1m23s
[10:57:19.650] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:93:0)
[10:57:19.696] Build status: STARTED
[10:57:19.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:94:0) after 1m44s
[10:59:03.793] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:94:0)
[10:59:03.817] Build status: STARTED
[10:59:03.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:95:0) after 7m0s
[11:06:03.849] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:95:0)
[11:06:03.870] Build status: STARTED
[11:06:03.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:96:0) after 7m30s
[11:13:34.317] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:96:0)
[11:13:34.356] Build status: STARTED
[11:13:34.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:97:0) after 7m44s
[11:21:18.385] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:97:0)
[11:21:18.646] Build status: STARTED
[11:21:18.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:98:0) after 8m43s
[11:30:01.678] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:98:0)
[11:30:01.700] Build status: STARTED
[11:30:01.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:99:0) after 4m21s
[11:34:22.681] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:99:0)
[11:34:22.707] Build status: STARTED
[11:34:22.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:100:0) after 3m55s
[11:38:17.770] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:100:0)
[11:38:17.791] Build status: STARTED
[11:38:17.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:101:0) after 3m56s
[11:42:13.955] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:101:0)
[11:42:13.980] Build status: STARTED
[11:42:13.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:102:0) after 5m55s
[11:48:09.378] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:102:0)
[11:48:09.435] Build status: STARTED
[11:48:09.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8988170290813640080:103:0) after 6m24s
[11:54:31.756] Received PubSub notification, asking Buildbucket for the build status
[11:54:31.778] Build:
{
"id": "8822740228601440721",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxMSan"
},
"number": 14729,
"createdBy": "project:chromium",
"createTime": "2022-02-09T03:11:05.866687029Z",
"startTime": "2022-02-09T03:13:17.821875Z",
"endTime": "2022-02-09T11:54:31.150356960Z",
"updateTime": "2022-02-09T11:54:31.150356960Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c38c9f1b832ecf792d3f8dcdbf131ef45b353d86",
"ref": "refs/heads/main"
}
}
}
[11:54:31.778] Invocation finished in 8h43m27.405031068s with status FAILED