[22:22:18.128] New invocation is queued and will start shortly
[22:22:19.304] Starting the invocation (attempt 1)
[22:22:19.361] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/851a3c9eb3ce142ed8a9973bf451788e25b6d249"
[22:22:19.361] Popped gitiles commit info from properties and tags
[22:22:19.361] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:22:19.361] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:22:19.361] Buildbucket request:
{
"requestId": "8972424586560926384",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "851a3c9eb3ce142ed8a9973bf451788e25b6d249",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8972424586560926384"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacASan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:22:20.176] Scheduled build:
{
"id": "8806994524520144529",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 27232,
"createdBy": "project:chromium",
"createTime": "2022-08-01T22:22:19.442733120Z",
"updateTime": "2022-08-01T22:22:19.442733120Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "851a3c9eb3ce142ed8a9973bf451788e25b6d249",
"ref": "refs/heads/main"
}
}
}
[22:22:20.177] Task URL: https://cr-buildbucket.appspot.com/build/8806994524520144529
[22:22:20.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:2:0) after 1m56s
[22:24:16.463] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:2:0)
[22:24:16.492] Build status: SCHEDULED
[22:24:16.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:3:0) after 2m44s
[22:27:00.792] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:3:0)
[22:27:00.845] Build status: SCHEDULED
[22:27:00.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:4:0) after 8m49s
[22:35:49.963] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:4:0)
[22:35:49.985] Build status: SCHEDULED
[22:35:49.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:5:0) after 9m47s
[22:45:37.106] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:5:0)
[22:45:37.134] Build status: SCHEDULED
[22:45:37.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:6:0) after 6m59s
[22:52:36.156] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:6:0)
[22:52:36.181] Build status: SCHEDULED
[22:52:36.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:7:0) after 5m52s
[22:58:28.354] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:7:0)
[22:58:28.374] Build status: SCHEDULED
[22:58:28.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:8:0) after 9m25s
[23:07:53.395] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:8:0)
[23:07:53.420] Build status: SCHEDULED
[23:07:53.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:9:0) after 8m52s
[23:16:45.545] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:9:0)
[23:16:45.573] Build status: SCHEDULED
[23:16:45.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:10:0) after 4m30s
[23:22:20.136] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:10:0)
[23:22:20.155] Build status: SCHEDULED
[23:22:20.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:11:0) after 2m10s
[23:24:30.183] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:11:0)
[23:24:30.206] Build status: SCHEDULED
[23:24:30.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:12:0) after 4m43s
[23:29:13.439] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:12:0)
[23:29:13.461] Build status: SCHEDULED
[23:29:13.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:13:0) after 7m46s
[23:36:59.493] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:13:0)
[23:36:59.515] Build status: SCHEDULED
[23:36:59.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:14:0) after 6m49s
[23:43:48.751] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:14:0)
[23:43:48.774] Build status: SCHEDULED
[23:43:48.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:15:0) after 3m40s
[23:47:29.201] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:15:0)
[23:47:29.280] Build status: SCHEDULED
[23:47:29.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:16:0) after 2m18s
[23:49:47.301] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:16:0)
[23:49:47.321] Build status: SCHEDULED
[23:49:47.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:17:0) after 3m36s
[23:53:23.349] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:17:0)
[23:53:23.377] Build status: SCHEDULED
[23:53:23.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:18:0) after 5m6s
[23:58:29.473] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:18:0)
[23:58:29.515] Build status: SCHEDULED
[23:58:29.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:19:0) after 8m9s
[00:06:38.710] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:19:0)
[00:06:38.731] Build status: SCHEDULED
[00:06:38.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:20:0) after 1m58s
[00:08:36.973] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:20:0)
[00:08:37.003] Build status: SCHEDULED
[00:08:37.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:21:0) after 6m52s
[00:15:30.119] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:21:0)
[00:15:30.167] Build status: SCHEDULED
[00:15:30.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:22:0) after 9m4s
[00:24:34.391] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:22:0)
[00:24:34.409] Build status: SCHEDULED
[00:24:34.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:23:0) after 5m39s
[00:30:13.517] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:23:0)
[00:30:13.555] Build status: SCHEDULED
[00:30:13.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:24:0) after 1m5s
[00:31:19.227] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:24:0)
[00:31:19.263] Build status: SCHEDULED
[00:31:19.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:25:0) after 2m46s
[00:34:05.336] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:25:0)
[00:34:05.372] Build status: SCHEDULED
[00:34:05.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:26:0) after 9m52s
[00:43:57.434] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:26:0)
[00:43:57.457] Build status: SCHEDULED
[00:43:57.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:27:0) after 4m30s
[00:48:27.516] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:27:0)
[00:48:27.631] Build status: SCHEDULED
[00:48:27.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:28:0) after 9m38s
[00:58:06.001] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:28:0)
[00:58:06.046] Build status: SCHEDULED
[00:58:06.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:29:0) after 5m9s
[01:03:15.070] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:29:0)
[01:03:15.127] Build status: SCHEDULED
[01:03:15.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:30:0) after 9m23s
[01:12:38.171] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:30:0)
[01:12:38.245] Build status: SCHEDULED
[01:12:38.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:31:0) after 5m59s
[01:18:37.563] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:31:0)
[01:18:37.588] Build status: SCHEDULED
[01:18:37.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:32:0) after 6m24s
[01:25:01.826] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:32:0)
[01:25:01.855] Build status: SCHEDULED
[01:25:01.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:33:0) after 3m21s
[01:28:22.878] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:33:0)
[01:28:22.896] Build status: SCHEDULED
[01:28:22.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:34:0) after 9m54s
[01:38:16.937] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:34:0)
[01:38:16.959] Build status: SCHEDULED
[01:38:16.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:35:0) after 1m1s
[01:39:17.984] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:35:0)
[01:39:18.004] Build status: SCHEDULED
[01:39:18.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:36:0) after 6m54s
[01:46:12.073] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:36:0)
[01:46:12.105] Build status: SCHEDULED
[01:46:12.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:37:0) after 5m4s
[01:51:16.227] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:37:0)
[01:51:16.248] Build status: SCHEDULED
[01:51:16.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:38:0) after 8m21s
[01:59:37.320] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:38:0)
[01:59:37.349] Build status: SCHEDULED
[01:59:37.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:39:0) after 3m50s
[02:03:27.487] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:39:0)
[02:03:27.561] Build status: SCHEDULED
[02:03:27.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:40:0) after 6m35s
[02:10:02.583] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:40:0)
[02:10:02.617] Build status: SCHEDULED
[02:10:02.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:41:0) after 5m59s
[02:16:01.742] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:41:0)
[02:16:01.768] Build status: SCHEDULED
[02:16:01.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:42:0) after 9m39s
[02:25:40.795] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:42:0)
[02:25:40.815] Build status: SCHEDULED
[02:25:40.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:43:0) after 2m27s
[02:28:07.847] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:43:0)
[02:28:07.885] Build status: SCHEDULED
[02:28:07.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:44:0) after 4m21s
[02:32:29.482] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:44:0)
[02:32:29.523] Build status: SCHEDULED
[02:32:29.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:45:0) after 3m8s
[02:35:37.549] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:45:0)
[02:35:37.663] Build status: SCHEDULED
[02:35:37.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:46:0) after 5m35s
[02:41:12.761] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:46:0)
[02:41:12.784] Build status: SCHEDULED
[02:41:12.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:47:0) after 3m42s
[02:44:54.808] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:47:0)
[02:44:54.842] Build status: SCHEDULED
[02:44:54.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:48:0) after 8m48s
[02:53:42.997] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:48:0)
[02:53:43.021] Build status: SCHEDULED
[02:53:43.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:49:0) after 9m33s
[03:03:16.162] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:49:0)
[03:03:16.184] Build status: SCHEDULED
[03:03:16.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:50:0) after 5m6s
[03:08:22.205] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:50:0)
[03:08:22.244] Build status: SCHEDULED
[03:08:22.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:51:0) after 1m24s
[03:09:46.247] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:51:0)
[03:09:46.300] Build status: SCHEDULED
[03:09:46.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:52:0) after 8m24s
[03:18:10.382] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:52:0)
[03:18:10.433] Build status: SCHEDULED
[03:18:10.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:53:0) after 4m25s
[03:22:35.491] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:53:0)
[03:22:35.510] Build status: SCHEDULED
[03:22:35.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:54:0) after 4m44s
[03:27:19.532] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:54:0)
[03:27:19.584] Build status: SCHEDULED
[03:27:19.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:55:0) after 9m45s
[03:37:04.609] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:55:0)
[03:37:04.644] Build status: SCHEDULED
[03:37:04.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:56:0) after 3m48s
[03:40:52.817] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:56:0)
[03:40:52.930] Build status: SCHEDULED
[03:40:52.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:57:0) after 4m14s
[03:45:07.073] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:57:0)
[03:45:07.110] Build status: SCHEDULED
[03:45:07.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:58:0) after 8m54s
[03:53:59.096] Received PubSub notification, asking Buildbucket for the build status
[03:53:59.117] Build status: STARTED
[03:54:01.141] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:58:0)
[03:54:01.162] Build status: STARTED
[03:54:01.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:60:0) after 1m31s
[03:55:32.188] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:60:0)
[03:55:32.222] Build status: STARTED
[03:55:32.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:61:0) after 9m19s
[04:04:51.281] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:61:0)
[04:04:51.307] Build status: STARTED
[04:04:51.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:62:0) after 4m12s
[04:09:03.382] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:62:0)
[04:09:03.443] Build status: STARTED
[04:09:03.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:63:0) after 1m35s
[04:10:38.475] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:63:0)
[04:10:38.496] Build status: STARTED
[04:10:38.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8972424586560926384:64:0) after 1m52s
[04:10:59.262] Received PubSub notification, asking Buildbucket for the build status
[04:10:59.290] Build:
{
"id": "8806994524520144529",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacASan"
},
"number": 27232,
"createdBy": "project:chromium",
"createTime": "2022-08-01T22:22:19.442733120Z",
"startTime": "2022-08-02T03:53:58.524815Z",
"endTime": "2022-08-02T04:10:58.999397505Z",
"updateTime": "2022-08-02T04:10:58.999397505Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "851a3c9eb3ce142ed8a9973bf451788e25b6d249",
"ref": "refs/heads/main"
}
}
}
[04:10:59.290] Invocation finished in 5h48m41.177422336s with status FAILED