[21:05:02.111] New invocation is queued and will start shortly
[21:05:03.210] Starting the invocation (attempt 1)
[21:05:03.237] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a40312e6213144fb341d5196de1b84b80eace224"
[21:05:03.237] Popped gitiles commit info from properties and tags
[21:05:03.237] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:05:03.237] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:05:03.237] Buildbucket request:
{
"requestId": "8912182465111673616",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a40312e6213144fb341d5196de1b84b80eace224",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8912182465111673616"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:05:03.849] Scheduled build:
{
"id": "8746752403208778833",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 32029,
"createdBy": "project:chromium",
"createTime": "2024-05-27T21:05:03.303209450Z",
"updateTime": "2024-05-27T21:05:03.303209450Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a40312e6213144fb341d5196de1b84b80eace224",
"ref": "refs/heads/main"
}
}
}
[21:05:03.849] Task URL: https://cr-buildbucket.appspot.com/build/8746752403208778833
[21:05:03.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:2:0) after 2m45s
[21:05:04.741] Received PubSub notification, asking Buildbucket for the build status
[21:05:04.795] Build status: SCHEDULED
[21:05:08.035] Received PubSub notification, asking Buildbucket for the build status
[21:05:08.062] Build status: STARTED
[21:07:48.865] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:2:0)
[21:07:48.882] Build status: STARTED
[21:07:48.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:5:0) after 2m36s
[21:10:24.862] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:5:0)
[21:10:24.884] Build status: STARTED
[21:10:24.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:6:0) after 4m11s
[21:14:35.934] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:6:0)
[21:14:35.952] Build status: STARTED
[21:14:35.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:7:0) after 4m16s
[21:18:51.982] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:7:0)
[21:18:51.998] Build status: STARTED
[21:18:51.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:8:0) after 1m58s
[21:20:50.028] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:8:0)
[21:20:50.058] Build status: STARTED
[21:20:50.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:9:0) after 4m15s
[21:25:05.163] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:9:0)
[21:25:05.184] Build status: STARTED
[21:25:05.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:10:0) after 5m31s
[21:30:36.200] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:10:0)
[21:30:36.225] Build status: STARTED
[21:30:36.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:11:0) after 8m57s
[21:39:33.243] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:11:0)
[21:39:33.261] Build status: STARTED
[21:39:33.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:12:0) after 5m31s
[21:45:04.274] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:12:0)
[21:45:04.293] Build status: STARTED
[21:45:04.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:13:0) after 4m22s
[21:49:26.317] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:13:0)
[21:49:26.345] Build status: STARTED
[21:49:26.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:14:0) after 1m17s
[21:50:43.368] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:14:0)
[21:50:43.397] Build status: STARTED
[21:50:43.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:15:0) after 5m59s
[21:56:42.529] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:15:0)
[21:56:42.556] Build status: STARTED
[21:56:42.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:16:0) after 1m9s
[21:57:51.696] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:16:0)
[21:57:51.720] Build status: STARTED
[21:57:51.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:17:0) after 5m47s
[22:03:38.737] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:17:0)
[22:03:38.753] Build status: STARTED
[22:03:38.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:18:0) after 8m52s
[22:12:30.820] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:18:0)
[22:12:30.837] Build status: STARTED
[22:12:30.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:19:0) after 3m32s
[22:16:02.853] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:19:0)
[22:16:02.880] Build status: STARTED
[22:16:02.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:20:0) after 1m29s
[22:17:31.979] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:20:0)
[22:17:32.007] Build status: STARTED
[22:17:32.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:21:0) after 9m37s
[22:27:09.162] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:21:0)
[22:27:09.177] Build status: STARTED
[22:27:09.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:22:0) after 8m47s
[22:35:56.216] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:22:0)
[22:35:56.246] Build status: STARTED
[22:35:56.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:23:0) after 7m29s
[22:43:25.268] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:23:0)
[22:43:25.300] Build status: STARTED
[22:43:25.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:24:0) after 2m42s
[22:46:07.484] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:24:0)
[22:46:07.500] Build status: STARTED
[22:46:07.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:25:0) after 5m20s
[22:51:27.517] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:25:0)
[22:51:27.534] Build status: STARTED
[22:51:27.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:26:0) after 3m46s
[22:55:13.642] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:26:0)
[22:55:13.661] Build status: STARTED
[22:55:13.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:27:0) after 6m35s
[23:01:48.742] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:27:0)
[23:01:48.790] Build status: STARTED
[23:01:48.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:28:0) after 7m47s
[23:09:35.908] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:28:0)
[23:09:35.942] Build status: STARTED
[23:09:35.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:29:0) after 8m13s
[23:17:48.943] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:29:0)
[23:17:48.962] Build status: STARTED
[23:17:48.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:30:0) after 4m13s
[23:22:02.188] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:30:0)
[23:22:02.205] Build status: STARTED
[23:22:02.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:31:0) after 4m32s
[23:26:34.254] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:31:0)
[23:26:34.283] Build status: STARTED
[23:26:34.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:32:0) after 7m4s
[23:33:38.565] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:32:0)
[23:33:38.590] Build status: STARTED
[23:33:38.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:33:0) after 4m6s
[23:37:44.612] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:33:0)
[23:37:44.633] Build status: STARTED
[23:37:44.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:34:0) after 9m0s
[23:46:44.650] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:34:0)
[23:46:44.685] Build status: STARTED
[23:46:44.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:35:0) after 9m45s
[23:56:29.704] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:35:0)
[23:56:29.721] Build status: STARTED
[23:56:29.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:36:0) after 1m40s
[23:58:09.773] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:36:0)
[23:58:09.791] Build status: STARTED
[23:58:09.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:37:0) after 3m47s
[00:01:56.807] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:37:0)
[00:01:56.827] Build status: STARTED
[00:01:56.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:38:0) after 9m52s
[00:11:48.938] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:38:0)
[00:11:48.987] Build status: STARTED
[00:11:48.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:39:0) after 9m46s
[00:21:35.001] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:39:0)
[00:21:35.020] Build status: STARTED
[00:21:35.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:40:0) after 6m55s
[00:28:30.135] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:40:0)
[00:28:30.152] Build status: STARTED
[00:28:30.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:41:0) after 7m31s
[00:36:01.276] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:41:0)
[00:36:01.296] Build status: STARTED
[00:36:01.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:42:0) after 3m22s
[00:39:23.351] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:42:0)
[00:39:23.369] Build status: STARTED
[00:39:23.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:43:0) after 1m12s
[00:40:35.459] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:43:0)
[00:40:35.505] Build status: STARTED
[00:40:35.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:44:0) after 8m52s
[00:49:27.659] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:44:0)
[00:49:27.677] Build status: STARTED
[00:49:27.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:45:0) after 3m18s
[00:52:45.858] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:45:0)
[00:52:45.878] Build status: STARTED
[00:52:45.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:46:0) after 9m19s
[01:02:05.068] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:46:0)
[01:02:05.086] Build status: STARTED
[01:02:05.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:47:0) after 3m44s
[01:05:49.343] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:47:0)
[01:05:49.365] Build status: STARTED
[01:05:49.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:48:0) after 4m57s
[01:10:46.615] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:48:0)
[01:10:46.635] Build status: STARTED
[01:10:46.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:49:0) after 1m55s
[01:12:42.052] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:49:0)
[01:12:42.071] Build status: STARTED
[01:12:42.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:50:0) after 3m24s
[01:16:06.295] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:50:0)
[01:16:06.315] Build status: STARTED
[01:16:06.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:51:0) after 2m54s
[01:19:00.502] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:51:0)
[01:19:00.521] Build status: STARTED
[01:19:00.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:52:0) after 4m17s
[01:23:17.643] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:52:0)
[01:23:17.729] Build status: STARTED
[01:23:17.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:53:0) after 3m57s
[01:27:14.913] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:53:0)
[01:27:14.929] Build status: STARTED
[01:27:14.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:54:0) after 2m47s
[01:30:01.948] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:54:0)
[01:30:01.968] Build status: STARTED
[01:30:01.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:55:0) after 1m44s
[01:31:46.037] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:55:0)
[01:31:46.065] Build status: STARTED
[01:31:46.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:56:0) after 5m53s
[01:37:39.185] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:56:0)
[01:37:39.203] Build status: STARTED
[01:37:39.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:57:0) after 8m8s
[01:45:47.441] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:57:0)
[01:45:47.462] Build status: STARTED
[01:45:47.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:58:0) after 7m23s
[01:53:10.534] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:58:0)
[01:53:10.552] Build status: STARTED
[01:53:10.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:59:0) after 9m26s
[02:02:36.610] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:59:0)
[02:02:36.629] Build status: STARTED
[02:02:36.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:60:0) after 2m3s
[02:04:39.680] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:60:0)
[02:04:39.718] Build status: STARTED
[02:04:39.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:61:0) after 9m48s
[02:14:27.738] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:61:0)
[02:14:27.753] Build status: STARTED
[02:14:27.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:62:0) after 3m41s
[02:18:08.865] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:62:0)
[02:18:08.885] Build status: STARTED
[02:18:08.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:63:0) after 9m17s
[02:27:25.999] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:63:0)
[02:27:26.018] Build status: STARTED
[02:27:26.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:64:0) after 5m34s
[02:33:00.040] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:64:0)
[02:33:00.064] Build status: STARTED
[02:33:00.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:65:0) after 3m49s
[02:36:49.394] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:65:0)
[02:36:49.444] Build status: STARTED
[02:36:49.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:66:0) after 3m2s
[02:39:51.463] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:66:0)
[02:39:51.489] Build status: STARTED
[02:39:51.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:67:0) after 6m47s
[02:46:38.502] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:67:0)
[02:46:38.524] Build status: STARTED
[02:46:38.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:68:0) after 3m7s
[02:49:45.571] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:68:0)
[02:49:45.588] Build status: STARTED
[02:49:45.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:69:0) after 2m12s
[02:51:57.605] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:69:0)
[02:51:57.620] Build status: STARTED
[02:51:57.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:70:0) after 5m29s
[02:57:26.642] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:70:0)
[02:57:26.660] Build status: STARTED
[02:57:26.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:71:0) after 2m43s
[03:00:09.688] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:71:0)
[03:00:09.717] Build status: STARTED
[03:00:09.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:72:0) after 7m18s
[03:07:27.741] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:72:0)
[03:07:27.762] Build status: STARTED
[03:07:27.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8912182465111673616:73:0) after 8m49s
[03:09:51.073] Received PubSub notification, asking Buildbucket for the build status
[03:09:51.093] Build:
{
"id": "8746752403208778833",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 32029,
"createdBy": "project:chromium",
"createTime": "2024-05-27T21:05:03.303209450Z",
"startTime": "2024-05-27T21:05:07.831541234Z",
"endTime": "2024-05-28T03:09:50.670368642Z",
"updateTime": "2024-05-28T03:09:50.670368642Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a40312e6213144fb341d5196de1b84b80eace224",
"ref": "refs/heads/main"
}
}
}
[03:09:51.093] Invocation finished in 6h4m48.9891532s with status FAILED