[12:02:34.609] New invocation is queued and will start shortly
[12:02:35.754] Starting the invocation (attempt 1)
[12:02:35.784] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/4b26486070aa6d786132bc43d9e49d1e63b26ffd"
[12:02:35.784] Popped gitiles commit info from properties and tags
[12:02:35.784] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[12:02:35.785] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[12:02:35.785] Buildbucket request:
{
"requestId": "8919736141851811072",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "android-mte-arm64-rel"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4b26486070aa6d786132bc43d9e49d1e63b26ffd",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8919736141851811072"
},
{
"key": "scheduler_job_id",
"value": "chromium/android-mte-arm64-rel"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[12:02:36.368] Scheduled build:
{
"id": "8754306079896359265",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "android-mte-arm64-rel"
},
"number": 203,
"createdBy": "project:chromium",
"createTime": "2024-03-05T12:02:35.851821392Z",
"updateTime": "2024-03-05T12:02:35.851821392Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4b26486070aa6d786132bc43d9e49d1e63b26ffd",
"ref": "refs/heads/main"
}
}
}
[12:02:36.368] Task URL: https://cr-buildbucket.appspot.com/build/8754306079896359265
[12:02:36.368] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:2:0) after 7m28s
[12:02:37.391] Received PubSub notification, asking Buildbucket for the build status
[12:02:37.479] Build status: SCHEDULED
[12:06:38.103] Received PubSub notification, asking Buildbucket for the build status
[12:06:38.130] Build status: STARTED
[12:10:04.540] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:2:0)
[12:10:04.562] Build status: STARTED
[12:10:04.562] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:5:0) after 8m1s
[12:18:05.727] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:5:0)
[12:18:05.767] Build status: STARTED
[12:18:05.767] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:6:0) after 9m46s
[12:27:51.973] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:6:0)
[12:27:52.058] Build status: STARTED
[12:27:52.059] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:7:0) after 8m14s
[12:36:06.567] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:7:0)
[12:36:06.589] Build status: STARTED
[12:36:06.589] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:8:0) after 4m12s
[12:40:18.691] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:8:0)
[12:40:18.720] Build status: STARTED
[12:40:18.720] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:9:0) after 5m9s
[12:45:27.723] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:9:0)
[12:45:27.748] Build status: STARTED
[12:45:27.748] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:10:0) after 3m31s
[12:48:58.772] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:10:0)
[12:48:58.801] Build status: STARTED
[12:48:58.801] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:11:0) after 3m7s
[12:52:05.921] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:11:0)
[12:52:05.999] Build status: STARTED
[12:52:05.999] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:12:0) after 2m58s
[12:55:04.288] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:12:0)
[12:55:04.323] Build status: STARTED
[12:55:04.323] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:13:0) after 7m54s
[13:02:58.844] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:13:0)
[13:02:58.884] Build status: STARTED
[13:02:58.884] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:14:0) after 6m23s
[13:09:22.035] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:14:0)
[13:09:22.067] Build status: STARTED
[13:09:22.067] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:15:0) after 4m36s
[13:13:58.113] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:15:0)
[13:13:58.134] Build status: STARTED
[13:13:58.134] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:16:0) after 1m13s
[13:15:11.356] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:16:0)
[13:15:11.513] Build status: STARTED
[13:15:11.513] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:17:0) after 5m17s
[13:20:28.552] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:17:0)
[13:20:28.590] Build status: STARTED
[13:20:28.590] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:18:0) after 1m44s
[13:22:13.195] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:18:0)
[13:22:13.276] Build status: STARTED
[13:22:13.276] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:19:0) after 4m37s
[13:26:50.603] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:19:0)
[13:26:50.630] Build status: STARTED
[13:26:50.630] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:20:0) after 2m49s
[13:29:39.931] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:20:0)
[13:29:39.962] Build status: STARTED
[13:29:39.962] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:21:0) after 3m39s
[13:33:19.097] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:21:0)
[13:33:19.141] Build status: STARTED
[13:33:19.141] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:22:0) after 2m50s
[13:36:09.175] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:22:0)
[13:36:09.200] Build status: STARTED
[13:36:09.200] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:23:0) after 7m36s
[13:43:45.531] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:23:0)
[13:43:45.552] Build status: STARTED
[13:43:45.552] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:24:0) after 5m6s
[13:48:51.589] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:24:0)
[13:48:51.609] Build status: STARTED
[13:48:51.609] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:25:0) after 5m14s
[13:54:05.632] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:25:0)
[13:54:05.658] Build status: STARTED
[13:54:05.658] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:26:0) after 5m28s
[13:59:33.796] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:26:0)
[13:59:33.824] Build status: STARTED
[13:59:33.824] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:27:0) after 5m58s
[14:05:31.900] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:27:0)
[14:05:31.929] Build status: STARTED
[14:05:31.929] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:28:0) after 1m51s
[14:07:22.983] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:28:0)
[14:07:23.020] Build status: STARTED
[14:07:23.020] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:29:0) after 2m53s
[14:10:16.066] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:29:0)
[14:10:16.096] Build status: STARTED
[14:10:16.097] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:30:0) after 9m59s
[14:20:15.132] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:30:0)
[14:20:15.152] Build status: STARTED
[14:20:15.152] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:31:0) after 7m0s
[14:27:15.182] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:31:0)
[14:27:15.200] Build status: STARTED
[14:27:15.200] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:32:0) after 9m16s
[14:36:31.236] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:32:0)
[14:36:31.268] Build status: STARTED
[14:36:31.268] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:33:0) after 5m34s
[14:42:05.404] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:33:0)
[14:42:05.426] Build status: STARTED
[14:42:05.426] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:34:0) after 9m22s
[14:51:27.461] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:34:0)
[14:51:27.479] Build status: STARTED
[14:51:27.479] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:35:0) after 4m51s
[14:56:18.653] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:35:0)
[14:56:18.689] Build status: STARTED
[14:56:18.689] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:36:0) after 1m46s
[14:58:04.716] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:36:0)
[14:58:04.742] Build status: STARTED
[14:58:04.742] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:37:0) after 9m9s
[15:07:14.067] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:37:0)
[15:07:14.168] Build status: STARTED
[15:07:14.168] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:38:0) after 8m12s
[15:15:26.462] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:38:0)
[15:15:26.500] Build status: STARTED
[15:15:26.500] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:39:0) after 4m27s
[15:19:53.935] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:39:0)
[15:19:54.074] Build status: STARTED
[15:19:54.074] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:40:0) after 4m42s
[15:24:36.108] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:40:0)
[15:24:36.345] Build status: STARTED
[15:24:36.345] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:41:0) after 4m7s
[15:28:43.368] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:41:0)
[15:28:43.386] Build status: STARTED
[15:28:43.386] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:42:0) after 3m34s
[15:32:17.411] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:42:0)
[15:32:17.567] Build status: STARTED
[15:32:17.567] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:43:0) after 1m23s
[15:33:40.592] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:43:0)
[15:33:40.626] Build status: STARTED
[15:33:40.626] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:44:0) after 6m52s
[15:40:32.744] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:44:0)
[15:40:32.785] Build status: STARTED
[15:40:32.785] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:45:0) after 1m10s
[15:41:42.807] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:45:0)
[15:41:42.832] Build status: STARTED
[15:41:42.832] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:46:0) after 2m28s
[15:44:10.997] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:46:0)
[15:44:11.019] Build status: STARTED
[15:44:11.019] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:47:0) after 4m12s
[15:48:23.188] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:47:0)
[15:48:23.234] Build status: STARTED
[15:48:23.234] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:48:0) after 9m38s
[15:58:01.299] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:48:0)
[15:58:01.323] Build status: STARTED
[15:58:01.323] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:49:0) after 6m15s
[16:04:16.356] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:49:0)
[16:04:16.385] Build status: STARTED
[16:04:16.385] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:50:0) after 2m23s
[16:06:39.425] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:50:0)
[16:06:39.495] Build status: STARTED
[16:06:39.496] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:51:0) after 1m57s
[16:08:36.517] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:51:0)
[16:08:36.547] Build status: STARTED
[16:08:36.547] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:52:0) after 7m1s
[16:15:37.724] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:52:0)
[16:15:37.745] Build status: STARTED
[16:15:37.746] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:53:0) after 6m33s
[16:22:10.800] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:53:0)
[16:22:10.852] Build status: STARTED
[16:22:10.852] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:54:0) after 8m23s
[16:30:33.932] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:54:0)
[16:30:33.959] Build status: STARTED
[16:30:33.960] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:55:0) after 1m38s
[16:32:12.030] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:55:0)
[16:32:12.048] Build status: STARTED
[16:32:12.048] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:56:0) after 6m13s
[16:38:25.037] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:56:0)
[16:38:25.063] Build status: STARTED
[16:38:25.063] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:57:0) after 7m16s
[16:45:41.089] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:57:0)
[16:45:41.118] Build status: STARTED
[16:45:41.118] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:58:0) after 4m50s
[16:50:31.110] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:58:0)
[16:50:31.130] Build status: STARTED
[16:50:31.130] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:59:0) after 8m4s
[16:58:35.262] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:59:0)
[16:58:35.292] Build status: STARTED
[16:58:35.292] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:60:0) after 3m44s
[17:02:19.418] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:60:0)
[17:02:19.496] Build status: STARTED
[17:02:19.496] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:61:0) after 5m45s
[17:08:04.523] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:61:0)
[17:08:04.607] Build status: STARTED
[17:08:04.607] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:62:0) after 7m51s
[17:15:55.699] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:62:0)
[17:15:55.720] Build status: STARTED
[17:15:55.720] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:63:0) after 8m38s
[17:24:33.763] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:63:0)
[17:24:33.782] Build status: STARTED
[17:24:33.782] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8919736141851811072:64:0) after 6m1s
[17:25:35.209] Received PubSub notification, asking Buildbucket for the build status
[17:25:35.231] Build:
{
"id": "8754306079896359265",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "android-mte-arm64-rel"
},
"number": 203,
"createdBy": "project:chromium",
"createTime": "2024-03-05T12:02:35.851821392Z",
"startTime": "2024-03-05T12:06:36.794243Z",
"endTime": "2024-03-05T17:25:33.551113Z",
"updateTime": "2024-03-05T17:25:33.551113Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4b26486070aa6d786132bc43d9e49d1e63b26ffd",
"ref": "refs/heads/main"
}
}
}
[17:25:35.231] Invocation finished in 5h23m0.627740665s with status FAILED