[09:35:42.120] New invocation is queued and will start shortly
[09:35:43.302] Starting the invocation (attempt 1)
[09:35:43.356] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e3cd7f4a88e61ab440391aaf5f5786a3ad77e792"
[09:35:43.356] Popped gitiles commit info from properties and tags
[09:35:43.356] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:35:43.364] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:35:43.365] Buildbucket request:
{
"requestId": "8932247763781885376",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid x64"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e3cd7f4a88e61ab440391aaf5f5786a3ad77e792",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8932247763781885376"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTAndroid x64"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:35:43.961] Scheduled build:
{
"id": "8766817701728421185",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid x64"
},
"number": 19245,
"createdBy": "project:chromium",
"createTime": "2023-10-19T09:35:43.453347145Z",
"updateTime": "2023-10-19T09:35:43.453347145Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e3cd7f4a88e61ab440391aaf5f5786a3ad77e792",
"ref": "refs/heads/main"
}
}
}
[09:35:43.961] Task URL: https://cr-buildbucket.appspot.com/build/8766817701728421185
[09:35:43.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:2:0) after 2m44s
[09:35:44.910] Received PubSub notification, asking Buildbucket for the build status
[09:35:44.931] Build status: SCHEDULED
[09:37:46.369] Received PubSub notification, asking Buildbucket for the build status
[09:37:46.384] Build status: STARTED
[09:38:28.010] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:2:0)
[09:38:28.033] Build status: STARTED
[09:38:28.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:5:0) after 7m33s
[09:46:01.217] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:5:0)
[09:46:01.238] Build status: STARTED
[09:46:01.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:6:0) after 2m23s
[09:48:24.255] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:6:0)
[09:48:24.283] Build status: STARTED
[09:48:24.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:7:0) after 7m53s
[09:56:17.347] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:7:0)
[09:56:17.439] Build status: STARTED
[09:56:17.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:8:0) after 3m56s
[10:00:13.513] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:8:0)
[10:00:13.578] Build status: STARTED
[10:00:13.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:9:0) after 8m12s
[10:08:25.664] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:9:0)
[10:08:25.717] Build status: STARTED
[10:08:25.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:10:0) after 5m1s
[10:13:26.745] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:10:0)
[10:13:26.768] Build status: STARTED
[10:13:26.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:11:0) after 1m38s
[10:15:04.850] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:11:0)
[10:15:04.954] Build status: STARTED
[10:15:04.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:12:0) after 1m26s
[10:16:30.982] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:12:0)
[10:16:31.004] Build status: STARTED
[10:16:31.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:13:0) after 9m13s
[10:25:44.032] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:13:0)
[10:25:44.052] Build status: STARTED
[10:25:44.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:14:0) after 9m23s
[10:35:07.292] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:14:0)
[10:35:07.311] Build status: STARTED
[10:35:07.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:15:0) after 1m20s
[10:36:27.315] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:15:0)
[10:36:27.340] Build status: STARTED
[10:36:27.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:16:0) after 4m6s
[10:40:34.091] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:16:0)
[10:40:34.175] Build status: STARTED
[10:40:34.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:17:0) after 1m47s
[10:42:21.908] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:17:0)
[10:42:21.938] Build status: STARTED
[10:42:21.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:18:0) after 2m26s
[10:44:48.154] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:18:0)
[10:44:48.228] Build status: STARTED
[10:44:48.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:19:0) after 7m33s
[10:52:21.225] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:19:0)
[10:52:21.249] Build status: STARTED
[10:52:21.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:20:0) after 7m4s
[10:59:25.273] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:20:0)
[10:59:25.292] Build status: STARTED
[10:59:25.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:21:0) after 5m46s
[11:05:11.351] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:21:0)
[11:05:11.386] Build status: STARTED
[11:05:11.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:22:0) after 2m18s
[11:07:29.484] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:22:0)
[11:07:29.540] Build status: STARTED
[11:07:29.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:23:0) after 9m34s
[11:17:03.568] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:23:0)
[11:17:03.608] Build status: STARTED
[11:17:03.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:24:0) after 8m22s
[11:25:25.816] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:24:0)
[11:25:25.836] Build status: STARTED
[11:25:25.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:25:0) after 2m53s
[11:28:19.425] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:25:0)
[11:28:19.446] Build status: STARTED
[11:28:19.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:26:0) after 1m12s
[11:29:31.468] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:26:0)
[11:29:31.491] Build status: STARTED
[11:29:31.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:27:0) after 5m27s
[11:34:58.804] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:27:0)
[11:34:58.839] Build status: STARTED
[11:34:58.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:28:0) after 7m46s
[11:42:44.926] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:28:0)
[11:42:44.953] Build status: STARTED
[11:42:44.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:29:0) after 3m53s
[11:46:39.309] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:29:0)
[11:46:39.332] Build status: STARTED
[11:46:39.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:30:0) after 2m48s
[11:49:27.460] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:30:0)
[11:49:27.481] Build status: STARTED
[11:49:27.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:31:0) after 6m29s
[11:55:56.503] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:31:0)
[11:55:56.524] Build status: STARTED
[11:55:56.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:32:0) after 9m18s
[12:05:14.528] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:32:0)
[12:05:14.553] Build status: STARTED
[12:05:14.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:33:0) after 5m0s
[12:10:14.573] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:33:0)
[12:10:14.605] Build status: STARTED
[12:10:14.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:34:0) after 1m22s
[12:11:36.647] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:34:0)
[12:11:36.689] Build status: STARTED
[12:11:36.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:35:0) after 3m3s
[12:14:39.714] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:35:0)
[12:14:39.734] Build status: STARTED
[12:14:39.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:36:0) after 3m28s
[12:18:07.764] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:36:0)
[12:18:07.786] Build status: STARTED
[12:18:07.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:37:0) after 2m35s
[12:20:42.865] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:37:0)
[12:20:42.958] Build status: STARTED
[12:20:42.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:38:0) after 4m41s
[12:25:23.984] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:38:0)
[12:25:24.013] Build status: STARTED
[12:25:24.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:39:0) after 9m45s
[12:35:09.062] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:39:0)
[12:35:09.216] Build status: STARTED
[12:35:09.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:40:0) after 3m48s
[12:38:57.271] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:40:0)
[12:38:57.294] Build status: STARTED
[12:38:57.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:41:0) after 1m37s
[12:40:34.349] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:41:0)
[12:40:34.391] Build status: STARTED
[12:40:34.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:42:0) after 9m19s
[12:49:53.461] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:42:0)
[12:49:53.494] Build status: STARTED
[12:49:53.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:43:0) after 2m22s
[12:52:15.638] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:43:0)
[12:52:15.677] Build status: STARTED
[12:52:15.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:44:0) after 8m20s
[13:00:35.923] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:44:0)
[13:00:35.958] Build status: STARTED
[13:00:35.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:45:0) after 2m56s
[13:03:32.417] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:45:0)
[13:03:32.546] Build status: STARTED
[13:03:32.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:46:0) after 4m32s
[13:08:04.627] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:46:0)
[13:08:04.643] Build status: STARTED
[13:08:04.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:47:0) after 3m7s
[13:11:11.960] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:47:0)
[13:11:12.044] Build status: STARTED
[13:11:12.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:48:0) after 2m55s
[13:14:07.220] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:48:0)
[13:14:07.259] Build status: STARTED
[13:14:07.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:49:0) after 8m14s
[13:22:21.579] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:49:0)
[13:22:21.598] Build status: STARTED
[13:22:21.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:50:0) after 7m36s
[13:29:57.627] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:50:0)
[13:29:57.650] Build status: STARTED
[13:29:57.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:51:0) after 3m15s
[13:33:12.881] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:51:0)
[13:33:12.921] Build status: STARTED
[13:33:12.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:52:0) after 1m13s
[13:34:26.051] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:52:0)
[13:34:26.084] Build status: STARTED
[13:34:26.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:53:0) after 4m45s
[13:39:12.352] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:53:0)
[13:39:12.371] Build status: STARTED
[13:39:12.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:54:0) after 1m40s
[13:40:52.953] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:54:0)
[13:40:53.032] Build status: STARTED
[13:40:53.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:55:0) after 6m25s
[13:47:18.395] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:55:0)
[13:47:18.439] Build status: STARTED
[13:47:18.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:56:0) after 5m8s
[13:52:26.458] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:56:0)
[13:52:26.475] Build status: STARTED
[13:52:26.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:57:0) after 1m0s
[13:53:26.555] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:57:0)
[13:53:26.714] Build status: STARTED
[13:53:26.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:58:0) after 9m28s
[14:02:55.303] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:58:0)
[14:02:55.333] Build status: STARTED
[14:02:55.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:59:0) after 4m42s
[14:07:37.668] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:59:0)
[14:07:37.687] Build status: STARTED
[14:07:37.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:60:0) after 7m30s
[14:15:07.949] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:60:0)
[14:15:08.038] Build status: STARTED
[14:15:08.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:61:0) after 2m21s
[14:17:29.060] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:61:0)
[14:17:29.125] Build status: STARTED
[14:17:29.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:62:0) after 4m18s
[14:21:47.259] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:62:0)
[14:21:47.337] Build status: STARTED
[14:21:47.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:63:0) after 7m54s
[14:29:41.678] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:63:0)
[14:29:41.695] Build status: STARTED
[14:29:41.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:64:0) after 8m58s
[14:38:40.263] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:64:0)
[14:38:40.281] Build status: STARTED
[14:38:40.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:65:0) after 4m7s
[14:42:47.409] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:65:0)
[14:42:47.431] Build status: STARTED
[14:42:47.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:66:0) after 7m49s
[14:50:36.597] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:66:0)
[14:50:36.621] Build status: STARTED
[14:50:36.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid x64:8932247763781885376:67:0) after 2m33s
[14:51:19.421] Received PubSub notification, asking Buildbucket for the build status
[14:51:19.440] Build:
{
"id": "8766817701728421185",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid x64"
},
"number": 19245,
"createdBy": "project:chromium",
"createTime": "2023-10-19T09:35:43.453347145Z",
"startTime": "2023-10-19T09:37:45.790545Z",
"endTime": "2023-10-19T14:51:19.171497573Z",
"updateTime": "2023-10-19T14:51:19.171497573Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e3cd7f4a88e61ab440391aaf5f5786a3ad77e792",
"ref": "refs/heads/main"
}
}
}
[14:51:19.440] Invocation finished in 5h15m37.327788086s with status FAILED