[02:41:55.735] New invocation is queued and will start shortly
[02:41:56.877] Starting the invocation (attempt 1)
[02:41:56.932] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/ff10d8b4fd8e9a5d658c98beb2e68e50b85eb5ad"
[02:41:56.932] Popped gitiles commit info from properties and tags
[02:41:56.932] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:41:56.933] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:41:56.933] Buildbucket request:
{
"requestId": "9007559875231628976",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ff10d8b4fd8e9a5d658c98beb2e68e50b85eb5ad",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9007559875231628976"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTAndroid"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:41:57.561] Scheduled build:
{
"id": "8842129813198109312",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid"
},
"number": 16964,
"createdBy": "project:chromium",
"createTime": "2021-07-10T02:41:57.030670Z",
"updateTime": "2021-07-10T02:41:57.486256Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ff10d8b4fd8e9a5d658c98beb2e68e50b85eb5ad",
"ref": "refs/heads/main"
}
}
}
[02:41:57.561] Task URL: https://cr-buildbucket.appspot.com/build/8842129813198109312
[02:41:57.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:2:0) after 3m8s
[02:42:41.501] Received PubSub notification, asking Buildbucket for the build status
[02:42:41.557] Build status: STARTED
[02:45:05.581] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:2:0)
[02:45:05.676] Build status: STARTED
[02:45:05.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:4:0) after 4m10s
[02:49:15.817] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:4:0)
[02:49:15.846] Build status: STARTED
[02:49:15.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:5:0) after 4m7s
[02:53:22.869] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:5:0)
[02:53:22.980] Build status: STARTED
[02:53:22.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:6:0) after 1m25s
[02:54:48.004] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:6:0)
[02:54:48.068] Build status: STARTED
[02:54:48.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:7:0) after 3m39s
[02:58:27.287] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:7:0)
[02:58:27.328] Build status: STARTED
[02:58:27.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:8:0) after 1m44s
[03:00:11.605] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:8:0)
[03:00:11.642] Build status: STARTED
[03:00:11.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:9:0) after 3m5s
[03:03:16.676] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:9:0)
[03:03:16.704] Build status: STARTED
[03:03:16.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:10:0) after 7m22s
[03:10:38.859] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:10:0)
[03:10:38.960] Build status: STARTED
[03:10:38.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:11:0) after 2m42s
[03:13:20.960] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:11:0)
[03:13:20.991] Build status: STARTED
[03:13:20.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:12:0) after 9m59s
[03:23:20.071] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:12:0)
[03:23:20.099] Build status: STARTED
[03:23:20.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:13:0) after 8m39s
[03:31:59.123] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:13:0)
[03:31:59.157] Build status: STARTED
[03:31:59.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:14:0) after 6m27s
[03:38:26.156] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:14:0)
[03:38:26.185] Build status: STARTED
[03:38:26.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:15:0) after 7m50s
[03:46:16.207] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:15:0)
[03:46:16.238] Build status: STARTED
[03:46:16.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:16:0) after 9m23s
[03:55:39.286] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:16:0)
[03:55:39.315] Build status: STARTED
[03:55:39.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:17:0) after 1m26s
[03:57:05.338] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:17:0)
[03:57:05.366] Build status: STARTED
[03:57:05.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:18:0) after 6m56s
[04:04:01.437] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:18:0)
[04:04:01.466] Build status: STARTED
[04:04:01.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:19:0) after 2m55s
[04:06:56.486] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:19:0)
[04:06:56.517] Build status: STARTED
[04:06:56.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:20:0) after 7m46s
[04:14:42.535] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:20:0)
[04:14:42.569] Build status: STARTED
[04:14:42.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:21:0) after 3m59s
[04:18:41.833] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:21:0)
[04:18:41.901] Build status: STARTED
[04:18:41.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:22:0) after 6m32s
[04:25:14.096] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:22:0)
[04:25:14.127] Build status: STARTED
[04:25:14.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:23:0) after 4m10s
[04:29:24.178] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:23:0)
[04:29:24.207] Build status: STARTED
[04:29:24.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:24:0) after 8m19s
[04:37:43.232] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:24:0)
[04:37:43.259] Build status: STARTED
[04:37:43.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:25:0) after 6m59s
[04:44:42.277] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:25:0)
[04:44:42.314] Build status: STARTED
[04:44:42.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:26:0) after 6m9s
[04:50:51.376] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:26:0)
[04:50:51.406] Build status: STARTED
[04:50:51.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:27:0) after 2m55s
[04:53:46.394] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:27:0)
[04:53:46.425] Build status: STARTED
[04:53:46.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:28:0) after 7m33s
[05:01:19.464] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:28:0)
[05:01:19.497] Build status: STARTED
[05:01:19.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:29:0) after 5m19s
[05:06:38.531] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:29:0)
[05:06:38.571] Build status: STARTED
[05:06:38.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:30:0) after 1m40s
[05:08:19.181] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:30:0)
[05:08:19.211] Build status: STARTED
[05:08:19.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:31:0) after 7m6s
[05:15:25.239] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:31:0)
[05:15:25.269] Build status: STARTED
[05:15:25.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:32:0) after 5m26s
[05:20:51.296] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:32:0)
[05:20:51.326] Build status: STARTED
[05:20:51.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:33:0) after 5m32s
[05:26:23.696] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:33:0)
[05:26:23.730] Build status: STARTED
[05:26:23.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:34:0) after 2m44s
[05:29:07.872] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:34:0)
[05:29:07.900] Build status: STARTED
[05:29:07.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:35:0) after 1m7s
[05:30:15.375] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:35:0)
[05:30:15.411] Build status: STARTED
[05:30:15.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:36:0) after 9m33s
[05:39:48.432] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:36:0)
[05:39:48.458] Build status: STARTED
[05:39:48.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:37:0) after 1m26s
[05:41:14.479] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:37:0)
[05:41:14.506] Build status: STARTED
[05:41:14.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:38:0) after 8m41s
[05:49:55.642] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:38:0)
[05:49:55.669] Build status: STARTED
[05:49:55.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:39:0) after 8m20s
[05:58:15.704] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:39:0)
[05:58:16.132] Build status: STARTED
[05:58:16.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:40:0) after 4m32s
[06:02:48.159] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:40:0)
[06:02:48.191] Build status: STARTED
[06:02:48.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:41:0) after 3m43s
[06:06:31.228] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:41:0)
[06:06:31.260] Build status: STARTED
[06:06:31.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:42:0) after 7m55s
[06:14:26.481] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:42:0)
[06:14:26.511] Build status: STARTED
[06:14:26.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:43:0) after 1m3s
[06:15:30.004] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:43:0)
[06:15:30.035] Build status: STARTED
[06:15:30.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:44:0) after 3m33s
[06:19:03.259] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:44:0)
[06:19:03.306] Build status: STARTED
[06:19:03.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:45:0) after 6m58s
[06:26:01.875] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:45:0)
[06:26:01.973] Build status: STARTED
[06:26:01.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:46:0) after 9m22s
[06:35:24.016] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:46:0)
[06:35:24.066] Build status: STARTED
[06:35:24.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:47:0) after 1m56s
[06:37:20.054] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:47:0)
[06:37:20.085] Build status: STARTED
[06:37:20.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:48:0) after 1m55s
[06:39:15.292] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:48:0)
[06:39:15.323] Build status: STARTED
[06:39:15.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:49:0) after 8m13s
[06:47:28.345] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:49:0)
[06:47:28.379] Build status: STARTED
[06:47:28.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:50:0) after 7m15s
[06:54:43.395] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:50:0)
[06:54:43.437] Build status: STARTED
[06:54:43.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:51:0) after 4m51s
[06:59:34.861] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:51:0)
[06:59:34.900] Build status: STARTED
[06:59:34.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:52:0) after 2m17s
[07:01:51.920] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:52:0)
[07:01:51.952] Build status: STARTED
[07:01:51.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:53:0) after 8m47s
[07:10:39.131] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:53:0)
[07:10:39.179] Build status: STARTED
[07:10:39.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:54:0) after 8m53s
[07:19:32.208] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:54:0)
[07:19:32.248] Build status: STARTED
[07:19:32.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:55:0) after 6m52s
[07:26:24.272] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:55:0)
[07:26:24.303] Build status: STARTED
[07:26:24.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:56:0) after 4m28s
[07:30:52.328] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:56:0)
[07:30:52.375] Build status: STARTED
[07:30:52.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:57:0) after 2m41s
[07:33:33.407] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:57:0)
[07:33:33.463] Build status: STARTED
[07:33:33.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:58:0) after 4m14s
[07:37:47.485] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:58:0)
[07:37:47.525] Build status: STARTED
[07:37:47.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:59:0) after 4m31s
[07:42:18.648] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:59:0)
[07:42:18.682] Build status: STARTED
[07:42:18.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:60:0) after 5m34s
[07:47:52.900] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:60:0)
[07:47:52.931] Build status: STARTED
[07:47:52.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:61:0) after 2m19s
[07:50:11.955] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:61:0)
[07:50:11.988] Build status: STARTED
[07:50:11.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:62:0) after 5m14s
[07:55:26.046] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:62:0)
[07:55:26.171] Build status: STARTED
[07:55:26.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:63:0) after 6m23s
[08:01:49.406] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:63:0)
[08:01:49.434] Build status: STARTED
[08:01:49.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:64:0) after 5m57s
[08:07:46.620] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:64:0)
[08:07:46.647] Build status: STARTED
[08:07:46.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:65:0) after 6m25s
[08:14:11.693] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:65:0)
[08:14:11.732] Build status: STARTED
[08:14:11.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:66:0) after 6m47s
[08:20:58.756] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:66:0)
[08:20:58.786] Build status: STARTED
[08:20:58.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroid:9007559875231628976:67:0) after 9m42s
[08:28:31.924] Received PubSub notification, asking Buildbucket for the build status
[08:28:32.058] Build:
{
"id": "8842129813198109312",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroid"
},
"number": 16964,
"createdBy": "project:chromium",
"createTime": "2021-07-10T02:41:57.030670Z",
"startTime": "2021-07-10T02:42:40.941340Z",
"endTime": "2021-07-10T08:28:31.436529886Z",
"updateTime": "2021-07-10T08:28:31.437185017Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ff10d8b4fd8e9a5d658c98beb2e68e50b85eb5ad",
"ref": "refs/heads/main"
}
}
}
[08:28:32.058] Invocation finished in 5h46m36.350468998s with status FAILED