[01:59:08.252] New invocation is queued and will start shortly
[01:59:09.553] Starting the invocation (attempt 1)
[01:59:09.600] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f9c6ece39b8bf10fcaa05413f1ab64f964dda521"
[01:59:09.600] Popped gitiles commit info from properties and tags
[01:59:09.600] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:59:09.600] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:59:09.600] Buildbucket request:
{
"requestId": "9005750628139162672",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f9c6ece39b8bf10fcaa05413f1ab64f964dda521",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9005750628139162672"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:59:10.148] Scheduled build:
{
"id": "8840320565891078880",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22852,
"createdBy": "project:chromium",
"createTime": "2021-07-30T01:59:09.719227Z",
"updateTime": "2021-07-30T01:59:10.080823Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f9c6ece39b8bf10fcaa05413f1ab64f964dda521",
"ref": "refs/heads/main"
}
}
}
[01:59:10.148] Task URL: https://cr-buildbucket.appspot.com/build/8840320565891078880
[01:59:10.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:2:0) after 3m59s
[02:01:45.838] Received PubSub notification, asking Buildbucket for the build status
[02:01:45.865] Build status: STARTED
[02:03:09.510] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:2:0)
[02:03:09.540] Build status: STARTED
[02:03:09.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:4:0) after 5m21s
[02:08:30.576] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:4:0)
[02:08:30.751] Build status: STARTED
[02:08:30.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:5:0) after 9m33s
[02:18:03.957] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:5:0)
[02:18:03.987] Build status: STARTED
[02:18:03.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:6:0) after 8m41s
[02:26:45.019] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:6:0)
[02:26:45.061] Build status: STARTED
[02:26:45.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:7:0) after 4m48s
[02:31:33.157] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:7:0)
[02:31:33.184] Build status: STARTED
[02:31:33.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:8:0) after 6m23s
[02:37:56.208] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:8:0)
[02:37:56.242] Build status: STARTED
[02:37:56.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:9:0) after 1m22s
[02:39:18.744] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:9:0)
[02:39:18.858] Build status: STARTED
[02:39:18.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:10:0) after 7m35s
[02:46:53.901] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:10:0)
[02:46:53.946] Build status: STARTED
[02:46:53.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:11:0) after 3m11s
[02:50:05.110] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:11:0)
[02:50:05.137] Build status: STARTED
[02:50:05.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:12:0) after 3m38s
[02:53:43.295] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:12:0)
[02:53:43.420] Build status: STARTED
[02:53:43.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:13:0) after 4m20s
[02:58:03.625] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:13:0)
[02:58:03.692] Build status: STARTED
[02:58:03.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:14:0) after 6m56s
[03:04:59.715] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:14:0)
[03:04:59.763] Build status: STARTED
[03:04:59.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:15:0) after 3m10s
[03:08:09.860] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:15:0)
[03:08:09.887] Build status: STARTED
[03:08:09.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:16:0) after 5m58s
[03:14:07.914] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:16:0)
[03:14:07.945] Build status: STARTED
[03:14:07.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:17:0) after 2m59s
[03:17:07.052] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:17:0)
[03:17:07.088] Build status: STARTED
[03:17:07.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:18:0) after 7m21s
[03:24:28.138] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:18:0)
[03:24:28.169] Build status: STARTED
[03:24:28.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:19:0) after 1m34s
[03:26:02.208] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:19:0)
[03:26:02.275] Build status: STARTED
[03:26:02.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:20:0) after 2m12s
[03:28:14.353] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:20:0)
[03:28:14.391] Build status: STARTED
[03:28:14.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:21:0) after 7m10s
[03:35:24.496] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:21:0)
[03:35:24.574] Build status: STARTED
[03:35:24.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:22:0) after 7m3s
[03:42:27.891] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:22:0)
[03:42:27.959] Build status: STARTED
[03:42:27.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:23:0) after 3m43s
[03:46:11.085] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:23:0)
[03:46:11.124] Build status: STARTED
[03:46:11.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:24:0) after 3m41s
[03:49:52.151] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:24:0)
[03:49:52.181] Build status: STARTED
[03:49:52.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:25:0) after 7m46s
[03:57:38.286] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:25:0)
[03:57:38.314] Build status: STARTED
[03:57:38.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:26:0) after 3m29s
[04:01:07.344] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:26:0)
[04:01:07.377] Build status: STARTED
[04:01:07.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:27:0) after 2m48s
[04:03:55.412] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:27:0)
[04:03:55.464] Build status: STARTED
[04:03:55.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:28:0) after 3m10s
[04:07:05.511] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:28:0)
[04:07:05.565] Build status: STARTED
[04:07:05.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:29:0) after 9m27s
[04:16:32.565] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:29:0)
[04:16:32.597] Build status: STARTED
[04:16:32.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:30:0) after 8m47s
[04:25:19.680] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:30:0)
[04:25:19.722] Build status: STARTED
[04:25:19.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:31:0) after 9m1s
[04:34:20.801] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:31:0)
[04:34:20.831] Build status: STARTED
[04:34:20.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:32:0) after 6m51s
[04:41:11.855] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:32:0)
[04:41:11.892] Build status: STARTED
[04:41:11.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:33:0) after 1m35s
[04:42:46.930] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:33:0)
[04:42:46.965] Build status: STARTED
[04:42:46.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:34:0) after 5m55s
[04:48:41.987] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:34:0)
[04:48:42.013] Build status: STARTED
[04:48:42.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:35:0) after 4m59s
[04:53:41.037] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:35:0)
[04:53:41.062] Build status: STARTED
[04:53:41.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:36:0) after 2m31s
[04:56:12.083] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:36:0)
[04:56:12.113] Build status: STARTED
[04:56:12.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:37:0) after 9m0s
[05:05:12.135] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:37:0)
[05:05:12.167] Build status: STARTED
[05:05:12.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:38:0) after 4m44s
[05:09:56.289] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:38:0)
[05:09:56.323] Build status: STARTED
[05:09:56.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:39:0) after 5m19s
[05:15:15.716] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:39:0)
[05:15:15.797] Build status: STARTED
[05:15:15.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:40:0) after 2m48s
[05:18:03.824] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:40:0)
[05:18:03.852] Build status: STARTED
[05:18:03.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:41:0) after 8m12s
[05:26:15.884] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:41:0)
[05:26:15.940] Build status: STARTED
[05:26:15.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:42:0) after 9m4s
[05:35:20.009] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:42:0)
[05:35:20.056] Build status: STARTED
[05:35:20.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:43:0) after 8m26s
[05:43:46.102] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:43:0)
[05:43:46.151] Build status: STARTED
[05:43:46.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:44:0) after 6m56s
[05:50:42.288] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:44:0)
[05:50:42.316] Build status: STARTED
[05:50:42.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:45:0) after 2m0s
[05:52:42.576] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:45:0)
[05:52:42.601] Build status: STARTED
[05:52:42.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:46:0) after 4m19s
[05:57:01.624] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:46:0)
[05:57:01.652] Build status: STARTED
[05:57:01.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:47:0) after 7m34s
[06:04:35.706] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:47:0)
[06:04:35.738] Build status: STARTED
[06:04:35.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:48:0) after 3m42s
[06:08:17.769] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:48:0)
[06:08:17.799] Build status: STARTED
[06:08:17.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:49:0) after 5m19s
[06:13:37.053] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:49:0)
[06:13:37.088] Build status: STARTED
[06:13:37.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:50:0) after 5m42s
[06:19:19.319] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:50:0)
[06:19:19.350] Build status: STARTED
[06:19:19.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:51:0) after 7m31s
[06:26:50.419] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:51:0)
[06:26:50.473] Build status: STARTED
[06:26:50.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:52:0) after 7m38s
[06:34:28.535] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:52:0)
[06:34:28.577] Build status: STARTED
[06:34:28.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:53:0) after 5m30s
[06:39:58.607] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:53:0)
[06:39:58.863] Build status: STARTED
[06:39:58.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:54:0) after 8m26s
[06:48:24.893] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:54:0)
[06:48:24.931] Build status: STARTED
[06:48:24.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:55:0) after 2m7s
[06:50:31.990] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:55:0)
[06:50:32.146] Build status: STARTED
[06:50:32.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:56:0) after 2m58s
[06:53:30.484] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:56:0)
[06:53:30.527] Build status: STARTED
[06:53:30.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:57:0) after 2m4s
[06:55:34.567] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:57:0)
[06:55:34.595] Build status: STARTED
[06:55:34.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:58:0) after 5m58s
[07:01:32.647] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:58:0)
[07:01:32.683] Build status: STARTED
[07:01:32.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:59:0) after 6m23s
[07:07:55.708] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:59:0)
[07:07:55.760] Build status: STARTED
[07:07:55.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:60:0) after 7m24s
[07:15:20.015] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:60:0)
[07:15:20.041] Build status: STARTED
[07:15:20.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:61:0) after 3m24s
[07:18:44.017] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:61:0)
[07:18:44.049] Build status: STARTED
[07:18:44.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:62:0) after 6m16s
[07:25:00.071] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:62:0)
[07:25:00.121] Build status: STARTED
[07:25:00.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9005750628139162672:63:0) after 1m50s
[07:26:35.165] Received PubSub notification, asking Buildbucket for the build status
[07:26:35.217] Build:
{
"id": "8840320565891078880",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22852,
"createdBy": "project:chromium",
"createTime": "2021-07-30T01:59:09.719227Z",
"startTime": "2021-07-30T02:01:44.803376Z",
"endTime": "2021-07-30T07:26:34.022650246Z",
"updateTime": "2021-07-30T07:26:34.023083680Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f9c6ece39b8bf10fcaa05413f1ab64f964dda521",
"ref": "refs/heads/main"
}
}
}
[07:26:35.217] Invocation finished in 5h27m27.024337419s with status FAILED