[14:06:24.085] New invocation is queued and will start shortly
[14:06:25.167] Starting the invocation (attempt 1)
[14:06:25.204] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/cdd5a1287a28713c129fac6562e75beba9e345db"
[14:06:25.204] Popped gitiles commit info from properties and tags
[14:06:25.204] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:06:25.204] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:06:25.204] Buildbucket request:
{
"requestId": "9000903233386655536",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cdd5a1287a28713c129fac6562e75beba9e345db",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9000903233386655536"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:06:25.909] Scheduled build:
{
"id": "8835473171452929665",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23224,
"createdBy": "project:chromium",
"createTime": "2021-09-21T14:06:25.296664277Z",
"updateTime": "2021-09-21T14:06:25.597619019Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cdd5a1287a28713c129fac6562e75beba9e345db",
"ref": "refs/heads/main"
}
}
}
[14:06:25.909] Task URL: https://cr-buildbucket.appspot.com/build/8835473171452929665
[14:06:25.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:2:0) after 9m55s
[14:08:38.753] Received PubSub notification, asking Buildbucket for the build status
[14:08:38.868] Build status: STARTED
[14:16:20.936] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:2:0)
[14:16:20.979] Build status: STARTED
[14:16:20.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:4:0) after 6m16s
[14:22:37.009] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:4:0)
[14:22:37.047] Build status: STARTED
[14:22:37.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:5:0) after 1m42s
[14:24:19.068] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:5:0)
[14:24:19.100] Build status: STARTED
[14:24:19.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:6:0) after 9m51s
[14:34:10.328] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:6:0)
[14:34:10.370] Build status: STARTED
[14:34:10.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:7:0) after 9m19s
[14:43:29.399] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:7:0)
[14:43:29.432] Build status: STARTED
[14:43:29.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:8:0) after 3m33s
[14:47:02.556] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:8:0)
[14:47:02.594] Build status: STARTED
[14:47:02.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:9:0) after 4m34s
[14:51:37.025] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:9:0)
[14:51:37.062] Build status: STARTED
[14:51:37.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:10:0) after 4m24s
[14:56:01.142] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:10:0)
[14:56:01.190] Build status: STARTED
[14:56:01.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:11:0) after 3m53s
[14:59:54.276] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:11:0)
[14:59:54.308] Build status: STARTED
[14:59:54.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:12:0) after 2m45s
[15:02:39.462] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:12:0)
[15:02:39.496] Build status: STARTED
[15:02:39.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:13:0) after 1m5s
[15:03:44.477] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:13:0)
[15:03:44.518] Build status: STARTED
[15:03:44.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:14:0) after 5m35s
[15:09:19.624] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:14:0)
[15:09:19.656] Build status: STARTED
[15:09:19.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:15:0) after 4m56s
[15:14:15.689] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:15:0)
[15:14:15.721] Build status: STARTED
[15:14:15.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:16:0) after 7m19s
[15:21:34.942] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:16:0)
[15:21:35.000] Build status: STARTED
[15:21:35.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:17:0) after 4m7s
[15:25:42.057] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:17:0)
[15:25:42.092] Build status: STARTED
[15:25:42.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:18:0) after 8m18s
[15:34:00.100] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:18:0)
[15:34:00.135] Build status: STARTED
[15:34:00.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:19:0) after 6m21s
[15:40:21.257] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:19:0)
[15:40:21.289] Build status: STARTED
[15:40:21.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:20:0) after 8m4s
[15:48:25.311] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:20:0)
[15:48:25.487] Build status: STARTED
[15:48:25.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:21:0) after 3m40s
[15:52:05.558] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:21:0)
[15:52:05.594] Build status: STARTED
[15:52:05.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:22:0) after 2m41s
[15:54:46.799] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:22:0)
[15:54:46.829] Build status: STARTED
[15:54:46.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:23:0) after 5m31s
[16:00:18.043] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:23:0)
[16:00:18.075] Build status: STARTED
[16:00:18.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:24:0) after 8m19s
[16:08:37.196] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:24:0)
[16:08:37.450] Build status: STARTED
[16:08:37.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:25:0) after 9m44s
[16:18:21.484] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:25:0)
[16:18:21.519] Build status: STARTED
[16:18:21.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:26:0) after 6m58s
[16:25:19.552] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:26:0)
[16:25:19.585] Build status: STARTED
[16:25:19.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:27:0) after 7m30s
[16:32:49.608] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:27:0)
[16:32:49.683] Build status: STARTED
[16:32:49.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:28:0) after 2m12s
[16:35:01.775] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:28:0)
[16:35:01.806] Build status: STARTED
[16:35:01.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:29:0) after 8m33s
[16:43:34.928] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:29:0)
[16:43:34.962] Build status: STARTED
[16:43:34.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:30:0) after 8m5s
[16:51:40.002] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:30:0)
[16:51:40.029] Build status: STARTED
[16:51:40.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:31:0) after 1m25s
[16:53:05.049] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:31:0)
[16:53:05.079] Build status: STARTED
[16:53:05.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:32:0) after 4m18s
[16:57:23.132] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:32:0)
[16:57:23.260] Build status: STARTED
[16:57:23.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:33:0) after 4m12s
[17:01:35.305] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:33:0)
[17:01:35.347] Build status: STARTED
[17:01:35.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:34:0) after 8m25s
[17:10:00.514] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:34:0)
[17:10:00.554] Build status: STARTED
[17:10:00.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:35:0) after 3m30s
[17:13:30.665] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:35:0)
[17:13:30.713] Build status: STARTED
[17:13:30.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:36:0) after 4m45s
[17:18:15.734] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:36:0)
[17:18:15.787] Build status: STARTED
[17:18:15.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:37:0) after 2m1s
[17:20:16.833] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:37:0)
[17:20:16.869] Build status: STARTED
[17:20:16.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:38:0) after 8m13s
[17:28:30.010] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:38:0)
[17:28:30.042] Build status: STARTED
[17:28:30.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:39:0) after 4m53s
[17:33:23.365] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:39:0)
[17:33:23.395] Build status: STARTED
[17:33:23.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:40:0) after 8m44s
[17:42:07.451] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:40:0)
[17:42:07.512] Build status: STARTED
[17:42:07.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:41:0) after 3m6s
[17:45:13.568] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:41:0)
[17:45:13.605] Build status: STARTED
[17:45:13.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:42:0) after 6m9s
[17:51:22.649] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:42:0)
[17:51:22.714] Build status: STARTED
[17:51:22.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:43:0) after 2m54s
[17:54:16.963] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:43:0)
[17:54:17.086] Build status: STARTED
[17:54:17.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:44:0) after 7m56s
[18:02:13.328] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:44:0)
[18:02:13.375] Build status: STARTED
[18:02:13.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:45:0) after 5m0s
[18:07:13.680] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:45:0)
[18:07:13.775] Build status: STARTED
[18:07:13.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:46:0) after 7m59s
[18:15:12.798] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:46:0)
[18:15:12.835] Build status: STARTED
[18:15:12.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:47:0) after 2m25s
[18:17:37.865] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:47:0)
[18:17:37.922] Build status: STARTED
[18:17:37.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:48:0) after 1m25s
[18:19:03.421] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:48:0)
[18:19:03.573] Build status: STARTED
[18:19:03.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:49:0) after 8m2s
[18:27:05.595] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:49:0)
[18:27:05.633] Build status: STARTED
[18:27:05.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:50:0) after 5m37s
[18:32:42.667] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:50:0)
[18:32:42.709] Build status: STARTED
[18:32:42.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:51:0) after 9m3s
[18:41:46.007] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:51:0)
[18:41:46.091] Build status: STARTED
[18:41:46.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:52:0) after 8m14s
[18:50:00.213] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:52:0)
[18:50:00.246] Build status: STARTED
[18:50:00.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:53:0) after 2m10s
[18:52:10.415] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:53:0)
[18:52:10.447] Build status: STARTED
[18:52:10.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:54:0) after 5m44s
[18:57:54.471] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:54:0)
[18:57:54.514] Build status: STARTED
[18:57:54.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:55:0) after 1m33s
[18:59:27.686] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:55:0)
[18:59:27.716] Build status: STARTED
[18:59:27.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:56:0) after 4m19s
[19:03:46.832] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:56:0)
[19:03:46.974] Build status: STARTED
[19:03:46.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:57:0) after 8m20s
[19:12:07.265] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:57:0)
[19:12:07.295] Build status: STARTED
[19:12:07.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:58:0) after 3m56s
[19:16:03.362] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:58:0)
[19:16:03.392] Build status: STARTED
[19:16:03.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:59:0) after 3m21s
[19:19:24.414] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:59:0)
[19:19:24.445] Build status: STARTED
[19:19:24.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:60:0) after 2m25s
[19:21:49.482] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:60:0)
[19:21:49.523] Build status: STARTED
[19:21:49.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:61:0) after 1m25s
[19:23:15.394] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:61:0)
[19:23:15.435] Build status: STARTED
[19:23:15.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:62:0) after 8m6s
[19:31:21.649] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:62:0)
[19:31:21.696] Build status: STARTED
[19:31:21.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:63:0) after 2m18s
[19:33:39.866] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:63:0)
[19:33:39.903] Build status: STARTED
[19:33:39.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:64:0) after 5m32s
[19:39:12.206] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:64:0)
[19:39:12.237] Build status: STARTED
[19:39:12.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:65:0) after 4m31s
[19:43:43.394] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:65:0)
[19:43:43.444] Build status: STARTED
[19:43:43.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9000903233386655536:66:0) after 8m7s
[19:43:44.349] Received PubSub notification, asking Buildbucket for the build status
[19:43:44.400] Build:
{
"id": "8835473171452929665",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 23224,
"createdBy": "project:chromium",
"createTime": "2021-09-21T14:06:25.296664277Z",
"startTime": "2021-09-21T14:08:38.183473Z",
"endTime": "2021-09-21T19:43:43.812500769Z",
"updateTime": "2021-09-21T19:43:43.812925353Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cdd5a1287a28713c129fac6562e75beba9e345db",
"ref": "refs/heads/main"
}
}
}
[19:43:44.400] Invocation finished in 5h37m20.331371139s with status FAILED