[23:34:24.323] New invocation is queued and will start shortly
[23:34:25.446] Starting the invocation (attempt 1)
[23:34:25.483] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0876b1195695be6d332d010be9a5f8bf7c22eeec"
[23:34:25.483] Popped gitiles commit info from properties and tags
[23:34:25.483] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:34:25.483] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:34:25.484] Buildbucket request:
{
"requestId": "9015453609257820736",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0876b1195695be6d332d010be9a5f8bf7c22eeec",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9015453609257820736"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:34:27.904] Scheduled build:
{
"id": "8850023545397639792",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 21926,
"createdBy": "project:chromium",
"createTime": "2021-04-13T23:34:27.371995Z",
"updateTime": "2021-04-13T23:34:27.826338Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0876b1195695be6d332d010be9a5f8bf7c22eeec",
"ref": "refs/heads/master"
}
}
}
[23:34:27.904] Task URL: https://cr-buildbucket.appspot.com/build/8850023545397639792
[23:34:27.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:2:0) after 4m5s
[23:37:30.526] Received PubSub notification, asking Buildbucket for the build status
[23:37:30.563] Build status: STARTED
[23:38:33.027] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:2:0)
[23:38:33.062] Build status: STARTED
[23:38:33.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:4:0) after 5m55s
[23:44:28.084] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:4:0)
[23:44:28.109] Build status: STARTED
[23:44:28.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:5:0) after 1m9s
[23:45:37.136] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:5:0)
[23:45:37.202] Build status: STARTED
[23:45:37.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:6:0) after 6m13s
[23:51:50.407] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:6:0)
[23:51:50.436] Build status: STARTED
[23:51:50.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:7:0) after 4m42s
[23:56:32.670] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:7:0)
[23:56:32.717] Build status: STARTED
[23:56:32.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:8:0) after 2m25s
[23:58:58.200] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:8:0)
[23:58:58.229] Build status: STARTED
[23:58:58.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:9:0) after 3m1s
[00:01:59.469] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:9:0)
[00:01:59.499] Build status: STARTED
[00:01:59.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:10:0) after 1m43s
[00:03:42.569] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:10:0)
[00:03:42.602] Build status: STARTED
[00:03:42.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:11:0) after 7m43s
[00:11:25.810] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:11:0)
[00:11:25.836] Build status: STARTED
[00:11:25.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:12:0) after 3m12s
[00:14:38.024] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:12:0)
[00:14:38.049] Build status: STARTED
[00:14:38.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:13:0) after 1m21s
[00:15:59.093] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:13:0)
[00:15:59.145] Build status: STARTED
[00:15:59.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:14:0) after 8m42s
[00:24:41.293] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:14:0)
[00:24:41.321] Build status: STARTED
[00:24:41.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:15:0) after 7m21s
[00:32:02.348] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:15:0)
[00:32:02.375] Build status: STARTED
[00:32:02.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:16:0) after 8m24s
[00:40:26.553] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:16:0)
[00:40:26.578] Build status: STARTED
[00:40:26.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:17:0) after 3m57s
[00:44:23.609] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:17:0)
[00:44:23.654] Build status: STARTED
[00:44:23.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:18:0) after 8m4s
[00:52:27.812] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:18:0)
[00:52:27.839] Build status: STARTED
[00:52:27.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:19:0) after 5m48s
[00:58:16.010] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:19:0)
[00:58:16.039] Build status: STARTED
[00:58:16.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:20:0) after 2m20s
[01:00:36.067] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:20:0)
[01:00:36.097] Build status: STARTED
[01:00:36.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:21:0) after 1m24s
[01:02:00.147] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:21:0)
[01:02:00.177] Build status: STARTED
[01:02:00.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:22:0) after 7m30s
[01:09:30.271] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:22:0)
[01:09:30.306] Build status: STARTED
[01:09:30.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:23:0) after 4m38s
[01:14:08.426] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:23:0)
[01:14:08.467] Build status: STARTED
[01:14:08.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:24:0) after 3m5s
[01:17:13.581] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:24:0)
[01:17:13.611] Build status: STARTED
[01:17:13.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:25:0) after 4m0s
[01:21:13.636] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:25:0)
[01:21:13.665] Build status: STARTED
[01:21:13.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:26:0) after 5m2s
[01:26:15.790] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:26:0)
[01:26:15.820] Build status: STARTED
[01:26:15.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:27:0) after 8m8s
[01:34:23.842] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:27:0)
[01:34:23.867] Build status: STARTED
[01:34:23.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:28:0) after 6m28s
[01:40:51.889] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:28:0)
[01:40:51.920] Build status: STARTED
[01:40:51.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:29:0) after 8m28s
[01:49:19.991] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:29:0)
[01:49:20.020] Build status: STARTED
[01:49:20.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:30:0) after 8m52s
[01:58:12.055] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:30:0)
[01:58:12.094] Build status: STARTED
[01:58:12.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:31:0) after 8m52s
[02:07:04.228] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:31:0)
[02:07:04.257] Build status: STARTED
[02:07:04.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:32:0) after 6m43s
[02:13:47.275] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:32:0)
[02:13:47.305] Build status: STARTED
[02:13:47.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:33:0) after 2m12s
[02:15:59.393] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:33:0)
[02:15:59.426] Build status: STARTED
[02:15:59.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:34:0) after 2m19s
[02:18:18.678] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:34:0)
[02:18:18.705] Build status: STARTED
[02:18:18.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:35:0) after 2m54s
[02:21:13.088] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:35:0)
[02:21:13.119] Build status: STARTED
[02:21:13.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:36:0) after 6m35s
[02:27:48.144] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:36:0)
[02:27:48.171] Build status: STARTED
[02:27:48.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:37:0) after 1m23s
[02:29:11.193] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:37:0)
[02:29:11.244] Build status: STARTED
[02:29:11.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:38:0) after 4m43s
[02:33:54.266] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:38:0)
[02:33:54.298] Build status: STARTED
[02:33:54.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:39:0) after 1m42s
[02:35:36.317] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:39:0)
[02:35:36.350] Build status: STARTED
[02:35:36.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:40:0) after 5m28s
[02:41:04.482] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:40:0)
[02:41:04.513] Build status: STARTED
[02:41:04.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:41:0) after 3m40s
[02:44:44.556] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:41:0)
[02:44:44.588] Build status: STARTED
[02:44:44.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:42:0) after 7m18s
[02:52:02.842] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:42:0)
[02:52:02.875] Build status: STARTED
[02:52:02.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:43:0) after 8m25s
[03:00:27.913] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:43:0)
[03:00:27.948] Build status: STARTED
[03:00:27.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:44:0) after 4m33s
[03:05:01.277] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:44:0)
[03:05:01.305] Build status: STARTED
[03:05:01.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:45:0) after 6m52s
[03:11:53.564] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:45:0)
[03:11:53.594] Build status: STARTED
[03:11:53.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:46:0) after 9m24s
[03:21:17.751] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:46:0)
[03:21:17.784] Build status: STARTED
[03:21:17.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:47:0) after 8m13s
[03:29:30.811] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:47:0)
[03:29:30.838] Build status: STARTED
[03:29:30.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:48:0) after 9m54s
[03:39:24.870] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:48:0)
[03:39:24.907] Build status: STARTED
[03:39:24.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:49:0) after 8m58s
[03:48:23.109] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:49:0)
[03:48:23.136] Build status: STARTED
[03:48:23.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:50:0) after 4m11s
[03:52:34.162] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:50:0)
[03:52:34.190] Build status: STARTED
[03:52:34.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:51:0) after 9m57s
[04:02:31.397] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:51:0)
[04:02:31.422] Build status: STARTED
[04:02:31.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:52:0) after 6m51s
[04:09:22.484] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:52:0)
[04:09:22.512] Build status: STARTED
[04:09:22.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:53:0) after 7m8s
[04:16:30.621] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:53:0)
[04:16:30.650] Build status: STARTED
[04:16:30.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:54:0) after 5m7s
[04:21:37.748] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:54:0)
[04:21:37.772] Build status: STARTED
[04:21:37.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:55:0) after 6m43s
[04:28:20.792] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:55:0)
[04:28:20.822] Build status: STARTED
[04:28:20.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:56:0) after 9m3s
[04:37:23.844] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:56:0)
[04:37:23.880] Build status: STARTED
[04:37:23.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:57:0) after 8m21s
[04:45:44.905] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:57:0)
[04:45:44.929] Build status: STARTED
[04:45:44.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015453609257820736:58:0) after 8m25s
[04:48:31.759] Received PubSub notification, asking Buildbucket for the build status
[04:48:31.791] Build:
{
"id": "8850023545397639792",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 21926,
"createdBy": "project:chromium",
"createTime": "2021-04-13T23:34:27.371995Z",
"startTime": "2021-04-13T23:37:29.991343Z",
"endTime": "2021-04-14T04:48:31.363653148Z",
"updateTime": "2021-04-14T04:48:31.364112075Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0876b1195695be6d332d010be9a5f8bf7c22eeec",
"ref": "refs/heads/master"
}
}
}
[04:48:31.791] Invocation finished in 5h14m7.485044867s with status FAILED