[00:02:27.361] New invocation is queued and will start shortly
[00:02:28.430] Starting the invocation (attempt 1)
[00:02:28.459] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/aa8d4062bc3de5d916adda3c87130f384223dd7d"
[00:02:28.459] Popped gitiles commit info from properties and tags
[00:02:28.459] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:02:28.459] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:02:28.459] Buildbucket request:
{
"requestId": "8913439660285886080",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "aa8d4062bc3de5d916adda3c87130f384223dd7d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8913439660285886080"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:02:29.098] Scheduled build:
{
"id": "8748009598382049985",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 32561,
"createdBy": "project:chromium",
"createTime": "2024-05-14T00:02:28.555998545Z",
"updateTime": "2024-05-14T00:02:28.555998545Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "aa8d4062bc3de5d916adda3c87130f384223dd7d",
"ref": "refs/heads/main"
}
}
}
[00:02:29.098] Task URL: https://cr-buildbucket.appspot.com/build/8748009598382049985
[00:02:29.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:2:0) after 7m39s
[00:02:30.007] Received PubSub notification, asking Buildbucket for the build status
[00:02:30.106] Build status: SCHEDULED
[00:03:35.567] Received PubSub notification, asking Buildbucket for the build status
[00:03:35.667] Build status: STARTED
[00:10:08.134] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:2:0)
[00:10:08.155] Build status: STARTED
[00:10:08.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:5:0) after 7m45s
[00:17:53.286] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:5:0)
[00:17:53.309] Build status: STARTED
[00:17:53.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:6:0) after 3m2s
[00:20:55.393] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:6:0)
[00:20:55.425] Build status: STARTED
[00:20:55.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:7:0) after 7m26s
[00:28:21.447] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:7:0)
[00:28:21.473] Build status: STARTED
[00:28:21.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:8:0) after 5m8s
[00:33:29.548] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:8:0)
[00:33:29.573] Build status: STARTED
[00:33:29.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:9:0) after 6m38s
[00:40:07.612] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:9:0)
[00:40:07.721] Build status: STARTED
[00:40:07.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:10:0) after 8m34s
[00:48:41.782] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:10:0)
[00:48:41.803] Build status: STARTED
[00:48:41.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:11:0) after 4m37s
[00:53:18.834] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:11:0)
[00:53:18.863] Build status: STARTED
[00:53:18.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:12:0) after 1m59s
[00:55:17.882] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:12:0)
[00:55:17.898] Build status: STARTED
[00:55:17.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:13:0) after 8m41s
[01:03:58.946] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:13:0)
[01:03:58.970] Build status: STARTED
[01:03:58.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:14:0) after 3m8s
[01:07:06.991] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:14:0)
[01:07:07.130] Build status: STARTED
[01:07:07.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:15:0) after 4m8s
[01:11:15.234] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:15:0)
[01:11:15.329] Build status: STARTED
[01:11:15.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:16:0) after 6m28s
[01:17:43.425] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:16:0)
[01:17:43.484] Build status: STARTED
[01:17:43.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:17:0) after 9m59s
[01:27:42.651] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:17:0)
[01:27:42.667] Build status: STARTED
[01:27:42.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:18:0) after 1m38s
[01:29:20.787] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:18:0)
[01:29:20.805] Build status: STARTED
[01:29:20.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:19:0) after 8m46s
[01:38:06.904] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:19:0)
[01:38:06.922] Build status: STARTED
[01:38:06.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:20:0) after 9m11s
[01:47:18.000] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:20:0)
[01:47:18.022] Build status: STARTED
[01:47:18.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:21:0) after 2m3s
[01:49:21.193] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:21:0)
[01:49:21.268] Build status: STARTED
[01:49:21.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:22:0) after 8m14s
[01:57:35.304] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:22:0)
[01:57:35.342] Build status: STARTED
[01:57:35.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:23:0) after 5m14s
[02:02:49.505] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:23:0)
[02:02:49.530] Build status: STARTED
[02:02:49.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:24:0) after 6m7s
[02:08:56.610] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:24:0)
[02:08:56.628] Build status: STARTED
[02:08:56.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:25:0) after 4m46s
[02:13:42.683] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:25:0)
[02:13:42.728] Build status: STARTED
[02:13:42.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:26:0) after 9m39s
[02:23:21.816] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:26:0)
[02:23:21.833] Build status: STARTED
[02:23:21.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:27:0) after 1m14s
[02:24:35.856] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:27:0)
[02:24:35.872] Build status: STARTED
[02:24:35.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:28:0) after 7m47s
[02:32:22.977] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:28:0)
[02:32:23.296] Build status: STARTED
[02:32:23.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:29:0) after 2m1s
[02:34:24.383] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:29:0)
[02:34:24.408] Build status: STARTED
[02:34:24.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:30:0) after 3m21s
[02:37:45.524] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:30:0)
[02:37:45.563] Build status: STARTED
[02:37:45.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:31:0) after 4m25s
[02:42:10.584] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:31:0)
[02:42:10.603] Build status: STARTED
[02:42:10.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:32:0) after 2m39s
[02:44:49.658] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:32:0)
[02:44:49.729] Build status: STARTED
[02:44:49.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:33:0) after 6m22s
[02:51:11.770] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:33:0)
[02:51:11.983] Build status: STARTED
[02:51:11.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:34:0) after 2m5s
[02:53:17.053] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:34:0)
[02:53:17.285] Build status: STARTED
[02:53:17.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:35:0) after 4m36s
[02:57:53.324] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:35:0)
[02:57:53.340] Build status: STARTED
[02:57:53.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:36:0) after 5m56s
[03:03:49.396] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:36:0)
[03:03:49.418] Build status: STARTED
[03:03:49.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:37:0) after 6m20s
[03:10:09.475] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:37:0)
[03:10:09.610] Build status: STARTED
[03:10:09.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:38:0) after 4m45s
[03:14:54.729] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:38:0)
[03:14:54.749] Build status: STARTED
[03:14:54.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:39:0) after 8m38s
[03:23:32.881] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:39:0)
[03:23:32.902] Build status: STARTED
[03:23:32.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:40:0) after 6m32s
[03:30:05.130] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:40:0)
[03:30:05.199] Build status: STARTED
[03:30:05.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:41:0) after 4m51s
[03:34:56.301] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:41:0)
[03:34:56.330] Build status: STARTED
[03:34:56.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:42:0) after 8m39s
[03:43:35.407] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:42:0)
[03:43:35.473] Build status: STARTED
[03:43:35.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:43:0) after 8m22s
[03:51:57.842] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:43:0)
[03:51:57.859] Build status: STARTED
[03:51:57.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:44:0) after 5m39s
[03:57:36.983] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:44:0)
[03:57:37.005] Build status: STARTED
[03:57:37.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:45:0) after 3m56s
[04:01:33.084] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:45:0)
[04:01:33.144] Build status: STARTED
[04:01:33.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:46:0) after 5m19s
[04:06:52.155] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:46:0)
[04:06:52.173] Build status: STARTED
[04:06:52.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:47:0) after 3m30s
[04:10:22.210] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:47:0)
[04:10:22.229] Build status: STARTED
[04:10:22.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:48:0) after 9m24s
[04:19:46.265] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:48:0)
[04:19:46.305] Build status: STARTED
[04:19:46.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:49:0) after 9m6s
[04:28:52.530] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:49:0)
[04:28:52.546] Build status: STARTED
[04:28:52.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8913439660285886080:50:0) after 2m7s
[04:30:18.617] Received PubSub notification, asking Buildbucket for the build status
[04:30:18.637] Build:
{
"id": "8748009598382049985",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 32561,
"createdBy": "project:chromium",
"createTime": "2024-05-14T00:02:28.555998545Z",
"startTime": "2024-05-14T00:03:35.357710414Z",
"endTime": "2024-05-14T04:30:18.353415012Z",
"updateTime": "2024-05-14T04:30:18.353415012Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "aa8d4062bc3de5d916adda3c87130f384223dd7d",
"ref": "refs/heads/main"
}
}
}
[04:30:18.637] Invocation finished in 4h27m51.28132819s with status FAILED