[03:21:45.339] New invocation is queued and will start shortly
[03:21:46.574] Starting the invocation (attempt 1)
[03:21:46.609] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/922fd6ff7eabddf56c10217bd8c8855a27720a5d"
[03:21:46.609] Popped gitiles commit info from properties and tags
[03:21:46.609] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:21:46.610] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:21:46.610] Buildbucket request:
{
"requestId": "8945951432380871920",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "922fd6ff7eabddf56c10217bd8c8855a27720a5d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8945951432380871920"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:21:47.033] Scheduled build:
{
"id": "8780521370320412257",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29446,
"createdBy": "project:chromium",
"createTime": "2023-05-21T03:21:46.677860135Z",
"updateTime": "2023-05-21T03:21:46.677860135Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "922fd6ff7eabddf56c10217bd8c8855a27720a5d",
"ref": "refs/heads/main"
}
}
}
[03:21:47.033] Task URL: https://cr-buildbucket.appspot.com/build/8780521370320412257
[03:21:47.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:2:0) after 3m58s
[03:24:34.096] Received PubSub notification, asking Buildbucket for the build status
[03:24:34.151] Build status: STARTED
[03:25:45.197] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:2:0)
[03:25:45.214] Build status: STARTED
[03:25:45.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:4:0) after 7m13s
[03:32:58.455] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:4:0)
[03:32:58.525] Build status: STARTED
[03:32:58.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:5:0) after 8m8s
[03:41:06.541] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:5:0)
[03:41:06.670] Build status: STARTED
[03:41:06.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:6:0) after 2m50s
[03:43:56.800] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:6:0)
[03:43:56.822] Build status: STARTED
[03:43:56.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:7:0) after 9m50s
[03:53:46.840] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:7:0)
[03:53:46.860] Build status: STARTED
[03:53:46.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:8:0) after 1m45s
[03:55:32.229] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:8:0)
[03:55:32.243] Build status: STARTED
[03:55:32.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:9:0) after 8m23s
[04:03:55.386] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:9:0)
[04:03:55.409] Build status: STARTED
[04:03:55.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:10:0) after 5m39s
[04:09:34.464] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:10:0)
[04:09:34.489] Build status: STARTED
[04:09:34.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:11:0) after 9m56s
[04:19:30.503] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:11:0)
[04:19:30.524] Build status: STARTED
[04:19:30.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:12:0) after 5m18s
[04:24:48.557] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:12:0)
[04:24:48.646] Build status: STARTED
[04:24:48.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:13:0) after 7m23s
[04:32:11.804] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:13:0)
[04:32:11.824] Build status: STARTED
[04:32:11.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:14:0) after 4m2s
[04:36:14.040] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:14:0)
[04:36:14.061] Build status: STARTED
[04:36:14.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:15:0) after 1m11s
[04:37:25.084] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:15:0)
[04:37:25.104] Build status: STARTED
[04:37:25.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:16:0) after 6m28s
[04:43:53.125] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:16:0)
[04:43:53.150] Build status: STARTED
[04:43:53.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:17:0) after 9m25s
[04:53:18.171] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:17:0)
[04:53:18.193] Build status: STARTED
[04:53:18.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:18:0) after 7m28s
[05:00:46.222] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:18:0)
[05:00:46.249] Build status: STARTED
[05:00:46.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:19:0) after 5m47s
[05:06:33.381] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:19:0)
[05:06:33.401] Build status: STARTED
[05:06:33.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:20:0) after 2m51s
[05:09:24.726] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:20:0)
[05:09:24.758] Build status: STARTED
[05:09:24.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:21:0) after 6m24s
[05:15:48.868] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:21:0)
[05:15:48.898] Build status: STARTED
[05:15:48.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:22:0) after 2m32s
[05:18:21.129] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:22:0)
[05:18:21.153] Build status: STARTED
[05:18:21.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:23:0) after 1m30s
[05:19:51.177] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:23:0)
[05:19:51.203] Build status: STARTED
[05:19:51.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:24:0) after 1m54s
[05:21:45.222] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:24:0)
[05:21:45.238] Build status: STARTED
[05:21:45.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:25:0) after 7m49s
[05:29:34.253] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:25:0)
[05:29:34.276] Build status: STARTED
[05:29:34.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:26:0) after 1m9s
[05:30:43.837] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:26:0)
[05:30:43.933] Build status: STARTED
[05:30:43.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:27:0) after 1m13s
[05:31:56.955] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:27:0)
[05:31:56.979] Build status: STARTED
[05:31:56.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:28:0) after 3m39s
[05:35:35.995] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:28:0)
[05:35:36.020] Build status: STARTED
[05:35:36.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:29:0) after 8m57s
[05:44:33.044] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:29:0)
[05:44:33.068] Build status: STARTED
[05:44:33.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:30:0) after 8m42s
[05:53:15.131] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:30:0)
[05:53:15.186] Build status: STARTED
[05:53:15.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:31:0) after 6m0s
[05:59:15.348] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:31:0)
[05:59:15.370] Build status: STARTED
[05:59:15.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:32:0) after 9m42s
[06:08:57.609] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:32:0)
[06:08:57.697] Build status: STARTED
[06:08:57.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:33:0) after 3m4s
[06:12:01.915] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:33:0)
[06:12:01.985] Build status: STARTED
[06:12:01.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:34:0) after 5m58s
[06:18:00.438] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:34:0)
[06:18:00.455] Build status: STARTED
[06:18:00.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:35:0) after 1m54s
[06:19:54.783] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:35:0)
[06:19:54.810] Build status: STARTED
[06:19:54.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:36:0) after 7m16s
[06:27:11.000] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:36:0)
[06:27:11.031] Build status: STARTED
[06:27:11.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:37:0) after 7m15s
[06:34:26.065] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:37:0)
[06:34:26.090] Build status: STARTED
[06:34:26.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:38:0) after 6m45s
[06:41:11.167] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:38:0)
[06:41:11.189] Build status: STARTED
[06:41:11.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:39:0) after 3m12s
[06:44:23.292] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:39:0)
[06:44:23.328] Build status: STARTED
[06:44:23.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:40:0) after 8m45s
[06:53:08.353] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:40:0)
[06:53:08.377] Build status: STARTED
[06:53:08.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:41:0) after 2m51s
[06:55:59.529] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:41:0)
[06:55:59.618] Build status: STARTED
[06:55:59.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:42:0) after 9m30s
[07:05:29.642] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:42:0)
[07:05:29.790] Build status: STARTED
[07:05:29.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:43:0) after 3m46s
[07:09:16.110] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:43:0)
[07:09:16.134] Build status: STARTED
[07:09:16.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:44:0) after 7m21s
[07:16:37.389] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:44:0)
[07:16:37.415] Build status: STARTED
[07:16:37.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:45:0) after 2m36s
[07:19:13.621] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:45:0)
[07:19:13.649] Build status: STARTED
[07:19:13.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:46:0) after 5m42s
[07:24:55.666] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:46:0)
[07:24:55.814] Build status: STARTED
[07:24:55.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:47:0) after 7m55s
[07:32:50.830] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:47:0)
[07:32:50.854] Build status: STARTED
[07:32:50.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:48:0) after 3m45s
[07:36:35.885] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:48:0)
[07:36:35.907] Build status: STARTED
[07:36:35.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:49:0) after 2m45s
[07:39:20.943] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:49:0)
[07:39:20.962] Build status: STARTED
[07:39:20.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:50:0) after 4m22s
[07:43:43.164] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:50:0)
[07:43:43.183] Build status: STARTED
[07:43:43.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:51:0) after 1m49s
[07:45:32.427] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:51:0)
[07:45:32.449] Build status: STARTED
[07:45:32.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:52:0) after 7m11s
[07:52:43.683] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:52:0)
[07:52:43.702] Build status: STARTED
[07:52:43.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:53:0) after 6m55s
[07:59:38.732] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:53:0)
[07:59:38.781] Build status: STARTED
[07:59:38.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:54:0) after 4m24s
[08:04:02.798] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:54:0)
[08:04:02.819] Build status: STARTED
[08:04:02.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:55:0) after 5m52s
[08:09:55.011] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:55:0)
[08:09:55.034] Build status: STARTED
[08:09:55.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:56:0) after 2m33s
[08:12:28.059] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:56:0)
[08:12:28.092] Build status: STARTED
[08:12:28.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:57:0) after 4m28s
[08:16:56.184] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:57:0)
[08:16:56.207] Build status: STARTED
[08:16:56.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:58:0) after 8m12s
[08:25:08.427] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:58:0)
[08:25:08.448] Build status: STARTED
[08:25:08.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:59:0) after 5m20s
[08:30:28.575] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:59:0)
[08:30:28.595] Build status: STARTED
[08:30:28.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8945951432380871920:60:0) after 7m0s
[08:34:49.529] Received PubSub notification, asking Buildbucket for the build status
[08:34:49.547] Build:
{
"id": "8780521370320412257",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29446,
"createdBy": "project:chromium",
"createTime": "2023-05-21T03:21:46.677860135Z",
"startTime": "2023-05-21T03:24:33.311117Z",
"endTime": "2023-05-21T08:34:49.230207498Z",
"updateTime": "2023-05-21T08:34:49.230207498Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "922fd6ff7eabddf56c10217bd8c8855a27720a5d",
"ref": "refs/heads/main"
}
}
}
[08:34:49.547] Invocation finished in 5h13m4.21848345s with status FAILED