[23:40:06.341] New invocation is queued and will start shortly
[23:40:07.560] Starting the invocation (attempt 1)
[23:40:07.594] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/cb8c6a45ed779117c1b83515f26398c8ec1bf5bd"
[23:40:07.594] Popped gitiles commit info from properties and tags
[23:40:07.594] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:40:07.594] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:40:07.595] Buildbucket request:
{
"requestId": "8953031940770372080",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cb8c6a45ed779117c1b83515f26398c8ec1bf5bd",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8953031940770372080"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:40:08.082] Scheduled build:
{
"id": "8787601878660852657",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29024,
"createdBy": "project:chromium",
"createTime": "2023-03-03T23:40:07.725736287Z",
"updateTime": "2023-03-03T23:40:07.725736287Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cb8c6a45ed779117c1b83515f26398c8ec1bf5bd",
"ref": "refs/heads/main"
}
}
}
[23:40:08.082] Task URL: https://cr-buildbucket.appspot.com/build/8787601878660852657
[23:40:08.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:2:0) after 9m45s
[23:42:50.848] Received PubSub notification, asking Buildbucket for the build status
[23:42:50.869] Build status: STARTED
[23:49:53.138] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:2:0)
[23:49:53.158] Build status: STARTED
[23:49:53.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:4:0) after 3m24s
[23:53:17.687] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:4:0)
[23:53:17.706] Build status: STARTED
[23:53:17.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:5:0) after 3m41s
[23:56:58.735] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:5:0)
[23:56:58.755] Build status: STARTED
[23:56:58.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:6:0) after 1m36s
[23:58:34.780] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:6:0)
[23:58:34.799] Build status: STARTED
[23:58:34.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:7:0) after 1m20s
[23:59:54.846] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:7:0)
[23:59:54.874] Build status: STARTED
[23:59:54.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:8:0) after 5m5s
[00:04:59.901] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:8:0)
[00:04:59.923] Build status: STARTED
[00:04:59.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:9:0) after 6m17s
[00:11:16.949] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:9:0)
[00:11:16.977] Build status: STARTED
[00:11:16.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:10:0) after 1m47s
[00:13:03.973] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:10:0)
[00:13:04.151] Build status: STARTED
[00:13:04.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:11:0) after 4m38s
[00:17:42.552] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:11:0)
[00:17:42.576] Build status: STARTED
[00:17:42.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:12:0) after 8m54s
[00:26:36.677] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:12:0)
[00:26:36.701] Build status: STARTED
[00:26:36.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:13:0) after 7m54s
[00:34:30.741] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:13:0)
[00:34:30.769] Build status: STARTED
[00:34:30.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:14:0) after 8m29s
[00:42:59.936] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:14:0)
[00:42:59.962] Build status: STARTED
[00:42:59.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:15:0) after 1m49s
[00:44:49.482] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:15:0)
[00:44:49.528] Build status: STARTED
[00:44:49.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:16:0) after 2m33s
[00:47:22.584] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:16:0)
[00:47:22.607] Build status: STARTED
[00:47:22.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:17:0) after 6m40s
[00:54:02.783] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:17:0)
[00:54:02.814] Build status: STARTED
[00:54:02.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:18:0) after 4m30s
[00:58:33.184] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:18:0)
[00:58:33.226] Build status: STARTED
[00:58:33.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:19:0) after 4m5s
[01:02:38.361] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:19:0)
[01:02:38.383] Build status: STARTED
[01:02:38.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:20:0) after 2m54s
[01:05:32.455] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:20:0)
[01:05:32.487] Build status: STARTED
[01:05:32.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:21:0) after 8m30s
[01:14:02.550] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:21:0)
[01:14:02.574] Build status: STARTED
[01:14:02.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:22:0) after 8m29s
[01:22:31.658] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:22:0)
[01:22:31.685] Build status: STARTED
[01:22:31.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:23:0) after 8m8s
[01:30:39.911] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:23:0)
[01:30:39.933] Build status: STARTED
[01:30:39.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:24:0) after 8m11s
[01:38:51.214] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:24:0)
[01:38:51.233] Build status: STARTED
[01:38:51.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:25:0) after 5m19s
[01:44:10.492] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:25:0)
[01:44:10.514] Build status: STARTED
[01:44:10.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:26:0) after 6m50s
[01:51:00.850] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:26:0)
[01:51:00.872] Build status: STARTED
[01:51:00.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:27:0) after 1m44s
[01:52:44.895] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:27:0)
[01:52:44.914] Build status: STARTED
[01:52:44.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:28:0) after 6m55s
[01:59:39.940] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:28:0)
[01:59:39.997] Build status: STARTED
[01:59:39.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:29:0) after 5m25s
[02:05:05.514] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:29:0)
[02:05:05.535] Build status: STARTED
[02:05:05.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:30:0) after 3m47s
[02:08:52.760] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:30:0)
[02:08:52.782] Build status: STARTED
[02:08:52.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:31:0) after 5m44s
[02:14:36.806] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:31:0)
[02:14:36.827] Build status: STARTED
[02:14:36.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:32:0) after 6m6s
[02:20:43.135] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:32:0)
[02:20:43.162] Build status: STARTED
[02:20:43.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:33:0) after 7m56s
[02:28:39.193] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:33:0)
[02:28:39.291] Build status: STARTED
[02:28:39.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:34:0) after 3m27s
[02:32:06.452] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:34:0)
[02:32:06.493] Build status: STARTED
[02:32:06.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:35:0) after 8m17s
[02:40:23.604] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:35:0)
[02:40:23.631] Build status: STARTED
[02:40:23.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:36:0) after 1m35s
[02:41:58.836] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:36:0)
[02:41:58.859] Build status: STARTED
[02:41:58.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:37:0) after 6m17s
[02:48:15.857] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:37:0)
[02:48:15.905] Build status: STARTED
[02:48:15.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:38:0) after 7m1s
[02:55:16.954] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:38:0)
[02:55:16.975] Build status: STARTED
[02:55:16.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:39:0) after 4m4s
[02:59:21.094] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:39:0)
[02:59:21.118] Build status: STARTED
[02:59:21.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:40:0) after 4m15s
[03:03:36.143] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:40:0)
[03:03:36.166] Build status: STARTED
[03:03:36.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:41:0) after 9m56s
[03:13:32.156] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:41:0)
[03:13:32.179] Build status: STARTED
[03:13:32.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:42:0) after 6m57s
[03:20:29.367] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:42:0)
[03:20:29.388] Build status: STARTED
[03:20:29.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:43:0) after 2m55s
[03:23:24.520] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:43:0)
[03:23:24.540] Build status: STARTED
[03:23:24.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:44:0) after 4m4s
[03:27:28.567] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:44:0)
[03:27:28.591] Build status: STARTED
[03:27:28.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:45:0) after 1m39s
[03:29:07.618] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:45:0)
[03:29:07.672] Build status: STARTED
[03:29:07.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:46:0) after 2m16s
[03:31:23.706] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:46:0)
[03:31:23.729] Build status: STARTED
[03:31:23.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:47:0) after 2m2s
[03:33:25.793] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:47:0)
[03:33:25.842] Build status: STARTED
[03:33:25.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:48:0) after 3m55s
[03:37:20.878] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:48:0)
[03:37:20.909] Build status: STARTED
[03:37:20.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:49:0) after 2m13s
[03:39:34.032] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:49:0)
[03:39:34.052] Build status: STARTED
[03:39:34.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:50:0) after 9m11s
[03:48:45.225] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:50:0)
[03:48:45.263] Build status: STARTED
[03:48:45.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:51:0) after 6m3s
[03:54:48.402] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:51:0)
[03:54:48.423] Build status: STARTED
[03:54:48.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:52:0) after 2m58s
[03:57:46.573] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:52:0)
[03:57:46.652] Build status: STARTED
[03:57:46.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:53:0) after 8m25s
[04:06:11.978] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:53:0)
[04:06:12.008] Build status: STARTED
[04:06:12.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:54:0) after 7m35s
[04:13:47.049] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:54:0)
[04:13:47.071] Build status: STARTED
[04:13:47.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:55:0) after 6m13s
[04:20:00.116] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:55:0)
[04:20:00.138] Build status: STARTED
[04:20:00.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:56:0) after 5m40s
[04:25:40.160] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:56:0)
[04:25:40.182] Build status: STARTED
[04:25:40.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:57:0) after 2m43s
[04:28:23.409] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:57:0)
[04:28:23.432] Build status: STARTED
[04:28:23.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:58:0) after 2m44s
[04:31:07.594] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:58:0)
[04:31:07.617] Build status: STARTED
[04:31:07.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:59:0) after 4m5s
[04:35:12.741] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:59:0)
[04:35:12.765] Build status: STARTED
[04:35:12.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:60:0) after 9m17s
[04:44:29.785] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:60:0)
[04:44:29.807] Build status: STARTED
[04:44:29.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:61:0) after 2m5s
[04:46:34.987] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:61:0)
[04:46:35.008] Build status: STARTED
[04:46:35.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:62:0) after 4m44s
[04:51:19.076] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:62:0)
[04:51:19.098] Build status: STARTED
[04:51:19.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:8953031940770372080:63:0) after 2m41s
[04:53:42.008] Received PubSub notification, asking Buildbucket for the build status
[04:53:42.029] Build:
{
"id": "8787601878660852657",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 29024,
"createdBy": "project:chromium",
"createTime": "2023-03-03T23:40:07.725736287Z",
"startTime": "2023-03-03T23:42:50.268045Z",
"endTime": "2023-03-04T04:53:41.735859336Z",
"updateTime": "2023-03-04T04:53:41.735859336Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cb8c6a45ed779117c1b83515f26398c8ec1bf5bd",
"ref": "refs/heads/main"
}
}
}
[04:53:42.029] Invocation finished in 5h13m35.698666316s with status FAILED