[19:19:49.259] New invocation is queued and will start shortly
[19:19:50.391] Starting the invocation (attempt 1)
[19:19:50.441] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e25e6342ea30283ffb8ad7320f48f4462036195b"
[19:19:50.441] Popped gitiles commit info from properties and tags
[19:19:50.441] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:19:50.441] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:19:50.441] Buildbucket request:
{
"requestId": "9017190968682789840",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "win-asan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e25e6342ea30283ffb8ad7320f48f4462036195b",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9017190968682789840"
},
{
"key": "scheduler_job_id",
"value": "chromium/win-asan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:20:24.526] Failed to schedule Buildbucket build - rpc error: code = Internal desc = Service implementation threw an exception
[19:20:24.527] The invocation will be retried
[19:20:29.679] Starting the invocation (attempt 2)
[19:20:29.747] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e25e6342ea30283ffb8ad7320f48f4462036195b"
[19:20:29.747] Popped gitiles commit info from properties and tags
[19:20:29.747] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:20:29.747] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:20:29.747] Buildbucket request:
{
"requestId": "9017190968682789840",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "win-asan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e25e6342ea30283ffb8ad7320f48f4462036195b",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9017190968682789840"
},
{
"key": "scheduler_job_id",
"value": "chromium/win-asan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:21:06.417] Failed to schedule Buildbucket build - rpc error: code = Internal desc = Service implementation threw an exception
[19:21:06.417] The invocation will be retried
[19:21:17.118] Starting the invocation (attempt 3)
[19:21:17.157] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e25e6342ea30283ffb8ad7320f48f4462036195b"
[19:21:17.157] Popped gitiles commit info from properties and tags
[19:21:17.157] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:21:17.157] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:21:17.157] Buildbucket request:
{
"requestId": "9017190968682789840",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "win-asan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e25e6342ea30283ffb8ad7320f48f4462036195b",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9017190968682789840"
},
{
"key": "scheduler_job_id",
"value": "chromium/win-asan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:21:49.949] Failed to schedule Buildbucket build - rpc error: code = Internal desc = Service implementation threw an exception
[19:21:49.949] The invocation will be retried
[19:22:10.137] Starting the invocation (attempt 4)
[19:22:10.172] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e25e6342ea30283ffb8ad7320f48f4462036195b"
[19:22:10.172] Popped gitiles commit info from properties and tags
[19:22:10.172] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:22:10.172] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:22:10.172] Buildbucket request:
{
"requestId": "9017190968682789840",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "win-asan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e25e6342ea30283ffb8ad7320f48f4462036195b",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9017190968682789840"
},
{
"key": "scheduler_job_id",
"value": "chromium/win-asan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:22:43.580] Failed to schedule Buildbucket build - rpc error: code = Internal desc = Service implementation threw an exception
[19:22:43.580] The invocation will be retried
[19:23:23.627] Starting the invocation (attempt 5)
[19:23:23.755] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e25e6342ea30283ffb8ad7320f48f4462036195b"
[19:23:23.755] Popped gitiles commit info from properties and tags
[19:23:23.755] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:23:23.755] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:23:23.756] Buildbucket request:
{
"requestId": "9017190968682789840",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "win-asan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e25e6342ea30283ffb8ad7320f48f4462036195b",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9017190968682789840"
},
{
"key": "scheduler_job_id",
"value": "chromium/win-asan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:23:56.912] Failed to schedule Buildbucket build - rpc error: code = Internal desc = Service implementation threw an exception
[19:23:56.912] The invocation will be retried
[19:25:17.071] Starting the invocation (attempt 6)
[19:25:17.108] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e25e6342ea30283ffb8ad7320f48f4462036195b"
[19:25:17.108] Popped gitiles commit info from properties and tags
[19:25:17.108] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:25:17.108] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:25:17.108] Buildbucket request:
{
"requestId": "9017190968682789840",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "win-asan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e25e6342ea30283ffb8ad7320f48f4462036195b",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9017190968682789840"
},
{
"key": "scheduler_job_id",
"value": "chromium/win-asan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:25:51.814] Scheduled build:
{
"id": "8851760529015101712",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "win-asan"
},
"number": 18015,
"createdBy": "project:chromium",
"createTime": "2021-03-25T19:25:50.707724Z",
"updateTime": "2021-03-25T19:25:51.593818Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e25e6342ea30283ffb8ad7320f48f4462036195b",
"ref": "refs/heads/master"
}
},
"canary": true
}
[19:25:51.814] Task URL: https://cr-buildbucket.appspot.com/build/8851760529015101712
[19:25:51.814] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:17:0) after 8m40s
[19:31:30.990] Received PubSub notification, asking Buildbucket for the build status
[19:31:31.026] Build status: STARTED
[19:34:31.930] Handling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:17:0)
[19:34:31.957] Build status: STARTED
[19:34:31.957] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:19:0) after 4m21s
[19:38:52.959] Handling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:19:0)
[19:38:52.989] Build status: STARTED
[19:38:52.989] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:20:0) after 5m39s
[19:44:32.117] Handling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:20:0)
[19:44:32.176] Build status: STARTED
[19:44:32.176] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:21:0) after 8m10s
[19:52:42.206] Handling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:21:0)
[19:52:42.370] Build status: STARTED
[19:52:42.370] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:22:0) after 6m41s
[19:59:23.532] Handling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:22:0)
[19:59:23.579] Build status: STARTED
[19:59:23.579] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:23:0) after 7m55s
[20:07:18.678] Handling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:23:0)
[20:07:18.726] Build status: STARTED
[20:07:18.726] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:24:0) after 6m14s
[20:13:32.864] Handling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:24:0)
[20:13:32.904] Build status: STARTED
[20:13:32.904] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:25:0) after 3m52s
[20:17:24.934] Handling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:25:0)
[20:17:24.964] Build status: STARTED
[20:17:24.964] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:26:0) after 7m20s
[20:24:44.992] Handling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:26:0)
[20:24:45.147] Build status: STARTED
[20:24:45.147] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:27:0) after 4m11s
[20:28:56.180] Handling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:27:0)
[20:28:56.214] Build status: STARTED
[20:28:56.214] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:28:0) after 5m17s
[20:34:13.363] Handling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:28:0)
[20:34:13.433] Build status: STARTED
[20:34:13.433] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:29:0) after 3m15s
[20:37:28.654] Handling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:29:0)
[20:37:28.707] Build status: STARTED
[20:37:28.707] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:30:0) after 3m15s
[20:40:43.758] Handling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:30:0)
[20:40:43.784] Build status: STARTED
[20:40:43.784] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:31:0) after 7m28s
[20:48:11.814] Handling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:31:0)
[20:48:11.851] Build status: STARTED
[20:48:11.851] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:32:0) after 4m18s
[20:52:30.099] Handling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:32:0)
[20:52:30.125] Build status: STARTED
[20:52:30.125] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:33:0) after 6m59s
[20:59:29.289] Handling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:33:0)
[20:59:29.318] Build status: STARTED
[20:59:29.318] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:34:0) after 3m58s
[21:03:27.346] Handling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:34:0)
[21:03:27.375] Build status: STARTED
[21:03:27.375] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:35:0) after 9m34s
[21:13:01.399] Handling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:35:0)
[21:13:01.435] Build status: STARTED
[21:13:01.435] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:36:0) after 3m20s
[21:16:21.570] Handling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:36:0)
[21:16:21.625] Build status: STARTED
[21:16:21.626] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:9017190968682789840:37:0) after 7m54s
[21:19:21.222] Received PubSub notification, asking Buildbucket for the build status
[21:19:21.264] Build:
{
"id": "8851760529015101712",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "win-asan"
},
"number": 18015,
"createdBy": "project:chromium",
"createTime": "2021-03-25T19:25:50.707724Z",
"startTime": "2021-03-25T19:31:28.987136Z",
"endTime": "2021-03-25T21:19:20.463881767Z",
"updateTime": "2021-03-25T21:19:20.464315182Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e25e6342ea30283ffb8ad7320f48f4462036195b",
"ref": "refs/heads/master"
}
},
"canary": true
}
[21:19:21.264] Invocation finished in 1h59m32.02010734s with status FAILED