about summary refs log tree commit diff
path: root/tvix/eval
diff options
context:
space:
mode:
authorSimon Hauser <simon.hauser@helsinki-systems.de>2024-06-11T10·30+0200
committerclbot <clbot@tvl.fyi>2024-06-14T10·20+0000
commit118e69d81da73a4d55c6ab3ba7e1cc924bd3f506 (patch)
tree5508ae33d75f63b7af6315e07dbe046475734552 /tvix/eval
parenta857a2b978379ff0df66319a1eb6e1c1933cf11e (diff)
fix(tvix/tracing): reduce the error logs of otlp if collector is offline r/8273
The problem is that opentelemetry_otlp tonic batch exporter tries to
exports if either the `scheduled_delay` or if the
`max_export_batch_size` is reached. Per default the
`max_export_batch_size` is set to 512 spans, which means that we try to
export these spans once that counter is reached. Each export will then
try to connect to the exporter (if that not already happening) and will
result in a `tcp connect error`.
Increasing the max_export_batch_size to 4096 will then ensure that the
export only happens if the `scheduled_delay` is met after the 10
seconds.
`max_queue_size` is also increased, because `max_export_batch_size`
should not be greater than `max_queue_size`, so similar to the default
config its set to `max_export_batch_size * 4`.
This will reduce the amount of tries to otlp if the collector is not
available and otlp enabled.

Change-Id: Ic3430006e8a104fa3b34d274678cae55b3620ce9
Reviewed-on: https://cl.tvl.fyi/c/depot/+/11791
Tested-by: BuildkiteCI
Reviewed-by: flokli <flokli@flokli.de>
Autosubmit: Simon Hauser <simon.hauser@helsinki-systems.de>
Diffstat (limited to 'tvix/eval')
0 files changed, 0 insertions, 0 deletions