Add `ByteFill`, representing a number of bytes filled with a single value,
replacing `{{,Backward}Writer,DigesterHandle}::Write{Zeros,Chars,Bytes}()` and
`{Array,Chain,Cord}OfZeros()`, and providing iteration over blocks which are
convertible to `ExternalRef`.

This makes it easier to combine writing repetitions with writing other objects
in a single variadic call to `Write()` or `DigestFrom()`.

This also makes it easier to implement materializing the sequence by iterating
over blocks.

`WriteSlow(ByteFill)` is virtual, replacing virtual `WriteZerosSlow()` and
non-virtual `WriteCharsSlow()`. This means that filling with a value other than
zero is customizable too, at the cost of having to customize for any value even
if only filling with zeros is customizable in an interesting way.

PiperOrigin-RevId: 658855384
69 files changed
tree: 6506e9764f031a5d4e8979c09894051b3308aecb
  1. doc/
  2. python/
  3. riegeli/
  4. tf_dependency/
  5. .bazelrc
  6. configure
  7. CONTRIBUTING.md
  8. LICENSE
  9. MANIFEST.in
  10. MODULE.bazel
  11. README.md
README.md

Riegeli

Riegeli/records is a file format for storing a sequence of string records, typically serialized protocol buffers. It supports dense compression, fast decoding, seeking, detection and optional skipping of data corruption, filtering of proto message fields for even faster decoding, and parallel encoding.

See documentation.

Status

Riegeli file format will only change in a backward compatible way (i.e. future readers will understand current files, but current readers might not understand files using future features).

Riegeli C++ API might change in incompatible ways.