1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44
|
# BufferedTokenizer
[][gem]
[][build]
[gem]: https://rubygems.org/gems/buftok
[build]: https://github.com/sferik/buftok/actions
###### Statefully split input data by a specifiable token
BufferedTokenizer takes a delimiter upon instantiation, or acts line-based by
default. It allows input to be spoon-fed from some outside source which
receives arbitrary length datagrams which may-or-may-not contain the token by
which entities are delimited. In this respect it's ideally paired with
something like [EventMachine][].
[EventMachine]: http://rubyeventmachine.com/
## Supported Ruby Versions
This library aims to support and is [tested against][build] the following Ruby
implementations:
* Ruby 2.6
* Ruby 2.7
* Ruby 3.0
If something doesn't work on one of these interpreters, it's a bug.
This code will likely still work on older versions since it has not undergone
many changes since release. However, support will not be provided for
end-of-life ruby versions.
If you would like this library to support another Ruby version, you may
volunteer to be a maintainer. Being a maintainer entails making sure all tests
run and pass on that implementation. When something breaks on your
implementation, you will be responsible for providing patches in a timely
fashion. If critical issues for a particular implementation exist at the time
of a major release, support for that Ruby version may be dropped.
## Copyright
Copyright (c) 2006-2021 Tony Arcieri, Martin Emde, Erik Michaels-Ober.
Distributed under the [MIT license][license].
[license]: https://opensource.org/licenses/MIT
|