Combine streams into larger chunks
version 0.11
use Data::Stream::Bulk::Chunked; Data::Stream::Bulk::Chunked->new( stream => $s, chunk_size => 10000, );
This is a stream which wraps an existing stream to give more items in a single block. This can simplify application code which does its own processing one block at a time, and where processing larger blocks is more efficient.
The stream to chunk. Required.
The minimum number of items to return in a block. Defaults to 1 (which does nothing).
See Data::Stream::Bulk::DoneFlag. Returns at least \*(C`chunk_size\*(C' items. Note that this isn't guaranteed to return exactly \*(C`chunk_size\*(C' items - it just returns multiple full blocks from the backend. Also, the final block returned may have less than \*(C`chunk_size\*(C' items.
Yuval Kogman <[email protected]>
This software is copyright (c) 2012 by Yuval Kogman.
This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.