Mercurial > hg > Lemuriformes
view lemuriformes/chunk.py @ 6:244c29f46554
add module for chunking data
| author | Jeff Hammel <k0scist@gmail.com> | 
|---|---|
| date | Sun, 10 Dec 2017 11:52:37 -0800 | 
| parents | |
| children | 
line wrap: on
 line source
def chunk(data, chunksize=100000): """ chunk `data` into smaller sizes of `chunksize` """ offset = 0 chunk = data[0:chunksize] while chunk: yield chunk offset += chunksize chunk = data[offset:offset+chunksize]
