Blosc
@Blosc2
Followers
152
Following
51
Media
52
Statuses
242
A fast, compressed and persistent data store library. Get more of your data while consuming less resources. https://t.co/kJkH43503P
Joined February 2019
Unsure about the optimal compression parameters for Blosc2? π Introducing Btune. It predicts the best parameters based on your preferences π Select the best compression ratio, best speed, or a tradeoff between them, and let Btune decide for youπ π https://t.co/ySuZwJdiBt
0
2
5
We recently implemented read-ahead capabilities in Blosc2-Python to interleave computation and I/O as much as possible. Stay tuned for our forthcoming release of Python-Blosc2 3.0. We are working super-hard into it. Make compression better π
0
0
2
π’ Learn how using Blosc2 and Btune is improving the compression ratio of data (both lossless and lossy) coming from photon sciences. We were able also to reach compression speeds exceeding 23 GB/s. Report π https://t.co/VC8DlWnYZe Make compression better π
0
1
4
Caterva2 uses #Python-Blosc2 for achieving high performance compression and out-of-core computation
#Caterva2 cannot only be used for sharing your compressed datasets in the internet, but also to efficiently perform operations on datasets exceeding available memory. Look at our new blog explaining how this works π https://t.co/vEdgGYXvmG Make compression better π
0
0
1
New JPEG2000 codecs, HDF5 integration, deep learning via Btune, sparse data handling and remote Blosc2/HDF5 access and visualization. Check how we have accomplished all these tasks in the framework of the LEAPS-INNOV program: https://t.co/7oMaJS87ZA We make compression better
0
0
2
ANN: C-Blosc2 2.14.4 has been released! π₯³π₯³ This is a patch release where the SOVERSION was bumped since the API changed. For more info see : https://t.co/nryYEiQjth Enjoy!π
github.com
A fast, compressed, persistent binary data store library for C. - Blosc/c-blosc2
0
0
1
ANN: Btune 1.2.0 is out! π₯³π₯³π This is a minor release where new support for tuning compression parameters taking into account not only the compression ratio and speed, but also the quality was added. To get an idea of how this works, see: https://t.co/4dGiRImVtY. Enjoy!
0
0
0
ANN: blosc2-grok 0.3.1 has been released! This is a patch release so that now aarch64/Linux wheels are available. You can have a look at the release notes in: https://t.co/jLpHBTI5ps Enjoy!π
github.com
Blosc2 plugin for grok. Contribute to Blosc/blosc2_grok development by creating an account on GitHub.
0
0
1
ANN: blosc2-grok 0.3.0 is out! π₯³This is a minor release where a simpler way to set the `rates` value through the `codec_meta` from blosc2 cparams was added. For more info, you can have a look at the release notes in: https://t.co/jLpHBTI5ps Enjoy!π
github.com
Blosc2 plugin for grok. Contribute to Blosc/blosc2_grok development by creating an account on GitHub.
0
1
0
π Discover the latest insights in data analysis, compression and visualization with this article from SciPy 2023: https://t.co/BFVxDG08xN Delve into practical techniques and strategies for enhancing performance in Python-based data processing. #DataScience #Python #SciPy2023
0
0
1
ANN: blosc2-grok 0.2.3 is out! πThis is a patch release which fixes a memory leak when decompressing. For more info, you can have a look at the release notes in: https://t.co/jLpHBTI5ps Enjoy!π₯³π₯³
github.com
Blosc2 plugin for grok. Contribute to Blosc/blosc2_grok development by creating an account on GitHub.
0
0
0
ANN: python-blosc2 2.5.1 has been released! π. There, we have updated to the latest C-Blosc 2.13.x, which implemented a new filter for truncating the precision of integers, allowing for lossy compression. More info: https://t.co/C14MKylRAO Enjoy!
github.com
A high-performance library for compressed ndarrays, with a flexible computational engine - Blosc/python-blosc2
1
1
1
ANN: blosc2-grok 0.2.2 is out! π₯³This is a minor release, where the grok library is automatically initialized when needed instead of having to import the package. For more info, you can have a look at the release notes in: https://t.co/jLpHBTI5ps Enjoy!
github.com
Blosc2 plugin for grok. Contribute to Blosc/blosc2_grok development by creating an account on GitHub.
0
0
0
ANN: C-Blosc2 2.13.1 is out!π₯³ This is a patch release for fixing a bug regarding the included files in public headers. For more info, see the release notes: https://t.co/nryYEiQRiP Enjoy data!π·
github.com
A fast, compressed, persistent binary data store library for C. - Blosc/c-blosc2
0
1
0
ANN: C-Blosc2 2.13.0 is out!ππ This is a minor release with several improvements like the optimization of the zstd codec or the creation of a new filter for integers truncation. For more info, see the release notes: https://t.co/nryYEiQjth Enjoy data!π·π
github.com
A fast, compressed, persistent binary data store library for C. - Blosc/c-blosc2
0
1
1
blosc2-grok 0.2.1 is out! π₯³This is a minor release, where the default parameters are automatically changed to the defaults in blosc2-grok without having to call `set_params_defaults`. For more info, you can have a look at the release notes in: https://t.co/jLpHBTI5ps Enjoy! π
github.com
Blosc2 plugin for grok. Contribute to Blosc/blosc2_grok development by creating an account on GitHub.
0
0
0
ANN: C-Blosc2 2.12.0 is out!π₯³π₯³ This is a minor release with several improvements like the registration of the dynamically loaded codec blosc2_grok. For more info, see the release notes: https://t.co/nryYEiQRiP Enjoy data!π
github.com
A fast, compressed, persistent binary data store library for C. - Blosc/c-blosc2
0
0
2
Btune 1.1.0 is out!π₯³π₯³ This is a minor release where added some performance optimizations when creating many arrays instead of one array with many chunks (see https://t.co/266Awdnkz0). For more info see the release notes: https://t.co/0WXqtSR16V Enjoy!π
0
1
0
Recent backport of the upstream #bitshuffle filter, with support for #AVX512, into Blosc2 is providing good vibes on expected performance: up to 20% faster on Zen4 architecture π More info π https://t.co/u4b2H3UbC3
0
1
1
Excited to announce #ZMat 1.0 RC1 - a fast in-memory data compression toolbox for @MATLAB & @GNUOctave A big update is the support of high-speed @Blosc2 metacompressor (by @FrancescAlted) and #ZStd Support zlib/gzip/lz4/lzma/blosc2/zstd with a 600kb mex https://t.co/bBpIroJAIF
github.com
Copyright (C) 2019-2023 Qianqian Fang License: GNU General Public License version 3 (GPL v3), see License*.txt Version: 0.9.9 (Foxy the Fantastic Mr. Fox - RC1) URL: http...
1
1
6
Happy to see how Blosc2 is helping other projects to get better performance. Here it is Blosc2 improving the times of Blosc1 (the current compression default) in @zarr π https://t.co/OnJH2GAsl1
0
1
1