Joe Jevnik
@__qualname__
Followers
389
Following
731
Media
11
Statuses
434
Brooklyn, NY
Joined January 2013
std::simd types should be regular Deviating from standard value-semantic types, the proposed == operator for SIMD types returns a mask instead of bool. This inconsistency detrimentally effects user experience. https://t.co/qASewaVCpC Coauthored with @__qualname__
12
2
33
If you want to deep dive on the string concatenation optimization I mentioned a few days ago, Joe has all the details:
@nedbat I wrote up some comments on these cases and added a few more "slow cases" here: https://t.co/uZqlXNrVkA tl;dr: you need the lhs reference count to be exactly 2, a STORE_(FAST|DEREF|NAME) directly after the (BINARY|INPLACE)_ADD, and the lhs can't already be hashed.
0
3
8
Thanks to our lightning talkers yesterday: https://t.co/FhGmV6MD2H
@MattBachmann @chrisremmel @nedbat @glindahl @__qualname__ @bhrhugs
0
4
4
I've been working on an experiment to add arena allocators to Python. The goal is to reduce the time spent allocating and destroying objects. The motivating use cases are compilers/optimizers that work with AST objects and web server response handlers.
github.com
Arena allocator for Python objects. Contribute to llllllllll/quelling_blade development by creating an account on GitHub.
0
1
10
I was following these docs: https://t.co/MZnduJN1bG and was able create a dtype with scalar conversions to and from PyBytesObject. This dtype supports various operations like np.empty (using NPY_NEEDS_INIT) and np.sort. Right now each element with size > 8 leaks the data ptr.
1
0
0
Does anyone know how to implement a user-defined numpy dtype for types with non-trivial destructors? I'm trying to make a dtype for: struct sbo_string { size_t size; union { char* ptr; char arr[8]; } data; }; I need to be able to free data.ptr
2
0
1
Having someone open a PR to fix the docs in an open source project you started feels great. Having another contributor review and merge the pull request is even better.
0
0
21
Someone described a feature I wrote as: "... probably the craziest python code I have ever seen in my entire life." Strong endorsement.
2
0
32
C++Now 2019: “test_resource: the pmr detective” by Attila Fehér https://t.co/eqmhzA2yyi
#CppNow #cpp #cplusplus
0
2
4
This was also done without making the jlist any larger. I made the tag for homogeneous_ob = 0; and store it in the lower 3 bits of a PyTypeObject*. If the tag == 0, then the pointer holds the PyTypeObject for each element. PyTypeObject is 8 byte aligned so these are always 0
2
0
3
I added support for homogeneous collections of PyObject to jlist. This speeds up elementwise operations (containment, any, sum), as well as sorting for boxed lists. This is similar to the optimizations that list.sort already has, but jlist maintains this type from the start.
1
0
5
Last night I wrote a near drop-in replacement for Python list objects that internally stores unboxed int64s and doubles if possible. Calling append will re-box if needed. It uses the unboxed repr. for faster ops. It even passes the CPython list test suite
github.com
A Python list replacement that's optimized for homogeneous collections. - llllllllll/jlist
7
15
75
Found this gem in the HDF5 frequently asked questions: "Performance-wise, how does HDF5 compare to a relational database? It really depends on your application. HDF5 is tuned to do efficient I/O and storage for "big" data (hundreds of megabytes and more). ..."
0
2
6
I have a ticket for pax tomorrow but can't go, lmk if you are interested.
0
0
0
God bless @scottbsanderson for this wonderful gift! I can't wait to enjoy a delicious meal at my neighborhood Chilli's Grill & Bar!
0
0
11
Super proud of my team at @quantopian today. We announced our first major milestone for international data: pricing and fundamental data for 21 (!) markets: https://t.co/Xme2FghG9F. Excited to see what happens as we expand our (already very global) community around the world!
2
9
48
$ git fetch * [new branch] somebody-once-told-me-the-world-is-gonna-roll-me-i-aint-the-sharpest-tool-in-the-shed -> origin/somebody-once-told-me-the-world-is-gonna-roll-me-i-aint-the-sharpest-tool-in-the-shed @__qualname__ is trolling my bash history now...
1
1
12
First 1e6 integers, represented as binary vectors indicating their prime factors, and laid out using the sparse matrix support in @leland_mcinnes's UMAP dimensionality reduction algorithm. This is from a 1000000x78628 (!) binary matrix. Very pretty structure emerges.
84
2K
5K