Sorted Containers -- Sorted List, Sorted Dict, Sorted Set
Sorted Containers_ is an Apache2 licensed sorted collections library_,
written in pure-Python, and fast as C-extensions.
Python's standard library is great until you need a sorted collections type. Many will attest that you can get really far without one, but the moment you really need a sorted list, sorted dict, or sorted set, you're faced with a dozen different implementations, most using C-extensions without great documentation and benchmarking.
In Python, we can do better. And we can do it in pure-Python!
.. code-block:: python
>>> from sortedcontainers import SortedList
>>> sl = SortedList(['e', 'a', 'c', 'd', 'b'])
>>> sl
SortedList(['a', 'b', 'c', 'd', 'e'])
>>> sl *= 10_000_000
>>> sl.count('c')
10000000
>>> sl[-3:]
['e', 'e', 'e']
>>> from sortedcontainers import SortedDict
>>> sd = SortedDict({'c': 3, 'a': 1, 'b': 2})
>>> sd
SortedDict({'a': 1, 'b': 2, 'c': 3})
>>> sd.popitem(index=-1)
('c', 3)
>>> from sortedcontainers import SortedSet
>>> ss = SortedSet('abracadabra')
>>> ss
SortedSet(['a', 'b', 'c', 'd', 'r'])
>>> ss.bisect_left('c')
2
All of the operations shown above run in faster than linear time. The above demo also takes nearly a gigabyte of memory to run. When the sorted list is multiplied by ten million, it stores ten million references to each of "a" through "e". Each reference requires eight bytes in the sorted container. That's pretty hard to beat as it's the cost of a pointer to each object. It's also 66% less overhead than a typical binary tree implementation (e.g. Red-Black Tree, AVL-Tree, AA-Tree, Splay-Tree, Treap, etc.) for which every node must also store two pointers to children nodes.
Sorted Containers_ takes all of the work out of Python sorted collections -
making your deployment and use of Python easy. There's no need to install a C
compiler or pre-build and distribute custom extensions. Performance is a
feature and testing has 100% coverage with unit tests and hours of stress.
.. _Sorted Containers: http://www.grantjenks.com/docs/sortedcontainers/
.. _sorted collections library: http://www.grantjenks.com/docs/sortedcontainers/
Alex Martelli, Fellow of the Python Software Foundation_
"Good stuff! ... I like the simple, effective implementation_ idea of
splitting the sorted containers into smaller "fragments" to avoid the O(N)
insertion costs."
Jeff Knupp, author of Writing Idiomatic Python and Python Trainer_
"That last part, "fast as C-extensions," was difficult to believe. I would need
some sort of Performance Comparison_ to be convinced this is true. The author
includes this in the docs. It is."
Kevin Samuel, Python and Django Trainer_
I'm quite amazed, not just by the code quality (it's incredibly readable and has more comment than code, wow), but the actual amount of work you put at stuff that is not code: documentation, benchmarking, implementation explanations. Even the git log is clean and the unit tests run out of the box on Python 2 and 3.
Mark Summerfield, a short plea for Python Sorted Collections_
Python's "batteries included" standard library seems to have a battery missing. And the argument that "we never had it before" has worn thin. It is time that Python offered a full range of collection classes out of the box, including sorted ones.
Sorted Containers_ is used in popular open source projects such as:
Zipline, an algorithmic trading library from Quantopian; Angr, a binary
analysis platform from UC Santa Barbara; Trio, an async I/O library; and
Dask Distributed, a distributed computation library supported by Continuum
Analytics.
.. _Fellow of the Python Software Foundation: https://en.wikipedia.org/wiki/Alex_Martelli
.. _simple, effective implementation: http://www.grantjenks.com/docs/sortedcontainers/implementation.html
.. _author of Writing Idiomatic Python and Python Trainer: https://jeffknupp.com/
.. _Python and Django Trainer: https://www.elephorm.com/formateur/kevin-samuel
.. _Python Sorted Collections: http://www.qtrac.eu/pysorted.html
.. _Zipline: https://github.com/quantopian/zipline
.. _Angr: https://github.com/angr/angr
.. _Trio: https://github.com/python-trio/trio
.. _Dask Distributed: https://github.com/dask/distributed
.. image:: https://api.travis-ci.org/grantjenks/python-sortedcontainers.svg?branch=master :target: http://www.grantjenks.com/docs/sortedcontainers/
.. image:: https://ci.appveyor.com/api/projects/status/github/grantjenks/python-sortedcontainers?branch=master&svg=true :target: http://www.grantjenks.com/docs/sortedcontainers/
Installing Sorted Containers_ is simple with pip <https://pypi.org/project/pip/>_::
$ pip install sortedcontainers
You can access documentation in the interpreter with Python's built-in help
function. The help works on modules, classes and methods in Sorted Containers_.
.. code-block:: python
>>> import sortedcontainers
>>> help(sortedcontainers)
>>> from sortedcontainers import SortedDict
>>> help(SortedDict)
>>> help(SortedDict.popitem)
Complete documentation for Sorted Containers_ is available at
http://www.grantjenks.com/docs/sortedcontainers/
User Guide ..........
The user guide provides an introduction to Sorted Containers_ and extensive
performance comparisons and analysis.
Introduction_Performance Comparison_Load Factor Performance Comparison_Runtime Performance Comparison_Simulated Workload Performance Comparison_Performance at Scale_.. _Introduction: http://www.grantjenks.com/docs/sortedcontainers/introduction.html
.. _Performance Comparison: http://www.grantjenks.com/docs/sortedcontainers/performance.html
.. _Load Factor Performance Comparison: http://www.grantjenks.com/docs/sortedcontainers/performance-load.html
.. _Runtime Performance Comparison: http://www.grantjenks.com/docs/sortedcontainers/performance-runtime.html
.. _Simulated Workload Performance Comparison: http://www.grantjenks.com/docs/sortedcontainers/performance-workload.html
.. _Performance at Scale: http://www.grantjenks.com/docs/sortedcontainers/performance-scale.html
Community Guide ...............
The community guide provides information on the development of Sorted Containers_ along with support, implementation, and history details.
Development and Support_Implementation Details_Release History_.. _Development and Support: http://www.grantjenks.com/docs/sortedcontainers/development.html
.. _Implementation Details: http://www.grantjenks.com/docs/sortedcontainers/implementation.html
.. _Release History: http://www.grantjenks.com/docs/sortedcontainers/history.html
API Documentation .................
The API documentation provides information on specific functions, classes, and
modules in the Sorted Containers_ package.
Sorted List_Sorted Dict_Sorted Set_.. _Sorted List: http://www.grantjenks.com/docs/sortedcontainers/sortedlist.html
.. _Sorted Dict: http://www.grantjenks.com/docs/sortedcontainers/sorteddict.html
.. _Sorted Set: http://www.grantjenks.com/docs/sortedcontainers/sortedset.html
Python Sorted Collections | PyCon 2016 Talk_SF Python Holiday Party 2015 Lightning Talk_DjangoCon 2015 Lightning Talk_.. _Python Sorted Collections | PyCon 2016 Talk: http://www.grantjenks.com/docs/sortedcontainers/pycon-2016-talk.html
.. _SF Python Holiday Party 2015 Lightning Talk: http://www.grantjenks.com/docs/sortedcontainers/sf-python-2015-lightning-talk.html
.. _DjangoCon 2015 Lightning Talk: http://www.grantjenks.com/docs/sortedcontainers/djangocon-2015-lightning-talk.html
Sorted Containers Documentation_Sorted Containers at PyPI_Sorted Containers at Github_Sorted Containers Issue Tracker_.. _Sorted Containers Documentation: http://www.grantjenks.com/docs/sortedcontainers/
.. _Sorted Containers at PyPI: https://pypi.org/project/sortedcontainers/
.. _Sorted Containers at Github: https://github.com/grantjenks/python-sortedcontainers
.. _Sorted Containers Issue Tracker: https://github.com/grantjenks/python-sortedcontainers/issues
Copyright 2014-2019 Grant Jenks
Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.