fucking-awesome-python/README.md
2015-10-15 12:12:38 +07:00

97 KiB
Raw Blame History

Fucking Awesome Python

A curated list with Github stars and forks stats based on awesome awesome-python, inspired by fucking-awesome-go

Awesome Python Awesome

A curated list of awesome Python frameworks, libraries and software. Inspired by awesome-php.


Environment Management

Libraries for Python version and environment management.

Package Management

Libraries for package and dependency management.

Package Repositories

Local PyPI repository server and proxies.

Distribution

Libraries to create packaged executables for release distribution.

  • :octocat: PyInstaller - Converts Python programs into stand-alone executables (cross-platform). 1191 🍴 329
  • 🌎 dh-virtualenv - Build and distribute a virtualenv as a Debian package.
  • 🌎 Nuitka - Compile scripts, modules, packages to an executable or extension module.
  • 🌎 py2app - Freezes Python scripts (Mac OS X).
  • 🌎 py2exe - Freezes Python scripts (Windows).
  • 🌎 pynsist - A tool to build Windows installers, installers bundle Python itself.

Build Tools

Compile software from source code.

  • 🌎 buildout - A build system for creating, assembling and deploying applications from multiple parts.
  • 🌎 BitBake - A make-like build tool for embedded Linux.
  • 🌎 fabricate - A build tool that finds dependencies automatically for any language.
  • :octocat: PlatformIO - A console tool to build code with different development platforms. 288 🍴 39
  • :octocat: PyBuilder - A continuous build tool written in pure Python. 479 🍴 116
  • 🌎 SCons - A software construction tool.

Interactive Interpreter

Interactive Python interpreters (REPL).

Files

Libraries for file manipulation and MIME type detection.

  • 🌎 imghdr - (Python standard library) Determine the type of an image.
  • 🌎 mimetypes - (Python standard library) Map filenames to MIME types.
  • :octocat: path.py - A module wrapper for os.path. 541 🍴 71
  • 🌎 pathlib - (Python standard library in Python 3.4+) An cross-platform, object-oriented path library.
  • :octocat: python-magic - A Python interface to the libmagic file type identification library. 526 🍴 83
  • :octocat: Unipath - An object-oriented approach to file/directory operations. 317 🍴 27
  • :octocat: watchdog - API and shell utilities to monitor file system events. 1810 🍴 237

Date and Time

Libraries for working with dates and times.

  • :octocat: arrow - Better dates & times for Python. 2534 🍴 216
  • :octocat: Chronyk - A Python 3 library for parsing human-written times and dates. 202 🍴 7
  • 🌎 dateutil - Extensions to the standard Python datetime module.
  • :octocat: delorean - A library for clearing up the inconvenient truths that arise dealing with datetimes. 844 🍴 49
  • :octocat: moment - A Python library for dealing with dates/times. Inspired by Moment.js. 251 🍴 9
  • :octocat: PyTime - A easy-use Python module which aims to operate date/time/datetime by string. 94 🍴 9
  • 🌎 pytz - World timezone definitions, modern and historical. Brings the tz database into Python.
  • :octocat: when.py - Providing user-friendly functions to help perform common date and time actions. 127 🍴 10

Text Processing

Libraries for parsing and manipulating plain texts.

Specific Formats Processing

Libraries for parsing and manipulating specific text formats.

  • General
    • :octocat: tablib - A module for Tabular Datasets in XLS, CSV, JSON, YAML. 1592 🍴 221
  • Office
    • :octocat: Marmir - Takes Python data structures and turns them into spreadsheets. 109 🍴 15
    • 🌎 openpyxl - A library for reading and writing Excel 2010 xlsx/xlsm/xltx/xltm files.
    • :octocat: python-docx - Reads, queries and modifies Microsoft Word 2007/2008 docx files. 370 🍴 135
    • :octocat: unoconv - Convert between any document format supported by LibreOffice/OpenOffice. 598 🍴 197
    • 🌎 XlsxWriter - A Python module for creating Excel .xlsx files.
    • 🌎 xlwings - A BSD-licensed library that makes it easy to call Python from Excel and vice versa.
    • :octocat: xlwt / xlrd - Writing and reading data and formatting information from Excel files. 442 🍴 153
  • PDF
    • :octocat: PDFMiner - A tool for extracting information from PDF documents. 1224 🍴 308
    • :octocat: PyPDF2 - A library capable of splitting, merging and transforming PDF pages. 751 🍴 230
    • 🌎 ReportLab - Allowing Rapid creation of rich PDF documents.
  • Markdown
  • YAML
  • CSV
    • :octocat: csvkit - Utilities for converting to and working with CSV. 1707 🍴 264
  • Archive
    • :octocat: unp - A command line tool that can unpack archives easily. 209 🍴 8

Natural Language Processing

Libraries for working with human languages.

  • 🌎 NLTK - A leading platform for building Python programs to work with human language data.
  • :octocat: jieba - Chinese Words Segmentation Utilities. 3790 🍴 1188
  • :octocat: langid.py - Stand-alone language identification system. 438 🍴 79
  • 🌎 Pattern - A web mining module for the Python.
  • :octocat: SnowNLP - A library for processing Chinese text. 1039 🍴 272
  • 🌎 TextBlob - Providing a consistent API for diving into common NLP tasks.

Documentation

Libraries for generating project documentation.

Configuration

Libraries for storing configuration options.

Command-line Tools

Libraries for building command-line application.

  • Command-line Application Development
    • 🌎 cement - Providing a light-weight and fully featured foundation to build anything from single file scripts to complex and intricately designed applications.
    • 🌎 click - A package for creating beautiful command line interfaces in a composable way.
    • 🌎 cliff - A framework for creating command-line programs with multi-level commands.
    • 🌎 Clime Clime lets you convert any module into a multi-command CLI program without any configuration.
    • :octocat: clint - Python Command-line Application Tools. 1817 🍴 169
    • 🌎 colorama - Cross-platform colored terminal text.
    • 🌎 docopt - Pythonic command line arguments parser.
    • :octocat: Gooey - Turn command line programs into a full GUI application with one line 3695 🍴 175
    • 🌎 pyCLI - Command-line applications supporting standard command line parsing, logging, unit and functional testing.
    • :octocat: python-prompt-toolkit - A Library for building powerful interactive command lines. 1722 🍴 81
  • Productivity Tools
    • :octocat: bashplotlib - Making basic plots in the terminal. It's a quick way to visualize data without GUI. 321 🍴 26
    • :octocat: caniusepython3 - Determine what projects are blocking you from porting to Python 3. 207 🍴 21
    • :octocat: cookiecutter - A command-line utility that creates projects from cookiecutters (project templates). E.g. Python package projects, jQuery plugin projects. 2403 🍴 289
    • :octocat: doitlive - A tool for live presentations in the terminal. 602 🍴 19
    • :octocat: httpie - A command line HTTP client, a user-friendly cURL replacement. 18125 🍴 1030
    • :octocat: PathPicker - Select files out of bash output. 2541 🍴 122
    • :octocat: percol - Adds flavor of interactive selection to the traditional pipe concept on UNIX. 1805 🍴 72
    • 🌎 RainbowStream - Smart and nice Twitter client on terminal.
    • :octocat: thefuck - Correcting your previous console command. 14686 🍴 692

Downloader

Libraries for downloading.

  • :octocat: coursera - Script for downloading Coursera.org videos and naming them. 2501 🍴 921
  • :octocat: s3cmd - A command line tool for managing Amazon S3 and CloudFront. 1586 🍴 523
  • :octocat: s4cmd - Super S3 command line tool, good for higher performance. 287 🍴 55
  • :octocat: subliminal - Library and command line tool to search and download subtitles. 789 🍴 183
  • :octocat: WikiTeam - Tools for downloading and preserving wikis. 80 🍴 29
  • 🌎 you-get - A YouTube/Youku/Niconico video downloader written in Python 3.
  • 🌎 youtube-dl - A small command-line program to download videos from YouTube.

Imagery

Libraries for manipulating images.

OCR

Libraries for Optical Character Recognition.

Audio

Libraries for manipulating audio.

Video

Libraries for manipulating video and GIFs.

Geolocation

Libraries for geocoding addresses and working with latitudes and longitudes.

HTTP

Libraries for working with HTTP.

  • 🌎 requests - HTTP Requests for Humans™.
  • :octocat: grequests - requests + gevent for asynchronous HTTP requests. 1127 🍴 134
  • :octocat: httplib2 - Comprehensive HTTP client library. 293 🍴 146
  • :octocat: treq - Python requests like API built on top of Twisted's HTTP client. 211 🍴 60
  • :octocat: urllib3 - A HTTP library with thread-safe connection pooling, file post support, sanity friendly. 915 🍴 277

Database

Databases implemented in Python.

  • 🌎 pickleDB - A simple and lightweight key-value store for Python.
  • 🌎 PipelineDB - The Streaming SQL Database.
  • :octocat: TinyDB - A tiny, document-oriented database. 538 🍴 39
  • 🌎 ZODB - A native object database for Python. A key-value and object graph database.

Database Drivers

Libraries for connecting and operating databases.

ORM

Libraries that implement Object-Relational Mapping or data mapping techniques.

Web Frameworks

Full stack web frameworks.

Permissions

Libraries that allow or deny users access to data or functionality.

  • 🌎 Carteblanche - Module to align code with thoughts of users and designers. Also magically handles navigation and permissions.
  • :octocat: django-guardian - Implementation of per object permissions for Django 1.2+ 957 🍴 272
  • :octocat: django-rules - A tiny but powerful app providing object-level permissions to Django, without requiring a database. 227 🍴 18

CMS

Content Management Systems.

  • 🌎 django-cms - An Open source enterprise CMS based on the Django.
  • 🌎 djedi-cms - A lightweight but yet powerful Django CMS with plugins, inline editing and performance in mind.
  • 🌎 FeinCMS - One of the most advanced Content Management Systems built on Django.
  • 🌎 Kotte - A high-level, Pythonic web application framework built on Pyramid.
  • 🌎 Mezzanine - A powerful, consistent, and flexible content management platform.
  • 🌎 Opps - A Django-based CMS for magazines, newspapers websites and portals with high-traffic.
  • 🌎 Plone - A CMS built on top of the open source application server Zope.
  • 🌎 Quokka - Flexible, extensible, small CMS powered by Flask and MongoDB.
  • 🌎 Wagtail - A Django content management system.
  • 🌎 Widgy - Last CMS framework, based on Django.

E-commerce

Frameworks and libraries for e-commerce and payments.

RESTful API

Libraries for developing RESTful APIs.

  • 🌎 django-rest-framework - A powerful and flexible toolkit that makes it easy to build Web APIs.
  • 🌎 django-tastypie - Creating delicious APIs for Django apps.
  • :octocat: django-formapi - Create JSON APIs with HMAC authentication and Django form-validation. 17 🍴 9
  • 🌎 flask-api - Browsable Web APIs for Flask.
  • 🌎 flask-restful - An extension for Flask that adds support for quickly building REST APIs.
  • 🌎 flask-restless - Generating RESTful APIs for database models defined with SQLAlchemy.
  • :octocat: flask-api-utils - Flask extension that takes care of API representation and authentication. 20 🍴 2
  • 🌎 falcon - A high-performance Python framework for building cloud APIs and web app backends.
  • :octocat: eve - REST API framework powered by Flask, MongoDB and good intentions. 2639 🍴 360
  • :octocat: sandman - Automated REST APIs for existing database-driven systems. 2102 🍴 163
  • 🌎 restless - Framework agnostic REST framework based on lessons learned from TastyPie.
  • :octocat: savory-pie - REST API building library (Django, and others) 5 🍴 7
  • :octocat: ripozo - Quickly creating REST/HATEOAS/Hypermedia APIs with extensions for Flask and Django. 109 🍴 5
  • 🌎 cornice - A REST framework for Pyramid.

Authentication

Libraries for implementing authentications schemes.

Template Engine

Libraries and tools for templating and lexing.

  • :octocat: Jinja2 - A modern and designer friendly templating language. 2751 🍴 564
  • 🌎 Chameleon - An HTML/XML template engine. Modeled after ZPT, optimized for speed.
  • 🌎 Genshi - Python templating toolkit for generation of web-aware output.
  • 🌎 Mako - Hyperfast and lightweight templating for the Python platform.
  • 🌎 Spitfire - A very fast Python template compiler.

Queue

Libraries for working with event and task queues.

  • 🌎 celery - An asynchronous task queue/job queue based on distributed message passing.
  • :octocat: huey - Little multi-threaded task queue. 746 🍴 72
  • :octocat: mrq - Mr. Queue - A distributed worker task queue in Python using Redis & gevent. 309 🍴 17
  • 🌎 rq - Simple job queues for Python.
  • :octocat: simpleq - A simple, infinitely scalable, Amazon SQS based queue. 88 🍴 5

Libraries and software for indexing and performing search queries on data.

News Feed

Libraries for building user's activities.

Asset Management

Tools for managing, compressing and minifying website assets.

Caching

Libraries for caching data.

Email

Libraries for sending and parsing email.

Internationalization

Libraries for working with i18n.

URL Manipulation

Libraries for parsing URLs.

  • :octocat: furl - A small Python library that makes manipulating URLs simple. 826 🍴 53
  • :octocat: purl - A simple, immutable URL class with a clean API for interrogation and manipulation. 130 🍴 17
  • :octocat: pyshorteners - A pure Python URL shortening lib. 84 🍴 16
  • :octocat: short_url - Python implementation for generating Tiny URL and bit.ly-like URLs. 39 🍴 6
  • :octocat: webargs - A friendly library for parsing HTTP request arguments, with built-in support for popular web frameworks, including Flask, Django, Bottle, Tornado, and Pyramid. 233 🍴 25

HTML Manipulation

Libraries for working with HTML and XML.

  • 🌎 BeautifulSoup - Providing Pythonic idioms for iterating, searching, and modifying HTML or XML.
  • 🌎 bleach - A whitelist-based HTML sanitization and text linkification library.
  • 🌎 cssutils - A CSS library for Python.
  • :octocat: html5lib - A standards-compliant library for parsing and serializing HTML documents and fragments. 380 🍴 90
  • 🌎 lxml - A very fast, easy-to-use and versatile library for handling HTML and XML.
  • :octocat: MarkupSafe - Implements a XML/HTML/XHTML Markup safe string for Python. 95 🍴 40
  • :octocat: pyquery - A jQuery-like library for parsing HTML. 792 🍴 73
  • :octocat: untangle - Converts XML documents to Python objects for easy access. 116 🍴 12
  • :octocat: xhtml2pdf - HTML/CSS to PDF converter. 1021 🍴 367
  • :octocat: xmltodict - Working with XML feel like you are working with JSON. 1767 🍴 161

Web Crawling

Libraries for scraping websites.

Web Content Extracting

Libraries for extracting web contents.

Forms

Libraries for working with forms.

Data Validation

Libraries for validating data. Used for forms in many cases.

  • 🌎 Cerberus - A mappings-validator with a variety of rules, normalization-features and simple customization that uses a pythonic schema-definition.
  • 🌎 colander - A system for validating and deserializing data obtained via XML, JSON, an HTML form post or any other equally simple data serialization.
  • :octocat: kmatch - A language for matching/validating/filtering Python dictionaries. 36 🍴 4
  • :octocat: schema - A library for validating Python data structures. 642 🍴 61
  • :octocat: Schematics - Data Structure Validation. 1439 🍴 187
  • :octocat: valideer - Lightweight extensible data validation and adaptation library. 144 🍴 7
  • :octocat: voluptuous - A Python data validation library. It is primarily intended for validating data coming into Python as JSON, YAML, etc. 465 🍴 73

Anti-spam

Libraries for fighting spam.

Tagging

Libraries for tagging items.

Admin Panels

Libraries for administrative interfaces.

  • :octocat: Ajenti - The admin panel your servers deserve. 61 🍴 13
  • 🌎 django-suit - Alternative Django Admin-Interface (free only for Non-commercial use).
  • :octocat: django-xadmin - Drop-in replacement of Django admin comes with lots of goodies. 1421 🍴 433
  • :octocat: flask-admin - Simple and extensible administrative interface framework for Flask. 21 🍴 6
  • :octocat: flower - Real-time monitor and web admin for Celery. 1408 🍴 258
  • 🌎 Grappelli A jazzy skin for the Django Admin-Interface.
  • :octocat: Wooey - A Django app which creates automatic web UIs for Python scripts. 483 🍴 26

Static Site Generator

Static site generator is a software that takes some text + templates as input and produces HTML files on the output.

  • 🌎 Pelican - Uses Markdown or ReST for content and Jinja 2 for themes. Supports DVCS, Disqus. AGPL.
  • 🌎 Cactus Static site generator for designers.
  • 🌎 Hyde - Jinja2-based static web site generator.
  • 🌎 Nikola - A static website and blog generator.
  • 🌎 Tinkerer - Tinkerer is a blogging engine/.static website generator powered by Sphinx.

Processes

Libraries for starting and communicating with OS processes.

Concurrency and Parallelism

Libraries for concurrent and parallel execution.

Networking

Libraries for networking programming.

  • 🌎 asyncio - (Python standard library) Asynchronous I/O, event loop, coroutines and tasks.
  • 🌎 Tornado - A Web framework and asynchronous networking library.
  • 🌎 Twisted - An event-driven networking engine.
  • :octocat: pulsar - Event-driven concurrent framework for Python. 1132 🍴 63
  • :octocat: diesel - Greenlet-based event I/O Framework for Python. 510 🍴 51
  • 🌎 pyzmq - A Python wrapper for the ZeroMQ message library.
  • :octocat: txZMQ - Twisted based wrapper for the ZeroMQ message library. 110 🍴 34

WebSocket

Libraries for working with WebSocket.

WSGI Servers

WSGI-compatible web servers.

  • 🌎 gunicorn - Pre-forked, partly written in C.
  • 🌎 uwsgi - A project aims at developing a full stack for building hosting services, written in C.
  • 🌎 bjoern - Asynchronous, very fast and written in C.
  • 🌎 fapws3 - Asynchronous (network side only), written in C.
  • 🌎 meinheld - Asynchronous, partly written in C.
  • :octocat: netius - Asynchronous, very fast. 29 🍴 1
  • 🌎 paste - Multi-threaded, stable, tried and tested.
  • 🌎 rocket - Multi-threaded.
  • 🌎 waitress - Multi-threaded, poweres Pyramid.
  • 🌎 Werkzeug - A WSGI utility library for Python that powers Flask and can easily be embedded into your own projects.

RPC Servers

RPC-compatible servers.

Cryptography

  • 🌎 cryptography - A package designed to expose cryptographic primitives and recipes to Python developers.
  • :octocat: hashids - Implementation of hashids in Python. 333 🍴 32
  • 🌎 Paramiko - A Python (2.6+, 3.3+) implementation of the SSHv2 protocol, providing both client and server functionality.
  • 🌎 Passlib - Secure password storage/hashing library, very high level.
  • 🌎 PyCrypto - The Python Cryptography Toolkit.
  • :octocat: PyNacl - Python binding to the Networking and Cryptography (NaCl) library. 227 🍴 43

GUI

Libraries for working with graphical user interface applications.

  • 🌎 curses - Built-in wrapper for ncurses used to create terminal GUI applications.
  • :octocat: enaml - Creating beautiful user-interfaces with Declaratic Syntax like QML. 408 🍴 52
  • 🌎 kivy - A library for creating NUI applications, running on Windows, Linux, Mac OS X, Android and iOS.
  • 🌎 pyglet - A cross-platform windowing and multimedia library for Python.
  • 🌎 PyQt - Python bindings for the Qt cross-platform application and UI framework, with support for both Qt v4 and Qt v5 frameworks.
  • 🌎 PySide - Python bindings for the Qt cross-platform application and UI framework, supporting the Qt v4 framework.
  • 🌎 Tkinter - Tkinter is Python's de-facto standard GUI package.
  • :octocat: Toga - A Python native, OS native GUI toolkit. 687 🍴 47
  • 🌎 urwid - A library for creating terminal GUI applications with strong support for widgets, events, rich colors, etc.
  • 🌎 wxPython - A blending of the wxWidgets C++ class library with the Python.

Game Development

Awesome game development libraries.

  • 🌎 Cocos2d - cocos2d is a framework for building 2D games, demos, and other graphical/interactive applications. It is based on pyglet.
  • 🌎 Panda3D - 3D game engine developed by Disney and maintained by Carnegie Mellon's Entertainment Technology Center. Written in C++, completely wrapped in Python.
  • 🌎 Pygame - Pygame is a set of Python modules designed for writing games.
  • 🌎 PyOgre - Python bindings for the Ogre 3D render engine, can be used for games, simulations, anything 3D.
  • 🌎 PyOpenGL - Python ctypes bindings for OpenGL and it's related APIs.
  • 🌎 PySDL2 - A ctypes based wrapper for the SDL2 library.
  • 🌎 PySFML - Python bindings for SFML
  • 🌎 RenPy - A Visual Novel engine.

Logging

Libraries for generating and working with logs.

Testing

Libraries for testing codebases and generating test data.

  • Testing Frameworks
  • Web Testing
  • Mock
    • 🌎 mock - (Python standard library) A mocking and patching library.
    • 🌎 doublex - Powerful test doubles framework for Python.
    • :octocat: freezegun - Travel through time by mocking the datetime module. 566 🍴 54
    • :octocat: httmock - A mocking library for requests for Python 2.6+ and 3.2+. 217 🍴 21
    • 🌎 httpretty - HTTP request mock tool for Python.
    • :octocat: responses - A utility library for mocking out the requests Python library. 1063 🍴 81
    • :octocat: VCR.py - Record and replay HTTP interactions on your tests. 525 🍴 80
  • Object Factories
    • :octocat: factory_boy - A test fixtures replacement for Python. 768 🍴 111
    • :octocat: mixer - Another fixtures replacement. Supported Django, Flask, SQLAlchemy, Peewee and etc. 259 🍴 27
    • :octocat: model_mommy - Creating random fixtures for testing in Django. 528 🍴 116
  • Code Coverage
  • Fake Data
  • Error Handler
    • :octocat: FuckIt.py - FuckIt.py uses state-of-the-art technology to make sure your Python code runs whether it has any right to or not. 1868 🍴 70

Code Analysis and Linter

Libraries and tools for analysing, parsing and manipulation codebases.

  • Code Analysis
    • :octocat: code2flow - Turn your Python and JavaScript code into DOT flowcharts. 184 🍴 22
    • :octocat: pycallgraph - A library that visualises the flow (call graph) of your Python application. 525 🍴 88
    • :octocat: pysonar2 - A type inferencer and indexer for Python. 1737 🍴 447
  • Linter
    • 🌎 Flake8 - The modular source code checker: pep8, pyflakes and co.
    • 🌎 Pylint - A source code analyzer.
    • 🌎 pylama - Code audit tool for Python and JavaScript.

Debugging Tools

Libraries for debugging code.

Science and Data Analysis

Libraries for scientific computing and data analyzing.

  • 🌎 astropy - A community Python library for Astronomy.
  • :octocat: bcbio-nextgen - A toolkit providing best-practice pipelines for fully automated high throughput sequencing analysis. 241 🍴 122
  • :octocat: bccb - Collection of useful code related to biological analysis. 277 🍴 133
  • 🌎 Biopython - Biopython is a set of freely available tools for biological computation.
  • 🌎 blaze - NumPy and Pandas interface to Big Data.
  • 🌎 cclib - A library for parsing and interpreting the results of computational chemistry packages.
  • 🌎 NetworkX - A high-productivity software for complex networks.
  • 🌎 Numba - Python JIT (just in time) complier to LLVM aimed at scientific Python by the developers of Cython and NumPy.
  • 🌎 NumPy - A fundamental package for scientific computing with Python.
  • 🌎 Open Babel - A chemical toolbox designed to speak the many languages of chemical data.
  • :octocat: Open Mining - Business Intelligence (BI) in Python (Pandas web interface) 475 🍴 72
  • 🌎 orange - Data mining, data visualization, analysis and machine learning through visual programming or Python scripting.
  • 🌎 Pandas - A library providing high-performance, easy-to-use data structures and data analysis tools.
  • 🌎 PyDy - Short for Python Dynamics, used to assist with workflow in the modeling of dynamic motion based around NumPy, SciPy, IPython, and matplotlib.
  • :octocat: PyMC - Markov Chain Monte Carlo sampling toolkit. 1240 🍴 263
  • 🌎 RDKit - Cheminformatics and Machine Learning Software.
  • 🌎 SciPy - A Python-based ecosystem of open-source software for mathematics, science, and engineering.
  • :octocat: statsmodels - Statistical modeling and econometrics in Python. 1149 🍴 505
  • :octocat: SymPy - A Python library for symbolic mathematics. 2395 🍴 1173
  • :octocat: zipline - A Pythonic algorithmic trading library. 2593 🍴 710

Data Visualization

Libraries for visualizing data. See: awesome-javascript.

Computer Vision

Libraries for computer vision.

  • 🌎 OpenCV - Open Source Computer Vision Library.
  • 🌎 SimpleCV - An open source framework for building computer vision applications.

Machine Learning

Libraries for Machine Learning. See: awesome-machine-learning.

MapReduce

Framworks and libraries for MapReduce.

  • :octocat: dpark - Python clone of Spark, a MapReduce alike framework in Python. 1462 🍴 349
  • :octocat: dumbo - Python module that allows one to easily write and run Hadoop programs. 955 🍴 154
  • :octocat: luigi - A module that helps you build complex pipelines of batch jobs. 3336 🍴 599
  • :octocat: mrjob - Run MapReduce jobs on Hadoop or Amazon Web Services. 1548 🍴 396
  • 🌎 PySpark - The Spark Python API.
  • :octocat: streamparse - Run Python code against real-time streams of data. Integrates with Apache Storm. 858 🍴 107

Functional Programming

Functional Programming with Python.

  • :octocat: CyToolz - Cython implementation of Toolz: High performance functional utilities. 216 🍴 16
  • :octocat: fn.py - Functional programming in Python: implementation of missing features to enjoy FP. 1709 🍴 95
  • :octocat: funcy - A fancy and practical functional tools. 1202 🍴 62
  • :octocat: Toolz - A collection of functional utilities for iterators, functions, and dictionaries. 899 🍴 73

Third-party APIs

Libraries for accessing third party services APIs. See: List of Python API Wrappers and Libraries.

DevOps Tools

Software and libraries for DevOps.

Job Scheduler

Libraries for scheduling jobs.

  • 🌎 APScheduler - A light but powerful in-process task scheduler that lets you schedule functions.
  • :octocat: django-schedule - A calendaring app for Django. 604 🍴 248
  • 🌎 doit - A task runner/build tool.
  • 🌎 Joblib - A set of tools to provide lightweight pipelining in Python.
  • :octocat: Plan - Writing crontab file in Python like a charm. 837 🍴 59
  • :octocat: schedule - Python job scheduling for humans. 1717 🍴 140
  • :octocat: Spiff - A powerful workflow engine implemented in pure Python. 261 🍴 67
  • 🌎 TaskFlow - A Python library that helps to make task execution easy, consistent and reliable.

Foreign Function Interface

Libraries for providing foreign function interface.

  • 🌎 cffi - Foreign Function Interface for Python calling C code.
  • 🌎 ctypes - (Python standard library) Foreign Function Interface for Python calling C code.
  • 🌎 PyCUDA - A Python wrapper for Nvidia's CUDA API.
  • 🌎 SWIG - Simplified Wrapper and Interface Generator.

High Performance

Libraries for making Python faster.

  • 🌎 Cython - Optimizing Static Compiler for Python. Uses type mixins to compile Python into C or C++ modules resulting in large performance gains.
  • 🌎 PyPy - An implementation of Python in Python. The interpreter uses black magic to make Python very fast without having to add in additional type information.
  • :octocat: Pyston - A Python implementation built using LLVM and modern JIT techniques with the goal of achieving good performance. 3173 🍴 222
  • 🌎 Stackless Python - An enhanced version of the Python.

Microsoft Windows

Python programming on Microsoft Windows.

  • 🌎 Python(x,y) - Scientific-applications-oriented Python Distribution based on Qt and Spyder.
  • 🌎 pythonlibs - Unofficial Windows binaries for Python extension packages.
  • :octocat: PythonNet - Python Integration with the .NET Common Language Runtime (CLR). 90 🍴 41
  • 🌎 PyWin32 - Python Extensions for Windows.
  • 🌎 WinPython - Portable development environment for Windows 7/8.

Network Virtualization and SDN

Tools and libraries for Virtual Networking and SDN (Software Defined Networking).

  • 🌎 Mininet - A popular network emulator and API written in Python.
  • 🌎 POX - An open source development platform for Python-based Software Defined Networking (SDN) control applications, such as OpenFlow SDN controllers.
  • 🌎 Pyretic - A member of the Frenetic family of SDN programming languages that provides powerful abstractions over network switches or emulators.
  • :octocat: SDX Platform - SDN based IXP implementation that leverages Mininet, POX and Pyretic. 7 🍴 3

Hardware

Libraries for programming with hardware.

  • 🌎 ino - Command line toolkit for working with Arduino.
  • 🌎 Pyro - Python Robotics.
  • :octocat: PyUserInput - A module for cross-platform control of the mouse and keyboard. 326 🍴 70
  • 🌎 scapy - A brilliant packet manipulation library.
  • 🌎 wifi - A Python library and command line tool for working with WiFi on Linux.

Compatibility

Libraries for migrating from Python 2 to 3.

Miscellaneous

Useful libraries or tools that don't fit in the categories above.

Algorithms and Design Patterns

Python implementation of algorithms and design patterns.

Editor Plugins

Plugins for editors and IDEs.

  • Emacs
    • :octocat: Elpy - Emacs Python Development Environment. 546 🍴 82
  • Sublime Text
    • :octocat: SublimeJEDI - A Sublime Text plugin to the awesome auto-complete library Jedi. 543 🍴 61
    • :octocat: Anaconda - Anaconda turns your Sublime Text 3 in a full featured Python development IDE. 854 🍴 83
  • Vim
  • Visual Studio

IDEs

Popular Python IDEs.

  • 🌎 PyCharm - Commercial Python IDE by JetBrains. Has free community edition available.
  • 🌎 Komodo - Commercial polyglot IDE with support for Python.
  • 🌎 LiClipse - Free polyglot IDE based on Eclipse. Uses PyDev for Python support.
  • :octocat: Spyder - Open Source Python IDE. 562 🍴 161
  • 🌎 WingIDE - Commercial IDE for Python.

Services

Online tools and APIs to simplify development.

Continuous Integration

See: awesome-CIandCD.

  • 🌎 Travis CI - A popular CI service for your open source and private projects. (GitHub only)
  • 🌎 CircleCI - A CI service that can run very fast parallel testing. (GitHub only)
  • 🌎 Vexor CI - A continuous integration tool for private apps with pay-per-minute billing model.
  • 🌎 Wercker - A Docker-based platform for building and deploying applications and microservices.

Code Quality

Resources

Where to discover new Python libraries.

Websites

Weekly

Twitter

Other Awesome Lists

List of lists.

Contributing

Your contributions are always welcome!