pdpipe

Easy pipelines for pandas DataFrames

Ever written a preprocessing pipeline for pandas dataframes and had trouble serializing it for later depoloyment on a different machine? Ever needed fit-able preprocessing transformations, that have tunable paramaters that are inferred from training data, to be used later to transform input data? Ever struggled with preprocessing different types of data in the same pandas dataframe?

Enter pdpipe, a simple framework for serializable, chainable and verbose pandas pipelines. Its intuitive API enables you to generate, using only a few lines, complex pandas processing pipelines that can easily be broken down or composed together, examined and debugged, and that adhere to scikit-learn's Transformer API. Stop writing the same preprocessing boilerplate code again and again!

  • Compatible with Python 3+

    Python 3.5 and up. Crucial for new or forward-looking projects.

  • Fully documented

    Every pipeline stage and parameter are meticulously documented and accompanied by working code examples.

  • Zero configuration

    Pdpipe stages use sensible defaults for everything. Get things going immediately, tune only what you need.

  • Handle mixed-type data

    Easily create pipelines that process diffe types of data separately without breaking, enabling easier use of stacking-based ensemble models down the pipeline.

  • Customizable stages

    Pipeline stages are highly configurable, and creating new custom stages is easy.

  • Chainable constructors & pipeline arithmetics

    Chaining pipeline stages constructor calls for easy, one-liners creating comples pipelines. Supports pipeline arithmetics.

Download

Usage

then read the