Exploiting the visions typesystem for fun and profit

If you’ve previously used pandas-profiling, you might have observed that column summaries are unique to the data types of each feature in your data. However, until recently it wasn’t possible to customize those summaries, so, if you wanted to automatically compute the average surface area of a sequence of shapely geometries, or the set of domain names in a sequence of email addresses, you were out of luck — until now.

The recently completed migration of pandas-profiling to the visions type system brings fully customizable type detection logic, summary algorithms, and is the first step towards end-to-end report customization including customized renderings. Over the rest of blog post I’m going to show you how to get started with visions and easily customize your data summaries using pandas-profiling.

#eda #dylan-profiler #data-science #pandas-profiling #vision