Storing Pandas dataframes efficiently in Python

Photo by Mika Baumeister on Unsplash

Introduction

If you are into solving data science and / or machine learning problems using Python you have probably come across Pandas, one of the most common data analysis and manipulation packages for Python.

Pandas stores data in a form called DataFrame, which is a 2 dimensional data structure (like a 2-D array) that can contain data in various…