SE Radio 727: Jeroen Janssens and Thijs Nieuwdorp on Using Polars – Software Engineering
- RadioPython Polars: The Definitive Guide (Book)
- Polars Package
- GitHub – pola-rs/polars: Extremely fast Query Engine for DataFrames, written in Rust
- Tidyverse
This episode of Software Engineering Radio features Jeroen Janssens (Senior Developer Relations Engineer at Posit) and Thijs Nieuwdorp (Developer Relations Engineer at Polars) in a conversation with host Gregory M. Kapfhammer. The discussion focuses on Polars, a lightning-fast data frame library system written in Rust, exploring its core features, execution philosophy, and how it is utilized for transforming, analyzing, and visualizing data.
Key Points
Introduction to Polars: The guest experts introduce Polars as a highly efficient alternative to traditional tools (like Pandas), packaged for Python, R, and Rust developers to handle data manipulation.
Core Capabilities: The episode details how Polars allows users to easily transform, analyze, and visualize complex datasets.
Expression Engine Optimization: A significant portion of the conversation explores the implementation and inner workings of Polars' expressions API, which optimizes query execution.
Performance Focus: The guests discuss how Polars utilizes Rust's memory safety and multi-threading capabilities under the hood to deliver strict performance improvements and lazy execution strategies.
