Polars LazyFrame for beginners after work: scan, filter, collect
Polars LazyFrame for beginners after work: scan_parquet, filter early, collect once. Educational only. Not investment advice.
Academy notes
Articles and updates from SoloQuant Academy.
Tag: polars
Polars LazyFrame for beginners after work: scan_parquet, filter early, collect once. Educational only. Not investment advice.
Polars vs pandas for trading data after work: when to stay, when to scan Parquet lazily, and when a hybrid wins. Educational only. Not investment advice.
Map for SQL-on-DataFrame after work: Polars SQL, SQLGlot, DuckDB, SQLFrame, Ibis. Anchored on Polars 1.44.2 + SQLGlot 30.18 freshness—not DuckDB 2.0 / Polars Iceberg / Polars 2.0 RC retreads. Educational only. Not investment advice.
Polars Python 2.0.0-rc.1 (2 Sep 2026) makes LazyFrame.collect default to the streaming engine (~5x faster, less memory per official). join/group_by no longer guarantee row order — use maintain_order. After-work RC checklist. Not investment advice.
scikit-learn 1.9.0 (2 Jun 2026, jeremiedbb) adds narwhals (>=2.0.1) so pandas and Polars set_output share one path after __dataframe__ deprecation. Experimental callbacks (ProgressBar, ScoringMonitor). Not a LightGBM/XGBoost roundup. Three things to try tonight. Not investment advice.
scikit-learn 1.9.0 (2 Jun 2026, jeremiedbb) adds narwhals (>=2.0.1) so pandas and Polars set_output share one path after __dataframe__ deprecation. Experimental callbacks (ProgressBar, ScoringMonitor). Not a LightGBM/XGBoost roundup. Three things to try tonight. Not investment advice.
Polars 1.44 (26 Aug 2026, Thijs Nieuwdorp) adds sink_iceberg schema_mode=merge, an adaptive S3/GCS/Azure rate limiter, correlated SQL subqueries, and selective when/then speedups. Three things to try tonight. Not a pandas bake-off. Not investment advice.
Polars 1.44 (26 Aug 2026, Thijs Nieuwdorp) adds sink_iceberg schema_mode=merge, an adaptive S3/GCS/Azure rate limiter, correlated SQL subqueries, and selective when/then speedups. Three things to try tonight. Not a pandas bake-off. Not investment advice.
LightGBM v4.7.0 lets the sklearn API take Polars and PyArrow Table inputs natively—an after-work path into the modern tabular stack without a pandas-only bottleneck.
Pandas 3.0 made Copy-on-Write default. Chained assignment can fail silently. Patch pandas tonight; keep Polars for big ETL, not a stack rewrite.