nan_to_null=True stops converting nans to nulls after the dataframe grows to a certain size. This did not happen in polars==0.20.10 Expected behavior nan_to_null=True should behave exactly as pl.from_pandas().with_columns(cs.float().fill_nan(None)) Installed versions ---Version info...
Operations such as filtering, calculations, joining, aggregating, renaming, projecting, transposing and saving to files / databases becomes a breeze via the ease of integrating with high level libraries such as polars, pandas and duckdb. Additionally due to the way Apache Arrow is created the ...
Converting to Lance importlanceimportpandasaspdimportpyarrowaspaimportpyarrow.datasetdf=pd.DataFrame({"a": [5],"b": [10]})uri="/tmp/test.parquet"tbl=pa.Table.from_pandas(df)pa.dataset.write_dataset(tbl,uri,format='parquet')parquet=pa.dataset.dataset(uri,format='parquet')lance.write_dataset...