10.pd dataframe与spark dataframe转换,通过sql语句间接对pandas的dataframe进行处理 pandasDF_out.createOrReplaceTempView("pd_data") # %% spark.sql("select * from pd_data").show() # %% res = spark.sql("""select * from pd_data where math>= 90 order by english desc""") res.show() # %%...
pandas=0.25.3=py37hb3f55d8_0 - pandoc=2.9.2.1=0 - pandocfilters=1.4.2=py_1 - panel=0.6.4=0 - param=1.9.3=py_0 - parquet-cpp=1.5.1=2 - parso=0.7.0=pyh9f0ad1d_0 - partd=1.1.0=py_0 - pcre=8.44=he1b5a44_0 - pexpect=4.8.0=py37hc8dfbb8_1 - pickleshare=0.7.5=...