tokenizer.save_pretrained("tokenizer") But now I want to create a UDF using the tokenizer in the stage so I can use the UDF as follows: SELECTmy_tokenizer_udf('你好,世界!')AStokens; This for example is not working: CREATEORREPLACEFUNCTIONmy_tokenizer_udf(str STRING)RETURNSARRAYLANGUAGEPYTHO...
For convenience I wrapped this Python code into a Snowflake UDF to compare the results from Python with Snowflake's native HLL estimations: create or replace function hll_estimate_python(hll_sketch variant) returns int language python runtime_version = '3.11' handler = 'estimate...