Databricks' dolly-v2-12b, an instruction-following large language model trained on the Databricks machine learning platform that is licensed for commercial use. Based on pythia-12b, Dolly is trained on ~15k instruction/response fine tuning records databricks-dolly-15k generated by Databricks employees...
from transformers import pipeline, AutoModel import torch model = AutoModel.from_pretrained("databricks/dolly-v2-12b") device = torch.device("mps" if torch.backends.mps.is_available() else "cpu") model.to(device) instruct_pipeline = pipeline(model=model, trust_remote_code=True, device_map=...