Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

jadohu
/
llamagen_drafter

Text-to-Image
Transformers
PyTorch
llama
text-generation
text-generation-inference
Model card Files Files and versions
xet
Community
2

Instructions to use jadohu/llamagen_drafter with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • Transformers

    How to use jadohu/llamagen_drafter with Transformers:

    # Load model directly
    from transformers import AutoTokenizer, AutoModelForCausalLM
    
    tokenizer = AutoTokenizer.from_pretrained("jadohu/llamagen_drafter")
    model = AutoModelForCausalLM.from_pretrained("jadohu/llamagen_drafter")
  • Notebooks
  • Google Colab
  • Kaggle

This repository contains the model described in LANTERN: Accelerating Visual Autoregressive Models with Relaxed Speculative Decoding.

Code: https://github.com/jadohu/LANTERN

Downloads last month
21
Inference Providers NEW
Text-to-Image
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Paper for jadohu/llamagen_drafter

LANTERN: Accelerating Visual Autoregressive Models with Relaxed Speculative Decoding

Paper • 2410.03355 • Published Oct 4, 2024
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs