1 Matching Annotations
  1. Apr 2023
  2. huggingface.co huggingface.co
    bigscience/bloom · Can Bloom-176B really be evaluated on normal hardware at a rate of 3 minutes per token?
    1
    1. tonz 02 Apr 2023

      Running BLOOM on a VPS or locally even is either expensive or very slow. Mostly because of the sheer size of the 176B model. Share it in a group of similar users on a VPS set-up? Use the Hugging Face API for BLOOM?

      bloom selfhostAI
    Visit annotations in context

    Tags

    Annotators

    URL

    huggingface.co/bigscience/bloom/discussions/87