Hugging Face
Ref: https://www.udemy.com/course/aws-certified-machine-learning-engineer-associate-mla-c01/learn/lecture/45285981 and https://www.udemy.com/course/aws-certified-machine-learning-engineer-associate-mla-c01/learn/lecture/45285951
- 🔧 Giant repository of pre-trained models you can use → huggingface.co
- Can mess around with models… for free!
- Contains also a ton of learning resources
- Many available models: GPT-2, LLaMa, Stable Diffusion…
GenAI Foundation Models in SageMaker JumpStart
Ref: https://www.udemy.com/course/aws-certified-machine-learning-engineer-associate-mla-c01/learn/lecture/45285981
- 🔧 Foundation Model (FM) = A giant, pre-trained transformer model that can be fine-tuned
- List of FMs from major vendors NOT in AWS:
- GPT-n (OpenAI, Microsoft) → LLM
- âť—Â Up to GPT-2 and GPT-J it's FOSS, so those can be found in HuggingFace and/or AWS, but not the later versions!
- DALL-E (OpenAI, Microsoft) → image generation
- BERT (Google)
- 💡 Amazon has lagged behind Microsoft and Google when it comes to AI FMs…
- List of FMs from major vendors that can be found in HuggingFace and/or AWS:
- LLaMa (Meta) → LLM
- Segment Anything (Meta) → image generation
- Jurassic-2 (AI21labs)
- Multilingual LLMs for text generation
- Spanish, French, German, Portuguese, Italian, Dutch
- Claude (Anthropic)
- LLMs for conversations
- Question answering
- Workflow automation
- Stable Diffusion (stability.ai)
- Image, art, logo, design generation
- Amazon Titan (Amazon) → multi-purpose FM
- Text summarization
- Text generation
- Q&A
- Embeddings (Recommendations, Search…)
- SageMaker Jumpstart allows quickly opening a notebook with a given model loaded up and ready to go
- HuggingFace models available for text generation
- Falcon, Flan, BlomZ, GPT-J
- Major vendor models also available (Stable Diffusion…)
- Amazon Alexa (encoder/decoder multilingual LLM)
- Diagram
AWS’ GenAI-aaS: Amazon Bedrock
- See dedicated section for Amazon Bedrock:
GenAI apps in Amazon Bedrock