• Contents:

GenAI Foundation Models in SageMaker JumpStart

Ref: https://www.udemy.com/course/aws-certified-machine-learning-engineer-associate-mla-c01/learn/lecture/45285981

• 🔧 Foundation Model (FM) = A giant, pre-trained transformer model that can be fine-tuned
• List of FMs from major vendors NOT in AWS:
  • GPT-n (OpenAI, Microsoft) → LLM
    • ❗ Up to GPT-2 and GPT-J it's FOSS, so those can be found in HuggingFace and/or AWS, but not the later versions!
  • DALL-E (OpenAI, Microsoft) → image generation
  • BERT (Google)
  • 💡 Amazon has lagged behind Microsoft and Google when it comes to AI FMs…
• List of FMs from major vendors that can be found in HuggingFace and/or AWS:
  • LLaMa (Meta) → LLM
  • Segment Anything (Meta) → image generation
  • Jurassic-2 (AI21labs)
    • Multilingual LLMs for text generation
    • Spanish, French, German, Portuguese, Italian, Dutch
  • Claude (Anthropic)
    • LLMs for conversations
    • Question answering
    • Workflow automation
  • Stable Diffusion (stability.ai)
    • Image, art, logo, design generation
  • Amazon Titan (Amazon) → multi-purpose FM
    • Text summarization
    • Text generation
    • Q&A
    • Embeddings (Recommendations, Search…)
• SageMaker Jumpstart allows quickly opening a notebook with a given model loaded up and ready to go
  • HuggingFace models available for text generation
    • Falcon, Flan, BlomZ, GPT-J
  • Major vendor models also available (Stable Diffusion…)
  • Amazon Alexa (encoder/decoder multilingual LLM)
  • Diagram

AWS’ GenAI-aaS: Amazon Bedrock

• See dedicated section for Amazon Bedrock:

GenAI apps in Amazon Bedrock