AI Engineer Roadmap All lessons Interactive Quiz MernStackDev GitHub

Phase 9: Multimodal AI

7 lessons · about 71 minutes of reading

Teach AI to see, hear and search pictures. Real data is not only text. Photos, charts, screenshots, speech and video all matter, yet a transformer only reads sequences of vectors. This phase shows how each kind of data becomes tokens, what that costs, and how to search and answer across images and text together.

After this phase you can

Before you start: Phase 3 (transformers, attention) and the embeddings lesson from Phase 1. Basic Python and school maths.

Lessons in this phase

Start with the interactive lessonTake the quiz