OpenCourser
Learn skills that shape your future
Visit OpenCourser.com
Learn how to build multimodal search and RAG systems. RAG systems enhance an LLM by incorporating proprietary data into the prompt context. Typically, RAG applications use text documents, but, what if the desired context includes multimedia like images, audio, and video? This course covers the technical aspects of implementing RAG with multimodal data to accomplish this.
1. Learn how multimodal models are trained through contrastive learning and implement it on a real dataset.
2. Build any-to-any multimodal search to retrieve relevant context across different data types.
Learn how to build multimodal search and RAG systems. RAG systems enhance an LLM by incorporating proprietary data into the prompt context. Typically, RAG applications use text documents, but, what if the desired context includes multimedia like images, audio, and video? This course covers the technical aspects of implementing RAG with multimodal data to accomplish this.
1. Learn how multimodal models are trained through contrastive learning and implement it on a real dataset.
2. Build any-to-any multimodal search to retrieve relevant context across different data types.
3. Learn how LLMs are trained to understand multimodal data through visual instruction tuning and use them on multiple image reasoning examples.
4. Implement an end-to-end multimodal RAG system that analyzes retrieved multimodal context to generate insightful answers.
5. Explore industry applications like visually analyzing invoices and flowcharts to output structured data.
6. Create a multi-vector recommender system that suggests relevant items by comparing their similarities across multiple modalities.
As AI systems increasingly need to process and reason over multiple data modalities, learning how to build such systems is an important skill for AI developers.
This course equips you with the key skills to embed, retrieve, and generate across different modalities. By gaining a strong foundation in multimodal AI, you’ll be prepared to build smarter search, RAG, and recommender systems.
Save
Covers highly relevant and up-to-date topics in multimodal AI.
Complex multimodal concepts are explained with clarity and conciseness.
Provides excellent hands-on experience for real-world application.
Verified partner policies & purchase protections
7-day free trial on monthly Coursera Plus subscriptions; free audit option available on most individual courses to explore video lectures and readings at no charge.
14-day refund window on annual Coursera Plus subscriptions and single-course purchases prior to certificate issuance. Monthly subscriptions do not offer refunds once billed.
Accredited university and industry certifications (e.g. Stanford, Google, IBM, Yale), secure SSL payment processing, and verifiable digital certificate links.
OpenCourser helps millions of learners each year. People visit us to learn workspace skills, ace their exams, and nurture their curiosity.
Our extensive catalog contains over 50,000 courses and twice as many books. Browse by search, by topic, or even by career interests. We'll match you to the right resources quickly.
Find this site helpful? Tell a friend about us.
We're supported by our community of learners. When you purchase or subscribe to courses and programs or purchase books, we may earn a commission from our partners.
Your purchases help us maintain our catalog and keep our servers humming without ads.
Thank you for supporting OpenCourser.
Get offer
