We may earn an affiliate commission when you visit our partners.
Course image
Pixovert Studio

Have you used Stable Diffusion and ComfyUI? Do you want to go the next step and step up to consistently producing professional results? If so, then this course is for you.

Read more

Have you used Stable Diffusion and ComfyUI? Do you want to go the next step and step up to consistently producing professional results? If so, then this course is for you.

This course is designed for professionals who already have some experience with text-to-image synthesis and want to take their skills to the next level. You will learn how to master Stable Diffusion, the state-of-the-art latent text-to-image diffusion model that can generate photo-realistic images given any text input. You will also learn how to master SDXL, the latest and most advanced version of Stable Diffusion, which can handle challenging concepts and produce images of high quality in virtually any art style. And you will learn how to master ComfyUI, the robust and modular Stable Diffusion GUI and backend that enables you to design and execute advanced Stable Diffusion pipelines using a graph and nodes-based interface.

System Requirements

A windows PC with a powerful GPU capable of running Stable Diffusion.  This is NOT a beginner course and students with entry level hardware will struggle to make use of the resources and exercises.  At the very least 8GB of VRAM is recommended for the GPU, more is highly advisable.

By taking this course, you will also be able to fine-tune the parameters and the workflows to your needs and preferences, as well as write creative and high-quality prompts that can produce amazing results. You will also gain a deeper understanding of the underlying principles and techniques of text-to-image synthesis, latent diffusion models, and image refinement techniques.

This course is not for beginners who need introductory learning. This course is for professionals who want to master Stable Diffusion, SDXL and ComfyUI and achieve polished, professional outcomes. If you are ready to take your text-to-image synthesis skills to the next level, then enroll in this course today.

Stable Diffusion is a latent text-to-image diffusion model capable of generating photo-realistic images given any text input. It is based on the idea of reversing the diffusion process, which gradually transforms an image into random noise. By applying the reverse steps with a neural network conditioned on text, Stable Diffusion can recover the original image from the noise.

SDXL is the latest and most advanced version of Stable Diffusion, which leverages a larger and more powerful UNet backbone with more attention blocks and a larger cross-attention context. SDXL can generate images of high quality in virtually any art style and is the best open model for photorealism. It can also handle challenging concepts such as hands, text, and spatial arrangements.

ComfyUI supports SD1.x, SD2.x and SDXL models, as well as standalone VAEs and CLIP models. ComfyUI also offers many features such as embeddings, textual inversion, Loras, hypernetworks, loading and saving workflows, and image control.

The goal of this course is to help you achieve polished, professional outcomes with Stable Diffusion, SDXL and ComfyUI. You will learn how to use these tools effectively and efficiently, as well as how to fine-tune them to the demands of your work and your preferences.  By the end of this course, you will be able to get the most out of the efficiency and flexibility of ComfyUI to produce reliably consistent results that begin to match the best in the industry.

Enroll now

What's inside

Learning objectives

  • Master the art of prompt engineering to provide professional, reliably consistent results
  • Create huge landscapes using built-in features in comfy-ui - for sdxl or earlier versions of stable diffusion
  • Produce beautiful portraits in sdxl
  • Use the speed and efficiency of comfyui to do batch processing for more effective cherry picking
  • Understand the dualism of the classifier free guidance and how it affects outputs
  • The use of the dpm adaptive sampler

Syllabus

Introduction

Understand the purpose of the course.

How do the Pixovert ComfyUI and Stable Diffusion courses fit together.

Develop a deep understanding of factors, in addition to the prompt, that have a major infuence on images that are produced
Read more

Introduction to this section.

This lecture is core to understanding the course.  Students will gain an analytical and synoptic understanding of the actions of changes in factors affecting the images.  Usually explanations of CFG and its relationship with Sample Steps and the positive and negative prompts are at the level needed for understand of five-year old.  But for advanced work, we need to drill down to the foundations of Stable Diffusion to understand the real roles and not just the superficial explanations

Understand the unique action and advantages of the Adaptive Sampler in ComfuUI

A newer release from Stability AI is SDXL Turbo which marks a radical break from current approaches.  Based on a technique coined Adverserial Diffusion Distillation, the technique allows a distilled new version of SDXL to perform renders at breakneck speed in just 1-4 steps. 

Update your installation of ComfyUI to get the new nodes for the associated workflow.


Creating more advanced workflows to control and refine processes and results

Gain an understanding of how time-based prompting can introduce compositional methods that permit the fusion of SDXL and Stable Diffusion 1.5 by allying the newer models with existing models.  This extends the functional lifespan of Stable Diffusion 1.5 models and compensates for weaknesses in the SDXL models.

Perturbed Attention Guidance is a very new technique for improving detail in diffusions.  The workflow may allow improved results where the refiner is not producing the kind of output that greatly improves results enough to justify the extra processing time.

Working with Large Landscapes and Batch Processing
Triptych - Working with Large Landscapes

SDXL can produce beautiful and detailed portraits.  This lecture examines a holistic approach to creating beautiful, photorealistic portraits, making maximum use of techniques learned in the earlier parts of the course

Understand and apply a range of methods and processes that can personalize, and optimize Stable Diffusion models

Presenting workflows for model merging with block ratios and Lora capability.

Understand methods that work with Refiner Model to enhance and adjust images

Used in a specific way the refiner model can be used to minor fixes and enhancements to the eyes.  This is a very subtle use case and one that you might have easily overlooked the potential for.

Use the noise seed to make minor adjustments in the Refiner

Understand extra resources that are available for Stable Diffusion Pros

ChatGPT can produce an incredible range of behaviours.  How can you lean into this robot to help you create detailed, inspiring prompts?

Master more advanced methods for increasing the resolution of images in Stable Diffusion

Upscaling images from Stable Diffusion 1.5 using a ControlNet is feasible even on systems that don't have the most powerful graphics cards, but the process is subject to chance alterations which can interfere with poses.  In this video a controlnet is used to maintain pose whilst using latent upscale to achieve detailed, high resolution results.

Good to know

Know what's good
, what to watch for
, and possible dealbreakers
Taught by experienced instructors who are recognized for their work in image synthesis
Assumes basic knowledge of Stable Diffusion and ComfyUI
Intended for individuals who want to take their skills in image synthesis to the next level
Students should have a working knowledge of computer science and machine learning concepts

Save this course

Save Generative AI Mastery with ComfyUI SDXL and Stable Diffusion to your list so you can find it easily later:
Save

Activities

Be better prepared before your course. Deepen your understanding during and after it. Supplement your coursework and achieve mastery of the topics covered in Generative AI Mastery with ComfyUI SDXL and Stable Diffusion with these activities:
Seek Guidance from Experienced Stable Diffusion Users
Connect with experienced practitioners to gain valuable insights and accelerate your learning journey.
Show steps
  • Identify potential mentors through online forums, social media, or personal networks.
  • Reach out to your chosen mentors and express your interest in learning from their expertise.
Review Dreamweaver Magic by Joseph W. Lowery
This book will expand your knowledge on SDXL and Stable Diffusion to improve your workflow.
Show steps
  • Read through the book at a leisurely pace.
  • Take notes on the techniques that are described.
  • Experiment with the techniques in your own work
Practice Prompt Engineering
Refine your ability to craft prompts that effectively communicate your desired image to Stable Diffusion.
Browse courses on Prompt Engineering
Show steps
  • Identify key elements of the image you want to generate.
  • Research and experiment with different prompt styles and keywords.
  • Iterate and refine your prompts based on the results you get.
Seven other activities
Expand to see all activities and additional details
Show all ten activities
Master the DPM Adaptive Sampler
Unlock the potential of the DPM Adaptive Sampler to enhance your image generation results.
Browse courses on Stable Diffusion
Show steps
  • Familiarize yourself with the principles of the DPM Adaptive Sampler.
  • Experiment with different settings and parameters of the sampler.
  • Compare the results obtained using the DPM Adaptive Sampler with other samplers.
Batch Process Images
Maximize your efficiency by utilizing ComfyUI's batch processing capabilities.
Browse courses on Batch Processing
Show steps
  • Gather a set of images or prompts for batch processing.
  • Configure the batch processing settings, including the desired number of generations and output format.
  • Run the batch process and review the results.
Practice Using the Refiner Model
Develop proficiency in utilizing the Refiner Model to enhance and refine your generated images.
Browse courses on Stable Diffusion
Show steps
  • Familiarize yourself with the Refiner Model's capabilities.
  • Experiment with different settings and parameters of the model.
  • Compare the results obtained using the Refiner Model with and without its application.
Create a Series of Landscapes
Utilize ComfyUI's built-in features to generate a cohesive series of visually stunning landscapes.
Show steps
  • Establish a consistent theme or style for your landscapes.
  • Experiment with different settings and parameters in ComfyUI to achieve desired effects.
  • Refine and iterate your workflow to optimize results.
Design a Portrait in SDXL
Leverage the advanced capabilities of SDXL to create a captivating and realistic portrait.
Show steps
  • Gather reference images and study portrait photography techniques.
  • Craft a detailed prompt that accurately describes the desired facial features and expressions.
  • Fine-tune your prompt and settings to refine the portrait's details.
  • Optional: Use post-processing techniques to enhance the final image.
Explore Classifier-Free Guidance
Gain a deeper understanding of the impact of Classifier-Free Guidance on image generation.
Browse courses on Stable Diffusion
Show steps
  • Experiment with different CFG settings and observe their effects on the generated images.
  • Analyze how CFG interacts with other generation parameters.
  • Apply CFG techniques to improve the quality and accuracy of your generated images.
Create a Presentation on Advanced Prompting Techniques
Showcase your mastery of advanced prompting techniques by creating a comprehensive presentation.
Show steps
  • Research and compile different advanced prompting techniques.
  • Develop a logical flow and structure for your presentation.
  • Create visual aids and examples to illustrate the concepts.
  • Deliver your presentation to a target audience, seeking feedback and engaging in discussions.

Career center

Learners who complete Generative AI Mastery with ComfyUI SDXL and Stable Diffusion will develop knowledge and skills that may be useful to these careers:

Reading list

We haven't picked any books for this reading list yet.

Share

Help others find this course page by sharing it with your friends and followers:

Similar courses

Here are nine courses similar to Generative AI Mastery with ComfyUI SDXL and Stable Diffusion.
Introducing StableDiffusion ComfyUI for...
Most relevant
Beginner’s Guide to ComfyUI with Stable Diffusion
Most relevant
Beginner's Guide to Stable Diffusion with Automatic1111
Most relevant
Your Ultimate Starter Kit on Stable Diffusion
Most relevant
Create Amazing Graphics and Art using Stable Cascade
Most relevant
Machine Learning: Modern Computer Vision & Generative AI
Most relevant
All of AI: ChatGPT, Midjourney, Stable Diffusion & App Dev
Most relevant
Master Generative AI: Automate Content Effortlessly with...
Most relevant
Generative AI: Introduction and Applications
Most relevant
Our mission

OpenCourser helps millions of learners each year. People visit us to learn workspace skills, ace their exams, and nurture their curiosity.

Our extensive catalog contains over 50,000 courses and twice as many books. Browse by search, by topic, or even by career interests. We'll match you to the right resources quickly.

Find this site helpful? Tell a friend about us.

Affiliate disclosure

We're supported by our community of learners. When you purchase or subscribe to courses and programs or purchase books, we may earn a commission from our partners.

Your purchases help us maintain our catalog and keep our servers humming without ads.

Thank you for supporting OpenCourser.

© 2016 - 2024 OpenCourser