Multimodal AI
You might say
Can AI understand my screenshot too, not just the text I send it?
AI that can combine information such as text, images, audio, or video in one taskSend a screenshot of a phone checkout page with the question “Why is the payment button missing?” and the AI can consider both the visible layout and your written question.
Also calledMultimodality
Further reading