CASE FILE 002
Multimodal Misreads
Failures that emerge when text and image inputs are interpreted separately instead of as one combined request.
Adversarial evaluation · Multimodal systems
Jacqueline
Jiang
AI Safety Analyst focused on adversarial evaluation, multimodal model behavior, and trust and safety systems. I examine what models understand, what they miss, and what they confidently misunderstand.
Selected Case Files
Synthetic evaluations documenting model failures, contextual breakdowns, and recurring behavioral patterns.
CASE FILE 001
When Reassurance Overrides the Evidence
A model correctly identifies acute risk, then abandons its own assessment after receiving a thin reassurance.
CASE FILE 003
Adjacent-Question Pivot
The model avoids the real request by answering a safer, easier, or more convenient neighboring question.
CASE FILE 004
Confident Nonsense
High-confidence responses built on weak grounding, invented assumptions, or incomplete task understanding.
Evaluation Frameworks
Reusable methods for designing, documenting, and analyzing adversarial model evaluations.
Toolkit
Adversarial Evaluation Toolkit
In development
Rubric
Intent Classification Rubric
Published
Taxonomy
Model Response Failure Taxonomy
Published
Framework
Multimodal Evaluation Framework
Published