Vehicle Damage Assessment

Train a VLM to identify dents, scratches, and paint damage from vehicle photos and generate structured claims reports.

Silver sedan with front-end collision damage in a body shop

When a vehicle is involved in a collision, an adjuster reviews photos of the damage to determine what needs repair. This assessment can take days, and different adjusters may evaluate the same damage differently. Inconsistency leads to disputes, rework, and slower claim resolution.

Datature Vi trains a model on photos of damaged vehicles. You label images with damage descriptions (type, location, severity), and the model learns to produce consistent assessments from new photos. Policyholders can upload photos from their phone, and the model generates a preliminary report in seconds rather than days.

The model does not replace an adjuster's final decision. It produces a structured first-pass assessment that speeds up the review process and reduces variation between assessors.

For an interactive overview of this application, visit the vehicle damage assessment use case on vi.datature.com.


Common applications

Task
What the model does
Damage identification
Identifies dents, scratches, cracks, and paint damage from photos
Severity grading
Classifies damage as minor, moderate, or severe
Location mapping
Maps damage to specific vehicle panels (front bumper, driver door, etc.)
Structured claims report
Generates a JSON report with damage type, location, and severity per panel

Choose your task type

Approach
Best for
Output
Freeform Text (JSON)
Structured damage reports with panel-by-panel breakdowns
JSON: {"panel": "front_bumper", "damage": "dent", "severity": "moderate"}
Visual Question Answering (VQA)
Quick damage detection or specific questions about a photo
Text answer: "Yes, there is a dent on the front bumper and a scratch on the hood."
Phrase Grounding
Highlighting the damaged area for visual documentation
Bounding box around each damaged region

Annotation examples

Image
Question
Answer
Front-end collision
Describe the visible damage on this vehicle.
The front bumper is dented and displaced. The hood has a crease running from the bumper line to the windshield. The left headlight housing is cracked.
Minor scratch
Describe the visible damage on this vehicle.
A surface scratch approximately 30 centimeters long on the rear passenger door. No dent or paint loss visible.
Undamaged vehicle
Describe the visible damage on this vehicle.
No visible damage. The vehicle exterior appears intact.

Deploy and test

import json
from vi.inference import ViModel

model = ViModel(
    run_id="your-run-id",
    secret_key=".your-secret-key.",
    organization_id="your-organization-id",
)

result, error = model(
    source="vehicle_photo.jpg",
    user_prompt="Assess the visible damage on this vehicle.",
    generation_config={"temperature": 0.0, "do_sample": False}
)

if error is None:
    report = json.loads(result.result)
    for item in report["damages"]:
        print(f"{item['panel']}: {item['damage_type']} ({item['severity']})")

Training tips

Photograph from standard angles: train on the same angles policyholders will use (front, rear, both sides, close-up of damage). Consistent framing improves assessment accuracy.

Include a range of damage severity: from hairline scratches to total-loss collisions. If the model only sees major collisions in training, it will struggle with minor damage.

Use your organization's damage taxonomy: align annotations with your claims system's categories (panel names, damage types, severity levels) so model output maps directly to your workflow.

Include weather and lighting variation: photos submitted by policyholders come in all conditions. Include sunny, overcast, and indoor parking garage lighting in your training data.


Next steps

Structured Data Extraction

Return structured JSON claims reports for direct integration with claims management systems.

Phrase Grounding

Draw bounding boxes around damaged areas for visual documentation in claims files.

Chain-of-Thought Reasoning

Step-by-step damage assessment: identify, classify, then grade severity per panel.