skillZs
★ LIVE SKILL TAGS ★
>>> LIVE SKILLS INDEX <<<
* OPEN SOURCE *
NO LOGIN, NO TRACKING
※ REAL INSTALL DATA ※
← back to all skills
tdimino/claude-code-minoan57 installs

smolvlm

Local vision-language model for image analysis using SmolVLM-2B

How do I install this agent skill?

npx skills add https://github.com/tdimino/claude-code-minoan --skill smolvlm
view source ↗

Is this agent skill safe to install?

  • Gen Agent Trust Hubpass

    This skill enables local image analysis using the SmolVLM model. It downloads the model from Hugging Face and performs inference locally on Apple Silicon. The primary security consideration is the attack surface for indirect prompt injection when processing untrusted images.

  • Socketpass

    No alerts

  • Snykpass

    Risk: LOW · No issues

  • Runlayerwarn

    2/2 files flagged

What does this agent skill do?

SmolVLM - Local Image Analysis

Analyze images locally using SmolVLM-2B, a state-of-the-art compact vision-language model optimized for Apple Silicon via mlx-vlm.

Quick Usage

Describe an Image

python ~/.claude/skills/smolvlm/scripts/view_image.py /path/to/image.png

Ask a Question About an Image

python ~/.claude/skills/smolvlm/scripts/view_image.py /path/to/image.png "What text is visible?"

Specific Tasks

# Extract text (OCR)
python ~/.claude/skills/smolvlm/scripts/view_image.py screenshot.png "Extract all text"

# UI analysis
python ~/.claude/skills/smolvlm/scripts/view_image.py ui.png "Describe the UI elements"

# Detailed description
python ~/.claude/skills/smolvlm/scripts/view_image.py photo.jpg --detailed

Effective Prompts

General Description

  • "Describe this image" - Basic description
  • "Describe this image in detail, including colors, composition, and any text" - Comprehensive

Text Extraction (OCR)

  • "Extract all visible text from this image"
  • "What text appears in this screenshot?"
  • "Read the text in this document"

UI/Screenshot Analysis

  • "Describe the user interface elements"
  • "What buttons and controls are visible?"
  • "Identify the application and its current state"

Visual Question Answering

  • "How many [objects] are in this image?"
  • "What color is the [object]?"
  • "Is there a [object] in this image?"

Code/Technical

  • "What programming language is shown?"
  • "Describe what this code does"
  • "Identify any errors in this code screenshot"

Model Details

SpecValue
ModelSmolVLM-2B-Instruct
Size~4GB
Peak Memory5.8GB
Speed~94 tok/s (M-series)
Supported FormatsPNG, JPG, JPEG, GIF, WebP

Requirements

  • macOS with Apple Silicon (M1/M2/M3)
  • Python 3.10+
  • mlx-vlm package: uv pip install mlx-vlm --system

Troubleshooting

"Model not found": First run downloads the model (~4GB). Wait for completion.

Out of memory: Close other applications. Model needs ~6GB free RAM.

Slow first inference: Model loading takes 10-15s on first use, subsequent calls are faster.

Add the canonical catalog link to the repository README so users can inspect current installs and available audits. The publishing guide covers the complete discovery path.

<a href="https://skillzs.dev/skills/tdimino/claude-code-minoan/smolvlm">View smolvlm on skillZs</a>