Pixel Detective Exports
by rm2thaddeus
Export Pixel Detective UMAP projections with HDBSCAN and manage Qdrant collections via the ingestion API. Use when the user asks for latent space exports, UMAP clustering assets, or collection operations (list/create/select/delete/merge).
Skill Details
Repository Files
4 files in this skill directory
name: pixel-detective-exports description: Export Pixel Detective UMAP projections with HDBSCAN and manage Qdrant collections via the ingestion API. Use when the user asks for latent space exports, UMAP clustering assets, or collection operations (list/create/select/delete/merge).
Pixel Detective Exports
Generate standalone exports (no UI) and manage collections for Pixel Detective.
Requirements
- Ingestion API running on
http://localhost:8002 - Qdrant running (Docker)
- GPU UMAP service on
http://localhost:8003for HDBSCAN clustering - Optional (for visuals):
matplotlib - Optional (for PDF output):
weasyprint(preferred) orplaywright
Quickstart
- UMAP + HDBSCAN JSON/CSV/SVG:
python skills/pixel-detective-exports/scripts/export_umap_hdbscan.py --collection <name> - Cluster report PDF/HTML (all collections):
python skills/pixel-detective-exports/scripts/export_umap_pdf.py --sample-size 500
Exports
UMAP + HDBSCAN export (standalone)
- Script:
python skills/pixel-detective-exports/scripts/export_umap_hdbscan.py - Output default:
exports/pixel-detective/umap/umap_hdbscan_<collection>.json|csv|svg - Example:
python skills/pixel-detective-exports/scripts/export_umap_hdbscan.py --collection my_collection --sample-size 2000- Color controls:
--color-map tab20 --point-size 18 --outlier-size 12 --outlier-color #94a3b8
UMAP PDF report (all collections)
- Script:
python skills/pixel-detective-exports/scripts/export_umap_pdf.py - Output default:
exports/pixel-detective/umap/umap_cluster_report.pdf - Example:
python skills/pixel-detective-exports/scripts/export_umap_pdf.py --sample-size 500 --title "Pixel Detective UMAP Clusters"
Collection management
Manage collections via API (Qdrant in Docker)
- Script:
python skills/pixel-detective-exports/scripts/manage_collections.py - Examples:
- List:
python skills/pixel-detective-exports/scripts/manage_collections.py --action list - Info:
python skills/pixel-detective-exports/scripts/manage_collections.py --action info --collection my_collection - Create:
python skills/pixel-detective-exports/scripts/manage_collections.py --action create --collection my_collection --vector-size 512 --distance Cosine - Select:
python skills/pixel-detective-exports/scripts/manage_collections.py --action select --collection my_collection - Delete:
python skills/pixel-detective-exports/scripts/manage_collections.py --action delete --collection my_collection - Merge:
python skills/pixel-detective-exports/scripts/manage_collections.py --action merge --dest merged_collection --sources a,b,c - Qdrant fallback listing:
python skills/pixel-detective-exports/scripts/manage_collections.py --action list --qdrant http://localhost:6333
- List:
Notes
- HDBSCAN clustering is performed by the GPU UMAP service; the ingestion service does not offer HDBSCAN.
- Collection operations go through the ingestion API, which talks to Qdrant in Docker.
- Use the start skill to bring up services:
powershell -ExecutionPolicy Bypass -File skills\\start-pixel-detective\\scripts\\start_pixel_detective.ps1 -Mode backend -UseGpuUmap
Related Skills
Reactome Database
Query Reactome REST API for pathway analysis, enrichment, gene-pathway mapping, disease pathways, molecular interactions, expression analysis, for systems biology studies.
Mermaid Diagrams
Comprehensive guide for creating software diagrams using Mermaid syntax. Use when users need to create, visualize, or document software through diagrams including class diagrams (domain modeling, object-oriented design), sequence diagrams (application flows, API interactions, code execution), flowcharts (processes, algorithms, user journeys), entity relationship diagrams (database schemas), C4 architecture diagrams (system context, containers, components), state diagrams, git graphs, pie charts,
Polars
Fast DataFrame library (Apache Arrow). Select, filter, group_by, joins, lazy evaluation, CSV/Parquet I/O, expression API, for high-performance data analysis workflows.
Reactome Database
Query Reactome REST API for pathway analysis, enrichment, gene-pathway mapping, disease pathways, molecular interactions, expression analysis, for systems biology studies.
Mermaidjs V11
Create diagrams and visualizations using Mermaid.js v11 syntax. Use when generating flowcharts, sequence diagrams, class diagrams, state diagrams, ER diagrams, Gantt charts, user journeys, timelines, architecture diagrams, or any of 24+ diagram types. Supports JavaScript API integration, CLI rendering to SVG/PNG/PDF, theming, configuration, and accessibility features. Essential for documentation, technical diagrams, project planning, system architecture, and visual communication.
Monitoring Apis
|
Validating Performance Budgets
Validate application performance against defined budgets to identify regressions early. Use when checking page load times, bundle sizes, or API response times against thresholds. Trigger with phrases like "validate performance budget", "check performance metrics", or "detect performance regression".
Tracking Application Response Times
Track and optimize application response times across API endpoints, database queries, and service calls. Use when monitoring performance or identifying bottlenecks. Trigger with phrases like "track response times", "monitor API performance", or "analyze latency".
Databuddy
Integrate Databuddy analytics into applications using the SDK or REST API. Use when implementing analytics tracking, feature flags, custom events, Web Vitals, error tracking, LLM observability, or querying analytics data programmatically.
Datasette Plugin Writer
Guide for writing Datasette plugins. This skill should be used when users want to create or develop plugins for Datasette, including information about plugin hooks, the cookiecutter template, database APIs, request/response handling, and plugin configuration.