Analyzing Backtests

by PoorRican

skill

Analyzes algorithmic trading backtest results from Jupyter notebooks and generates summary reports. Use when the user wants to analyze or summarize backtest notebooks.

Skill Details

Repository Files

1 file in this skill directory


name: analyzing-backtests description: Analyzes algorithmic trading backtest results from Jupyter notebooks and generates summary reports. Use when the user wants to analyze or summarize backtest notebooks. allowed-tools: Read, Bash, Glob, Grep

Backtest Analysis Skill

Analyze a Jupyter notebook containing algorithmic trading backtest results and generate a comprehensive summary report.

Analysis Steps

  1. Version Control Information

    • Run git status to check current state
    • Run git log -1 --format="%H %ci" for latest commit hash and date
    • Note any uncommitted changes
  2. Read the Notebook

    • Use Read tool to load the specified .ipynb file
    • Parse cells for code, markdown, and outputs
  3. Extract Key Information

    Model/Strategy Details:

    • Strategy name, type, and configuration
    • Key hyperparameters
    • Training and testing period information

    Date Coverage:

    • Backtest period (start, end, duration)

    Performance Metrics:

    • Monetary results: returns, capital, drawdowns, trade statistics
    • Statistical analysis: risk metrics, benchmark comparisons, distributions
    • Extract whatever metrics are available in the notebook
  4. Generate Report

Output a structured markdown report:

# Backtest Analysis Report

**Notebook:** [filename]
**Generated:** [date]
**Git Commit:** [hash] ([date])
**Uncommitted Changes:** [yes/no]

## Strategy
[Name and brief description]

**Configuration:**
- [Key parameters]

## Period
- **Dates:** [start] to [end] ([duration])

## Performance

| Metric | Value | Benchmark |
|--------|-------|-----------|
| Total Return | X% | X% |
| Annualized Return | X% | X% |
| Max Drawdown | X% | X% |
| Sharpe Ratio | X.XX | X.XX |
| Win Rate | X% | - |
| Total Trades | X | - |

## Risk Metrics
| Metric | Value |
|--------|-------|
| Volatility | X% |
| Alpha | X% |
| Beta | X.XX |

## Key Findings
- [Notable observations]
- [Strengths and weaknesses]

## Concerns/Recommendations
- [Any issues or suggestions]

Instructions

  • Extract all available metrics from the notebook
  • Mark unavailable metrics as "N/A"
  • Provide brief analysis, not just data
  • Flag unusual results or potential issues
  • Keep report concise but comprehensive

Related Skills

Attack Tree Construction

Build comprehensive attack trees to visualize threat paths. Use when mapping attack scenarios, identifying defense gaps, or communicating security risks to stakeholders.

skill

Grafana Dashboards

Create and manage production Grafana dashboards for real-time visualization of system and application metrics. Use when building monitoring dashboards, visualizing metrics, or creating operational observability interfaces.

skill

Matplotlib

Foundational plotting library. Create line plots, scatter, bar, histograms, heatmaps, 3D, subplots, export PNG/PDF/SVG, for scientific visualization and publication figures.

skill

Scientific Visualization

Create publication figures with matplotlib/seaborn/plotly. Multi-panel layouts, error bars, significance markers, colorblind-safe, export PDF/EPS/TIFF, for journal-ready scientific plots.

skill

Seaborn

Statistical visualization. Scatter, box, violin, heatmaps, pair plots, regression, correlation matrices, KDE, faceted plots, for exploratory analysis and publication figures.

skill

Shap

Model interpretability and explainability using SHAP (SHapley Additive exPlanations). Use this skill when explaining machine learning model predictions, computing feature importance, generating SHAP plots (waterfall, beeswarm, bar, scatter, force, heatmap), debugging models, analyzing model bias or fairness, comparing models, or implementing explainable AI. Works with tree-based models (XGBoost, LightGBM, Random Forest), deep learning (TensorFlow, PyTorch), linear models, and any black-box model

skill

Pydeseq2

Differential gene expression analysis (Python DESeq2). Identify DE genes from bulk RNA-seq counts, Wald tests, FDR correction, volcano/MA plots, for RNA-seq analysis.

skill

Query Writing

For writing and executing SQL queries - from simple single-table queries to complex multi-table JOINs and aggregations

skill

Pydeseq2

Differential gene expression analysis (Python DESeq2). Identify DE genes from bulk RNA-seq counts, Wald tests, FDR correction, volcano/MA plots, for RNA-seq analysis.

skill

Scientific Visualization

Meta-skill for publication-ready figures. Use when creating journal submission figures requiring multi-panel layouts, significance annotations, error bars, colorblind-safe palettes, and specific journal formatting (Nature, Science, Cell). Orchestrates matplotlib/seaborn/plotly with publication styles. For quick exploration use seaborn or plotly directly.

skill

Skill Information

Category:Skill
Allowed Tools:Read, Bash, Glob, Grep
Last Updated:11/1/2025