Atft Research

by wer-inc

skill

Drive quantitative analysis, factor diagnostics, and reporting for ATFT-GAT-FAN outputs.

Skill Details

Repository Files

1 file in this skill directory


name: atft-research description: Drive quantitative analysis, factor diagnostics, and reporting for ATFT-GAT-FAN outputs. proactive: true

ATFT Research Skill

Mission

  • Quantify performance (Sharpe, RankIC, hit ratio) across horizons and cohorts.
  • Inspect feature contributions, leakage risks, and stability of graph-based factors.
  • Produce stakeholder-ready artifacts (reports, dashboards, notebooks).

Engagement Signals

  • Requests to “analyze results”, “generate research report”, “compare to baseline”, “explain factor drift”.
  • Need to validate new model output or dataset revisions before release.
  • Desire for exploratory notebooks, plots, or KPI dashboards.

Baseline Workflow

  1. Confirm availability of latest run: ls -lt runs | head.
  2. Load metrics: python scripts/research/summarize_run.py --run runs/<timestamp>.
  3. Compute comparison vs baseline:
    • make research-baseline RUN=runs/<timestamp> — compares to curated benchmark.
    • make research-plus RUN=runs/<timestamp> — full bundle (feature importance, turnover, drawdowns).
  4. Plot diagnostics:
    • python scripts/research/plot_metrics.py --run runs/<timestamp> --horizons 1 5 10 20.
    • python scripts/research/graph_analytics.py --dataset output/ml_dataset_latest_full.parquet.
  5. Publish:
    • Output stored in reports/<timestamp>/.
    • Update docs/research/weekly_digest.md.

Specialized Analyses

Factor Stability / Drift

  • python scripts/research/factor_drift.py --window 60 --features top50.
  • python scripts/research/check_leakage.py --dataset output/ml_dataset_latest_full.parquet.
  • Alert when drift Z-score > 2.3 or leakage detection fails; escalate to pipeline skill to rebuild dataset.

Regime Segmentation

  • python scripts/research/regime_detector.py --regimes 4 --method gaussian_hmm.
  • python scripts/research/evaluate_by_regime.py --run runs/<timestamp> --regime-file output/regimes/latest.parquet.

Risk & Compliance

  • python scripts/research/limit_checker.py --run runs/<timestamp> — verifies VAR, exposure, and shorting constraints.
  • pytest tests/research/test_safety_constraints.py -k exposure if guard fails.

Visualization Arsenal

  • make research-report FACTORS=returns_5d,ret_1d_vs_sec HORIZONS=1,5,10,20.
  • python scripts/research/notebooks/render.py docs/notebooks/performance_atlas.ipynb.
  • python tools/chart_creator.py --input reports/<timestamp>/summary.json --output outputs/figures/.

Data Sources

  • Primary dataset: output/ml_dataset_latest_full.parquet
  • Model outputs: runs/<timestamp>/predictions.parquet
  • Feature metadata: dataset_features_detail.json
  • Market benchmarks: data/benchmarks/nikkei225.parquet

Reporting Standards

  • Include KPIs: Sharpe, RankIC, Top/Bottom decile returns, MaxDD, Turnover.
  • Break out metrics by sector (33 TSE industry codes) and market cap terciles.
  • Document experiment context: dataset version hash, training config file, git SHA.
  • Archive final report under docs/research/archive/<YYYY-MM-DD>_run_<timestamp>.md.

Codex Collaboration

  • Engage ./tools/codex.sh "Generate new factor hypothesis from latest run" to synthesize research leads using Codex search + reasoning stack.
  • Run codex exec --model gpt-5-codex "Summarize regime analysis findings in docs/research/weekly_digest.md" for automated reporting drafts.
  • Feed Codex-generated notebooks or scripts back through this skill for validation before sharing with stakeholders.

Related Skills

Attack Tree Construction

Build comprehensive attack trees to visualize threat paths. Use when mapping attack scenarios, identifying defense gaps, or communicating security risks to stakeholders.

skill

Grafana Dashboards

Create and manage production Grafana dashboards for real-time visualization of system and application metrics. Use when building monitoring dashboards, visualizing metrics, or creating operational observability interfaces.

skill

Matplotlib

Foundational plotting library. Create line plots, scatter, bar, histograms, heatmaps, 3D, subplots, export PNG/PDF/SVG, for scientific visualization and publication figures.

skill

Scientific Visualization

Create publication figures with matplotlib/seaborn/plotly. Multi-panel layouts, error bars, significance markers, colorblind-safe, export PDF/EPS/TIFF, for journal-ready scientific plots.

skill

Seaborn

Statistical visualization. Scatter, box, violin, heatmaps, pair plots, regression, correlation matrices, KDE, faceted plots, for exploratory analysis and publication figures.

skill

Shap

Model interpretability and explainability using SHAP (SHapley Additive exPlanations). Use this skill when explaining machine learning model predictions, computing feature importance, generating SHAP plots (waterfall, beeswarm, bar, scatter, force, heatmap), debugging models, analyzing model bias or fairness, comparing models, or implementing explainable AI. Works with tree-based models (XGBoost, LightGBM, Random Forest), deep learning (TensorFlow, PyTorch), linear models, and any black-box model

skill

Pydeseq2

Differential gene expression analysis (Python DESeq2). Identify DE genes from bulk RNA-seq counts, Wald tests, FDR correction, volcano/MA plots, for RNA-seq analysis.

skill

Query Writing

For writing and executing SQL queries - from simple single-table queries to complex multi-table JOINs and aggregations

skill

Pydeseq2

Differential gene expression analysis (Python DESeq2). Identify DE genes from bulk RNA-seq counts, Wald tests, FDR correction, volcano/MA plots, for RNA-seq analysis.

skill

Scientific Visualization

Meta-skill for publication-ready figures. Use when creating journal submission figures requiring multi-panel layouts, significance annotations, error bars, colorblind-safe palettes, and specific journal formatting (Nature, Science, Cell). Orchestrates matplotlib/seaborn/plotly with publication styles. For quick exploration use seaborn or plotly directly.

skill

Skill Information

Category:Skill
Last Updated:10/23/2025