Nixtla Experiment Architect
by intent-solutions-io
Generate production-ready forecasting experiments with StatsForecast and TimeGPT. Use when setting up model benchmarking or cross-validation. Trigger with 'scaffold experiment' or 'compare models'.
Skill Details
Repository Files
18 files in this skill directory
name: nixtla-experiment-architect description: "Generate production-ready forecasting experiments with StatsForecast and TimeGPT. Use when setting up model benchmarking or cross-validation. Trigger with 'scaffold experiment' or 'compare models'." allowed-tools: "Read,Write,Glob,Grep,Edit" version: "1.0.0" author: "Jeremy Longshore jeremy@intentsolutions.io" license: MIT
Nixtla Experiment Architect
Design and scaffold complete forecasting experiments using Nixtla's libraries.
Overview
This skill creates production-ready experiment harnesses:
- Configuration management: YAML-based experiment config
- Multi-model comparison: StatsForecast + MLForecast + TimeGPT
- Cross-validation: Rolling-origin or expanding-window
- Metrics evaluation: SMAPE, MASE, MAE, RMSE
Prerequisites
Required:
- Python 3.8+
statsforecast,utilsforecast
Optional:
mlforecast: For ML modelsnixtla: For TimeGPTNIXTLA_API_KEY: TimeGPT access
Installation:
pip install statsforecast mlforecast nixtla utilsforecast pyyaml
Instructions
Step 1: Gather Requirements
Collect experiment parameters:
- Data source path
- Target column name
- Forecast horizon (e.g., 14 days)
- Frequency (D, H, W, M)
- Unique ID column (optional)
Step 2: Generate Configuration
python {baseDir}/scripts/generate_config.py \
--data data/sales.csv \
--target sales \
--horizon 14 \
--freq D \
--output forecasting/config.yml
Step 3: Scaffold Experiment
python {baseDir}/scripts/scaffold_experiment.py \
--config forecasting/config.yml \
--output forecasting/experiments.py
Step 4: Run Experiment
python forecasting/experiments.py
Step 5: Review Results
cat forecasting/results/metrics_summary.csv
Output
- forecasting/config.yml: Experiment configuration
- forecasting/experiments.py: Runnable experiment harness
- forecasting/results/: Metrics and forecasts (after running)
Error Handling
-
Error:
Data file not foundSolution: Verify data source path in config -
Error:
Column not foundSolution: Check column names match your data -
Error:
Missing required packageSolution: Install missing dependencies with pip -
Error:
Cross-validation failedSolution: Ensure enough data for n_windows
Examples
Example 1: Daily Sales Forecast
python {baseDir}/scripts/generate_config.py \
--data data/sales.csv \
--target revenue \
--horizon 30 \
--freq D \
--id_col store_id
Output config.yml:
data:
source: data/sales.csv
target: revenue
unique_id: store_id
forecasting:
horizon: 30
freq: D
models:
- SeasonalNaive
- AutoETS
- AutoARIMA
Example 2: Hourly Energy Forecast
python {baseDir}/scripts/generate_config.py \
--data data/energy.csv \
--target consumption \
--horizon 24 \
--freq H
Resources
- Scripts:
{baseDir}/scripts/ - Templates:
{baseDir}/assets/templates/ - Nixtla Docs: https://nixtla.github.io/
Related Skills:
nixtla-timegpt-lab: Core forecasting guidancenixtla-schema-mapper: Data transformationnixtla-prod-pipeline-generator: Production deployment
Related Skills
Attack Tree Construction
Build comprehensive attack trees to visualize threat paths. Use when mapping attack scenarios, identifying defense gaps, or communicating security risks to stakeholders.
Grafana Dashboards
Create and manage production Grafana dashboards for real-time visualization of system and application metrics. Use when building monitoring dashboards, visualizing metrics, or creating operational observability interfaces.
Matplotlib
Foundational plotting library. Create line plots, scatter, bar, histograms, heatmaps, 3D, subplots, export PNG/PDF/SVG, for scientific visualization and publication figures.
Scientific Visualization
Create publication figures with matplotlib/seaborn/plotly. Multi-panel layouts, error bars, significance markers, colorblind-safe, export PDF/EPS/TIFF, for journal-ready scientific plots.
Seaborn
Statistical visualization. Scatter, box, violin, heatmaps, pair plots, regression, correlation matrices, KDE, faceted plots, for exploratory analysis and publication figures.
Shap
Model interpretability and explainability using SHAP (SHapley Additive exPlanations). Use this skill when explaining machine learning model predictions, computing feature importance, generating SHAP plots (waterfall, beeswarm, bar, scatter, force, heatmap), debugging models, analyzing model bias or fairness, comparing models, or implementing explainable AI. Works with tree-based models (XGBoost, LightGBM, Random Forest), deep learning (TensorFlow, PyTorch), linear models, and any black-box model
Pydeseq2
Differential gene expression analysis (Python DESeq2). Identify DE genes from bulk RNA-seq counts, Wald tests, FDR correction, volcano/MA plots, for RNA-seq analysis.
Query Writing
For writing and executing SQL queries - from simple single-table queries to complex multi-table JOINs and aggregations
Pydeseq2
Differential gene expression analysis (Python DESeq2). Identify DE genes from bulk RNA-seq counts, Wald tests, FDR correction, volcano/MA plots, for RNA-seq analysis.
Scientific Visualization
Meta-skill for publication-ready figures. Use when creating journal submission figures requiring multi-panel layouts, significance annotations, error bars, colorblind-safe palettes, and specific journal formatting (Nature, Science, Cell). Orchestrates matplotlib/seaborn/plotly with publication styles. For quick exploration use seaborn or plotly directly.
