Analyzing Logs
by jeremylongshore
Analyze application logs for performance insights and issue detection including slow requests, error patterns, and resource usage. Use when troubleshooting performance issues or debugging errors. Trigger with phrases like "analyze logs", "find slow requests", or "detect error patterns".
Skill Details
Repository Files
7 files in this skill directory
name: analyzing-logs description: Analyze application logs for performance insights and issue detection including slow requests, error patterns, and resource usage. Use when troubleshooting performance issues or debugging errors. Trigger with phrases like "analyze logs", "find slow requests", or "detect error patterns". version: 1.0.0 allowed-tools: "Read, Write, Bash(logs:), Bash(grep:), Bash(awk:*), Grep" license: MIT author: Jeremy Longshore jeremy@intentsolutions.io
Log Analysis Tool
This skill provides automated assistance for log analysis tool tasks.
Overview
This skill empowers Claude to automatically analyze application logs, pinpoint performance bottlenecks, and identify recurring errors. It streamlines the debugging process and helps optimize application performance by extracting key insights from log data.
How It Works
- Initiate Analysis: Claude activates the log analysis tool upon detecting relevant trigger phrases.
- Log Data Extraction: The tool extracts relevant data, including timestamps, request durations, error messages, and resource usage metrics.
- Pattern Identification: The tool identifies patterns such as slow requests, frequent errors, and resource exhaustion warnings.
- Report Generation: Claude presents a summary of findings, highlighting potential performance issues and optimization opportunities.
When to Use This Skill
This skill activates when you need to:
- Identify performance bottlenecks in an application.
- Debug recurring errors and exceptions.
- Analyze log data for trends and anomalies.
- Set up structured logging or log aggregation.
Examples
Example 1: Identifying Slow Requests
User request: "Analyze logs for slow requests."
The skill will:
- Activate the log analysis tool.
- Identify requests exceeding predefined latency thresholds.
- Present a list of slow requests with corresponding timestamps and durations.
Example 2: Detecting Error Patterns
User request: "Find error patterns in the application logs."
The skill will:
- Activate the log analysis tool.
- Scan logs for recurring error messages and exceptions.
- Group similar errors and present a summary of error frequencies.
Best Practices
- Log Level: Ensure appropriate log levels (e.g., INFO, WARN, ERROR) are used to capture relevant information.
- Structured Logging: Implement structured logging (e.g., JSON format) to facilitate efficient analysis.
- Log Rotation: Configure log rotation policies to prevent log files from growing excessively.
Integration
This skill can be integrated with other tools for monitoring and alerting. For example, it can be used in conjunction with a monitoring plugin to automatically trigger alerts based on log analysis results. It can also work with deployment tools to rollback deployments when critical errors are detected in the logs.
Prerequisites
- Access to application log files in {baseDir}/logs/
- Log parsing tools (grep, awk, sed)
- Understanding of application log format and structure
- Read permissions for log directories
Instructions
- Identify log files to analyze based on timeframe and application
- Extract relevant data (timestamps, durations, error messages)
- Apply pattern matching to identify slow requests and errors
- Aggregate and group similar issues
- Generate analysis report with findings and recommendations
- Suggest optimization opportunities based on patterns
Output
- Summary of slow requests with response times
- Error frequency reports grouped by type
- Resource usage patterns and anomalies
- Performance bottleneck identification
- Recommendations for log improvements and optimizations
Error Handling
If log analysis fails:
- Verify log file paths and permissions
- Check log format compatibility
- Validate timestamp parsing
- Ensure sufficient disk space for analysis
- Review log rotation configuration
Resources
- Application logging best practices
- Structured logging format guides
- Log aggregation tools documentation
- Performance analysis methodologies
Related Skills
Attack Tree Construction
Build comprehensive attack trees to visualize threat paths. Use when mapping attack scenarios, identifying defense gaps, or communicating security risks to stakeholders.
Grafana Dashboards
Create and manage production Grafana dashboards for real-time visualization of system and application metrics. Use when building monitoring dashboards, visualizing metrics, or creating operational observability interfaces.
Matplotlib
Foundational plotting library. Create line plots, scatter, bar, histograms, heatmaps, 3D, subplots, export PNG/PDF/SVG, for scientific visualization and publication figures.
Scientific Visualization
Create publication figures with matplotlib/seaborn/plotly. Multi-panel layouts, error bars, significance markers, colorblind-safe, export PDF/EPS/TIFF, for journal-ready scientific plots.
Seaborn
Statistical visualization. Scatter, box, violin, heatmaps, pair plots, regression, correlation matrices, KDE, faceted plots, for exploratory analysis and publication figures.
Shap
Model interpretability and explainability using SHAP (SHapley Additive exPlanations). Use this skill when explaining machine learning model predictions, computing feature importance, generating SHAP plots (waterfall, beeswarm, bar, scatter, force, heatmap), debugging models, analyzing model bias or fairness, comparing models, or implementing explainable AI. Works with tree-based models (XGBoost, LightGBM, Random Forest), deep learning (TensorFlow, PyTorch), linear models, and any black-box model
Pydeseq2
Differential gene expression analysis (Python DESeq2). Identify DE genes from bulk RNA-seq counts, Wald tests, FDR correction, volcano/MA plots, for RNA-seq analysis.
Query Writing
For writing and executing SQL queries - from simple single-table queries to complex multi-table JOINs and aggregations
Pydeseq2
Differential gene expression analysis (Python DESeq2). Identify DE genes from bulk RNA-seq counts, Wald tests, FDR correction, volcano/MA plots, for RNA-seq analysis.
Scientific Visualization
Meta-skill for publication-ready figures. Use when creating journal submission figures requiring multi-panel layouts, significance annotations, error bars, colorblind-safe palettes, and specific journal formatting (Nature, Science, Cell). Orchestrates matplotlib/seaborn/plotly with publication styles. For quick exploration use seaborn or plotly directly.
