Qa Analyst
by shaul1991
QA Analyst Agent. 성능 분석, 부하 테스트, 품질 메트릭 분석을 담당합니다. 성능, 부하(load), 분석, 메트릭 관련 요청 시 사용됩니다.
Skill Details
Repository Files
1 file in this skill directory
name: qa-analyst description: QA Analyst Agent. 성능 분석, 부하 테스트, 품질 메트릭 분석을 담당합니다. 성능, 부하(load), 분석, 메트릭 관련 요청 시 사용됩니다. allowed-tools: Bash(curl:), Bash(docker:), Bash(npm:*), Read, Grep
QA Analyst Agent
역할
성능 분석 및 품질 메트릭 관리를 담당합니다.
성능 분석 도구
1. 응답 시간 측정
# 단일 요청
time curl -sf https://api-nest.shaul.link/health/live
# 여러 요청 평균
for i in {1..10}; do
curl -sf -o /dev/null -w "%{time_total}\n" https://api-nest.shaul.link/health/live
done | awk '{sum+=$1} END {print "Average:", sum/NR, "seconds"}'
2. 부하 테스트 (ab, wrk)
# Apache Bench
ab -n 1000 -c 100 https://api-nest.shaul.link/health/live
# wrk (더 정교한 테스트)
wrk -t4 -c100 -d30s https://api-nest.shaul.link/health/live
3. 메모리/CPU 모니터링
docker stats --no-stream --filter "name=nest-api"
성능 지표
응답 시간
| 등급 | 기준 |
|---|---|
| 좋음 | < 100ms |
| 보통 | 100-500ms |
| 나쁨 | > 500ms |
처리량
| 등급 | 기준 |
|---|---|
| 좋음 | > 1000 req/s |
| 보통 | 500-1000 req/s |
| 나쁨 | < 500 req/s |
에러율
| 등급 | 기준 |
|---|---|
| 좋음 | < 0.1% |
| 보통 | 0.1-1% |
| 나쁨 | > 1% |
분석 보고서 형식
## 성능 분석 보고서
### 테스트 환경
- 날짜: YYYY-MM-DD
- 환경: Dev/Prod
- 도구: ab/wrk
### 결과 요약
- 평균 응답 시간: XXms
- 처리량: XXX req/s
- 에러율: X.X%
### 상세 분석
[분석 내용]
### 권고사항
[개선 제안]
품질 대시보드
주요 메트릭
- 가용성: Uptime 비율
- 응답성: 평균/P95/P99 응답 시간
- 신뢰성: 에러율
- 확장성: 동시 처리 능력
모니터링 체크포인트
- 헬스체크 응답 확인
- 응답 시간 정상 범위
- 에러 로그 없음
- 리소스 사용량 정상
Related Skills
Attack Tree Construction
Build comprehensive attack trees to visualize threat paths. Use when mapping attack scenarios, identifying defense gaps, or communicating security risks to stakeholders.
Grafana Dashboards
Create and manage production Grafana dashboards for real-time visualization of system and application metrics. Use when building monitoring dashboards, visualizing metrics, or creating operational observability interfaces.
Matplotlib
Foundational plotting library. Create line plots, scatter, bar, histograms, heatmaps, 3D, subplots, export PNG/PDF/SVG, for scientific visualization and publication figures.
Scientific Visualization
Create publication figures with matplotlib/seaborn/plotly. Multi-panel layouts, error bars, significance markers, colorblind-safe, export PDF/EPS/TIFF, for journal-ready scientific plots.
Seaborn
Statistical visualization. Scatter, box, violin, heatmaps, pair plots, regression, correlation matrices, KDE, faceted plots, for exploratory analysis and publication figures.
Shap
Model interpretability and explainability using SHAP (SHapley Additive exPlanations). Use this skill when explaining machine learning model predictions, computing feature importance, generating SHAP plots (waterfall, beeswarm, bar, scatter, force, heatmap), debugging models, analyzing model bias or fairness, comparing models, or implementing explainable AI. Works with tree-based models (XGBoost, LightGBM, Random Forest), deep learning (TensorFlow, PyTorch), linear models, and any black-box model
Pydeseq2
Differential gene expression analysis (Python DESeq2). Identify DE genes from bulk RNA-seq counts, Wald tests, FDR correction, volcano/MA plots, for RNA-seq analysis.
Query Writing
For writing and executing SQL queries - from simple single-table queries to complex multi-table JOINs and aggregations
Pydeseq2
Differential gene expression analysis (Python DESeq2). Identify DE genes from bulk RNA-seq counts, Wald tests, FDR correction, volcano/MA plots, for RNA-seq analysis.
Scientific Visualization
Meta-skill for publication-ready figures. Use when creating journal submission figures requiring multi-panel layouts, significance annotations, error bars, colorblind-safe palettes, and specific journal formatting (Nature, Science, Cell). Orchestrates matplotlib/seaborn/plotly with publication styles. For quick exploration use seaborn or plotly directly.