Academic Researcher

by Tristan578

data

Extracts structured data from cybersecurity fatigue research papers and calculates statistical correlations

Skill Details

Repository Files

1 file in this skill directory


name: academic-researcher description: Extracts structured data from cybersecurity fatigue research papers and calculates statistical correlations allowed-tools: [Read, Write, Bash]

Academic Researcher

You analyze academic papers to extract key information and perform statistical analysis.

Task 1: Extract Data from Papers

When asked to analyze papers, for each PDF you must extract:

Metadata

  • Authors (full names)
  • Publication year
  • Paper title
  • Journal or conference name

Study Details

  • Sample size (total number of participants)
  • Study type (survey, experiment, observational)
  • Measurement scales used (e.g., "Security Fatigue Scale")

Participant Groups

For each group of participants in the study, extract:

  • Group name (e.g., "IT Security Professionals", "General IT Staff")
  • Years of experience - mean and standard deviation
  • Fatigue score - mean and standard deviation
  • Sample size - how many people in this group (n)

Statistical Results

If the paper reports correlation between experience and fatigue:

  • Correlation coefficient (r or ρ)
  • P-value (statistical significance)
  • Confidence interval if available

Output Format

Save everything to results/parsed_papers.json in this exact format:

{
  "papers": [
    {
      "metadata": {
        "authors": ["Smith, John", "Jones, Mary"],
        "year": 2024,
        "title": "Cybersecurity Fatigue in IT Professionals",
        "venue": "Journal of Cybersecurity"
      },
      "study": {
        "total_participants": 342,
        "study_type": "survey",
        "instruments": ["Security Fatigue Scale"]
      },
      "groups": [
        {
          "name": "IT Security Professionals",
          "experience_mean": 8.5,
          "experience_sd": 3.2,
          "fatigue_mean": 4.2,
          "fatigue_sd": 0.8,
          "sample_size": 156
        }
      ],
      "statistics": {
        "correlation_r": 0.42,
        "p_value": 0.003
      }
    }
  ]
}

Task 2: Calculate Overall Correlation

When asked to analyze the combined data:

  1. Load results/parsed_papers.json
  2. Combine all participant groups from all papers
  3. Calculate Pearson correlation between experience and fatigue
  4. Calculate statistical significance
  5. Analyze by domain (IT security vs general IT vs non-technical)

Save results to results/correlation_analysis.json:

{
  "overall": {
    "pearson_r": 0.38,
    "p_value": 0.001,
    "total_n": 847,
    "interpretation": "Moderate positive correlation"
  },
  "by_domain": {
    "it_security": {
      "r": 0.45,
      "p": 0.001,
      "n": 423
    },
    "general_it": {
      "r": 0.32,
      "p": 0.008,
      "n": 298
    },
    "non_technical": {
      "r": 0.18,
      "p": 0.15,
      "n": 126
    }
  }
}

Tools You Can Use

Use these research tools from scripts/tools/research_tools.py:

  • extract_pdf_text(filepath) - Extracts all text from a PDF file
  • calculate_correlation(experience_data, fatigue_data) - Calculates Pearson correlation with p-value and 95% CI

Call them via Python:

from scripts.tools.research_tools import extract_pdf_text, calculate_correlation

# Extract text from PDF
text = extract_pdf_text("papers/smith-2024.pdf")

# Calculate correlation
result = calculate_correlation(experience_values, fatigue_values)

Quality Checks

Before finishing:

  • Verify all required fields are present
  • Check numbers make sense (correlations between -1 and 1, p-values between 0 and 1)
  • Ensure sample sizes add up correctly
  • Flag any missing or questionable data

Related Skills

Xlsx

Comprehensive spreadsheet creation, editing, and analysis with support for formulas, formatting, data analysis, and visualization. When Claude needs to work with spreadsheets (.xlsx, .xlsm, .csv, .tsv, etc) for: (1) Creating new spreadsheets with formulas and formatting, (2) Reading or analyzing data, (3) Modify existing spreadsheets while preserving formulas, (4) Data analysis and visualization in spreadsheets, or (5) Recalculating formulas

data

Clickhouse Io

ClickHouse database patterns, query optimization, analytics, and data engineering best practices for high-performance analytical workloads.

datacli

Clickhouse Io

ClickHouse database patterns, query optimization, analytics, and data engineering best practices for high-performance analytical workloads.

datacli

Analyzing Financial Statements

This skill calculates key financial ratios and metrics from financial statement data for investment analysis

data

Data Storytelling

Transform data into compelling narratives using visualization, context, and persuasive structure. Use when presenting analytics to stakeholders, creating data reports, or building executive presentations.

data

Kpi Dashboard Design

Design effective KPI dashboards with metrics selection, visualization best practices, and real-time monitoring patterns. Use when building business dashboards, selecting metrics, or designing data visualization layouts.

designdata

Dbt Transformation Patterns

Master dbt (data build tool) for analytics engineering with model organization, testing, documentation, and incremental strategies. Use when building data transformations, creating data models, or implementing analytics engineering best practices.

testingdocumenttool

Sql Optimization Patterns

Master SQL query optimization, indexing strategies, and EXPLAIN analysis to dramatically improve database performance and eliminate slow queries. Use when debugging slow queries, designing database schemas, or optimizing application performance.

designdata

Anndata

This skill should be used when working with annotated data matrices in Python, particularly for single-cell genomics analysis, managing experimental measurements with metadata, or handling large-scale biological datasets. Use when tasks involve AnnData objects, h5ad files, single-cell RNA-seq data, or integration with scanpy/scverse tools.

arttooldata

Xlsx

Spreadsheet toolkit (.xlsx/.csv). Create/edit with formulas/formatting, analyze data, visualization, recalculate formulas, for spreadsheet processing and analysis.

tooldata

Skill Information

Category:Data
Allowed Tools:[Read, Write, Bash]
Last Updated:10/22/2025