Scholar Evaluation

Systematically evaluate scholarly and research work using the ScholarEval framework with structured assessment across multiple quality dimensions and quantitative scoring.

Key Benefits

Structured evaluation methodology based on peer-reviewed criteria
Comprehensive analysis across 8 quality dimensions
Quantitative scoring with 5-point scale (optional)
Assessment of problem formulation, methodology, analysis, writing
Publication readiness evaluation
Actionable, prioritized feedback generation
Integration with scientific writer workflow

Core Capabilities

Evaluation Dimensions: Problem formulation, literature review, methodology & research design, data collection, analysis & interpretation, results & findings, scholarly writing, citations & references
Scoring: 5-point scale per dimension (1=Poor to 5=Excellent) with qualitative assessment
Feedback Structure: Specific, actionable, prioritized, balanced, evidence-based
Contextual Adjustment: Stage of development (early/advanced/final), purpose & venue, discipline-specific norms
Work Types: Research papers, research proposals, literature reviews, thesis chapters, conference abstracts

When to Use

Evaluating research papers for quality and rigor
Assessing literature review comprehensiveness
Reviewing research methodology design
Scoring data analysis approaches
Evaluating scholarly writing and presentation
Providing structured feedback on academic work
Benchmarking research quality against criteria
Assessing publication readiness for target venues

Evaluation Workflow

Initial assessment and scope definition (identify work type)
Dimension-based evaluation (systematic assessment)
Scoring and rating (qualitative + optional quantitative)
Synthesize overall assessment (strengths/weaknesses)
Provide actionable feedback (specific, prioritized)
Contextual considerations (stage, venue, discipline)

Based on ScholarEval framework: retrieval-augmented evaluation assessing soundness and contribution grounded in literature.

Source: https://github.com/K-Dense-AI/claude-scientific-writer/tree/main/skills/scholar-evaluation Framework: Moussa et al. (2025), arXiv:2510.16234 License: MIT

All Tags

Items tagged with Assessment (1)

Scholar Evaluation Skill