Scholar Evaluation

Systematically evaluate scholarly and research work using the ScholarEval framework with structured assessment across multiple quality dimensions and quantitative scoring.

Key Benefits

• Structured evaluation methodology based on peer-reviewed criteria
• Comprehensive analysis across 8 quality dimensions
• Quantitative scoring with 5-point scale (optional)
• Assessment of problem formulation, methodology, analysis, writing
• Publication readiness evaluation
• Actionable, prioritized feedback generation
• Integration with scientific writer workflow

Core Capabilities

• Evaluation Dimensions: Problem formulation, literature review, methodology & research design, data collection, analysis & interpretation, results & findings, scholarly writing, citations & references
• Scoring: 5-point scale per dimension (1=Poor to 5=Excellent) with qualitative assessment
• Feedback Structure: Specific, actionable, prioritized, balanced, evidence-based
• Contextual Adjustment: Stage of development (early/advanced/final), purpose & venue, discipline-specific norms
• Work Types: Research papers, research proposals, literature reviews, thesis chapters, conference abstracts

When to Use

• Evaluating research papers for quality and rigor
• Assessing literature review comprehensiveness
• Reviewing research methodology design
• Scoring data analysis approaches
• Evaluating scholarly writing and presentation
• Providing structured feedback on academic work
• Benchmarking research quality against criteria
• Assessing publication readiness for target venues

Evaluation Workflow

1. Initial assessment and scope definition (identify work type)
2. Dimension-based evaluation (systematic assessment)
3. Scoring and rating (qualitative + optional quantitative)
4. Synthesize overall assessment (strengths/weaknesses)
5. Provide actionable feedback (specific, prioritized)
6. Contextual considerations (stage, venue, discipline)

Based on ScholarEval framework: retrieval-augmented evaluation assessing soundness and contribution grounded in literature.

Source: https://github.com/K-Dense-AI/claude-scientific-writer/tree/main/skills/scholar-evaluation Framework: Moussa et al. (2025), arXiv:2510.16234 License: MIT