Lead Clinical Evidence Annotator

InterConnect Techs has been invited to submit a National Science Foundation Small Business Innovation Research Phase I proposal for the Evidence Completeness Audit Platform, a biomedical informatics platform designed to improve confidence in published clinical evidence.

We are seeking a Lead Annotator to oversee the structured review and annotation of a gold-standard dataset comparing ClinicalTrials.gov records with corresponding journal publications. This role will supervise four doctoral-level annotators and ensure the quality, consistency, and traceability of annotation decisions.

This is a remote, part-time W-2 position contingent upon NSF SBIR Phase I award. The position includes approximately 350 total hours during Months 1 through 7 of the 12-month project period. Hours will vary by project phase and average approximately 12 hours per week. Compensation is $55 per hour.

Responsibilities

• Lead annotation calibration sessions and establish inter-annotator agreement protocols
• Supervise a team of four doctoral-level annotators
• Oversee the adjudication log and resolve classification disagreements
• Monitor annotation consistency and identify systematic areas of disagreement
• Calculate and report inter-annotator agreement at defined project milestones
• Review ambiguous registry-publication pairs and make escalation decisions
• Coordinate annotation quality checks and documentation requirements
• Communicate significant findings, risks, and unresolved issues to the Principal Investigator

Minimum qualifications

• Master’s or doctoral degree in clinical research, epidemiology, pharmacy, public health, biomedical science, or a closely related discipline
• Experience reviewing clinical trial publications and clinical trial registry records
• Familiarity with structured annotation methods and inter-annotator agreement measures
• Strong critical reading, analytical reasoning, and documentation skills
• Ability to apply classification protocols consistently across a large evidence dataset
• Ability to supervise independent reviewers and maintain quality standards
• Authorization to work in the United States

Preferred qualifications

• Experience managing or coordinating annotation teams in a research setting
• Familiarity with ClinicalTrials.gov and clinical trial outcome reporting requirements
• Knowledge of CONSORT or related clinical research reporting standards
• Experience in evidence synthesis, systematic review, meta-analysis, or clinical trial auditing
• Experience using annotation platforms or structured evidence-review workflows
• Experience supporting federally funded or regulated research projects

University researchers, faculty members, postdoctoral researchers, and experienced clinical evidence professionals are encouraged to apply. Additional project protocols and technical specifications will be shared with selected candidates.