Computer Science
[Closed]
Work description
- review literature on synthetic clinical text evaluation; - define the evaluation criteria (e.g., linguistic quality, semantic accuracy, clinical plausibility, diversity) and select or develop appropriate metrics; - conduct the automatic evaluation of the synthetic dataset using pre-defined metrics; - design a manual annotation and review protocol in collaboration with medical students, including annotation guidelines and evaluation rubrics; - develop a web-based application to facilitate the crowd-based evaluation of synthetic clinical notes by medical students; - coordinate a manual evaluation process involving medical students to validate the clinical notes; - analyze results from both evaluation modalities to draw insights on the strengths and limitations of LLM-generated clinical notes; - document the methodology and results in a scientific article.
Academic Qualifications
Degree in Computer science or similar
Minimum profile required
- have Portuguese as a native language;- ability to read, write and speak in English.
Preference factors
- knowledge of NLP.
Application Period
Since 10 Apr 2025 to 24 Apr 2025
[Closed]
Centre
Human-Centered Computing and Information Science