Prompt Engineer (New Grad)

Wisedocs is a fast-growing AI platform transforming how insurance companies analyze claims. They are seeking a Prompt Engineer to evaluate and test AI model outputs, ensuring they meet technical and clinical standards while collaborating with engineering and product teams.ResponsibilitiesPrompt and Model Testing: Test AI-generated outputs, focusing on medical prompts and machine learning models used in healthcare applicationsFeedback Loop: Analyze AI output for accuracy, relevance, and clinical validity. Provide detailed feedback to the engineering team to enhance prompt performance and model behaviorStandard Operating Procedures (SOPs): Write, maintain, and update detailed SOPs for medical prompt engineering and testing, ensuring consistency and quality in prompt creation and validationCollaboration with Engineering: Work closely with the engineering team to troubleshoot, refine, and optimize machine learning models based on feedback from prompt testing and evaluationQuality Assurance: Ensure that the AI-generated responses align with clinical guidelines, best practices, and healthcare regulationsData Analysis: Assist in analyzing medical data sets and model outputs to evaluate the performance of AI models in clinical contextsDocumentation: Document all testing procedures, outcomes, and improvements. Create user-friendly guides and best practice documents for prompt testing and optimizationContinuous Improvement: Actively participate in the iterative process of improving prompt accuracy, functionality, and overall system performance in collaboration with cross-functional teamsSkillsA degree in medicine, nursing, medical informatics, or a related field, or significant hands-on clinical experienceFamiliarity with AI, machine learning models, and prompt engineering, especially in healthcare or clinical settingsExperience with testing and evaluating technology solutions, particularly in the healthcare or technology spaceDesire to learn and grow your skillset!Experience writing clear, concise, and detailed Standard Operating Procedures (SOPs) and documentationExcellent written and verbal communication skills, with the ability to deliver technical feedback in a clear and constructive mannerStrong attention to detail, particularly when reviewing AI outputs for clinical accuracy and relevanceAbility to identify issues, propose solutions, and collaborate with engineering teams to resolve challengesKnowledge of HIPAA, medical privacy laws, and healthcare compliance standardsExperience with data analysis tools, basic coding (Python, R, etc.) and SQLPrevious work with AI models in a medical context, such as AI-powered medical documentation systems, diagnostic tools, or virtual health assistantsBenefitsFlexible hybrid environment with the option to collaborate in-person at our Toronto HQ.Modern employee benefits, including health and dental coverageCompetitive compensation, with valuable stock options, as we’re still a young company growing very quickly.An opportunity to develop very rapidly in your career.Access to a learning and professional development fund to help you level up your career while you’re working with us.Company eventsGenerous Paid Time OffPaid Sick DaysCasual Dress codeEmployee Referral BonusTuition AssistancePlus, many other Recognition Programs!Company OverviewWisedocs provides medical record indexing, review, and AI summaries for various markets. It was founded in 2018, and is headquartered in Toronto, Ontario, CAN, with a workforce of 51-200 employees. Its website is https://www.wisedocs.ai.



Apply To This Job