LLM Fine-Tuning & Model Optimization Engineer

Company Overview

Forsure™ is the AI-native platform & consulting company that transforms how employers

manage healthcare. Powered by SureSystem™ (our intelligence engine handling data, AI,

and automation) and delivered through SureConsult™ (human expertise and consulting

services), we combine automation, analytics, and advisory to cut costs, reduce administrative

burden, and improve the employee experience.

Our culture is C.L.E.A.R. - we value Clarity Over Complexity (no jargon, just truth), Lead

With Empathy (fierce energy that's always human), Embrace the Unknown (reinvention is

our default), Act Like a Tribe (we grow together), and Resilience in Motion (grit drives

everything we do). We're looking for someone who embodies these values.

‍

WHAT YOU'LL BE DOING

• Fine-tune and optimize large language models (LLMs) for Forsure's healthcare benefits domain — ensuring accuracy, safety, and performance

• Design and manage training data pipelines for domain-specific model adaptation, including data curation, labeling strategy, and quality assurance

• Implement RLHF, DPO, and other alignment techniques to ensure model outputs meet clinical and regulatory standards

• Optimize model inference for cost, latency, and throughput — enabling real-time AI capabilities within SureSystem™

• Develop evaluation benchmarks specific to healthcare benefits (plan comparison accuracy, formulary reasoning, compliance adherence)

• Experiment with retrieval-augmented generation (RAG), agentic architectures, and multi-model orchestration to enhance system intelligence Forsure: LLM Fine-Tuning & Model Optimization Engineer 1

• Collaborate with the Medical AI Advisory Scientist to validate clinical accuracy of fine-tuned model outputs

• Research and implement emerging techniques in parameter-efficient fine-tuning (LoRA, QLoRA, adapters) and model compression

• Monitor model drift, bias, and performance degradation — building automated systems for ongoing quality assurance

• Document model archite

‍

‍

WHAT WE NEED TO SEE

• 3+ years of hands-on experience with LLM fine-tuning, NLP model development, or applied ML engineering

• Strong proficiency in Python, PyTorch, and Hugging Face Transformers ecosystem

• Experience with training infrastructure: GPU clusters, distributed training, cloud ML platforms (AWS, GCP, or Azure)

• Deep understanding of transformer architectures, attention mechanisms, and modern NLP techniques

• Hands-on experience with RLHF, DPO, SFT, or other alignment and fine-tuning methodologies reproducibility

• Strong software engineering fundamentals — version control, testing, CI/CD, and

• Ability to communicate technical concepts clearly to non-technical stakeholders

• Self-motivated with the ability to drive projects from research to production

‍

‍

WAYS TO STAND OUT IN THE CROWD

• Experience fine-tuning models for healthcare, insurance, or regulated industries

• Published research in NLP, machine learning, or related fields

• Experience with RAG systems, vector databases (Pinecone, Weaviate, Chroma), and knowledge retrieval

• Familiarity with model serving frameworks (vLLM, TGI, Triton) and optimization techniques

• Background in healthcare data standards and terminologies (ICD-10, CPT, SNOMED)

• Experience building evaluation harnesses and automated model testing pipelines Forsure: LLM Fine-Tuning & Model Optimization Engineer 2• Contributions to open-source ML/NLP projects

• Master's or PhD in Computer Science, AI/ML, or Computational Linguistics

‍

‍

WHAT WE OFFER

• Opportunity to shape AI-driven healthcare innovation at a fast-growing company

• Direct mentorship from senior leadership (Fast paced flat-organizational structure)

• Exposure to enterprise sales, consulting, and product development

• Collaborative environment with cutting-edge technology

• Competitive salary and comprehensive benefits

• Flexible work arrangements

‍

You’ll report directly to leadership and work closely with our sales, consulting, and product

teams. This role offers exceptional visibility and the opportunity to make immediate impact.

Join us in making healthcare simple, transparent, and built around people.

‍

Be Sure. Forsure.

‍

To Apply: Email careers@forsure.ai with your resume. Include "Medical AI Advisory Scientist

- [Your Name]" in the subject line and a brief note on why you’re the A+ player we’re seeking.

‍