AI Prompt Engineer at Authenticx

Posted on

Indianapolis, IN
Hybrid

Industry: Healthcare

Job Type: Full-time

Experience Level: Mid-Senior Level

Job Description

Authenticx is hiring an AI Prompt Engineer to design, develop, and optimize large language model prompts used for conversation scoring. The role turns scoring rubrics into reusable, testable prompt logic for enterprise healthcare clients, working with engineering, implementation, product, and data labeling. It is a hybrid role based at the Indianapolis office.

Responsibilities

  • Design and implement LLM prompts aligned to internal scoring rubrics and customer-specific needs.
  • Test and evaluate prompts with labeled datasets so scoring stays accurate.
  • Work with engineering on tooling and infrastructure for LLM scoring workflows.
  • Maintain a centralized prompt library so prompts are reused and standardized across use cases.
  • Document prompt strategies, testing approaches, and outcomes.
  • Find and fix inefficiencies in how prompts are developed and deployed.
  • Partner with product and data labeling teams to improve the quality and consistency of scoring outputs.

Requirements

  • Strong understanding of LLMs, NLP systems, and prompt engineering.
  • Ability to structure and document complex logic so it is scalable and repeatable.
  • Ability to collaborate with technical and non-technical teams.
  • Analytical mindset with an interest in experimentation, iteration, and data-driven decisions.
  • Preferred: experience in structured data labeling or QA workflows.
  • Preferred: familiarity with LangChain, OpenAI or GPT APIs, or vector databases.
  • Preferred: background in linguistics, cognitive science, or human-computer interaction.
  • Preferred: proficiency in Python or scripting tools for evaluation or automation.
  • Must be authorized to work in the United States without current or future visa sponsorship.
  • Occasional travel for team meetings or planning sessions.

Benefits

  • Hybrid work from the Indianapolis office.
  • Health insurance options, plus medical, vision, dental, life, and disability insurance.
  • HSA and FSA plans.
  • 401(k).
  • Unlimited vacation time, plus paid holidays, sick leave, and parental leave.
  • Perks at Work membership for discounts on shopping and travel.
Browse Jobs
Apply