Prompt Engineer

About the Role

Join Firework as an AI Prompt Engineer to shape the future of generative AI applications by designing and optimizing prompts that drive performance and ethical outputs.

What you'll be doing

• Develop and curate golden datasets for prompt evaluation and regression testing.
• Design, test, and refine prompts for a wide range of generative AI applications, including text, audio, avatar animation, and image generation.
• Document best practices and create reusable prompt templates for internal stakeholders.
• Refactor existing prompts to align with best-practice approaches.
• Collaborate with cross-functional teams to integrate AI-driven features into product experiences.
• Build and maintain prompt libraries with clear versioning and metadata.
• Drive continuous improvement in prompt performance using automated metrics and human-in-the-loop evaluations.
• Contribute to and extend our internal evaluation framework.

You will have

• Bachelor’s or Master’s degree in STEM or related field.
• Practical experience with large language models and/or multi-modal generative models.
• Familiarity with prompt techniques such as zero-shot, few-shot, and chain-of-thought.
• Strong analytical and linguistic intuition to translate abstract goals into machine-readable instructions.
• Deep interest in language and communication systems for effective human-machine interaction.
• Ability to create and maintain curated evaluation datasets ("golden sets").
• Strong writing and communication skills.

We'll be excited if you have

• Hands-on experience with Python or another scripting language.
• Experience with Jupyter Notebooks, or LLM ops tools and libraries such as LangChain.
• Experience designing or working within evaluation pipelines.