AIJobsy Logo
Prophecy logo
Principal AI Engineer (Technical Lead)
Prophecy
Highly relevant job!

Job Details

Location:San Francisco Bay Area
Job Type:Full-time
Posted:19 days ago

Skills & Technologies

AI Engineer
Machine Learning
LLM
Large Language Models
Technical Lead
PyTorch
HuggingFace
LangChain
LlamaIndex
RAG
Vector Databases
Prompt Engineering
MLOps
DevOps
CI/CD
A/B Testing
Multi-Agent Systems
ETL
Cloud
AWS
GCP
Kubernetes
Serverless
Python
Go
Java
Scala
API
Distributed Systems
Data Engineering
Software Engineering
Compiler Development
Open Source
Mentoring
Leadership
Data Science
Generative AI
Fine-tuning
SFT
DPO
RLHF
Distillation
Quantization
Production Agents
Prompt Orchestration
Code Generation
Semantic Extraction
Knowledge Graphs
Big Data
Spark
Model Optimization
Low-Latency
High-Throughput
Retrieval Systems
Mid-Senior Level
Staff Level

Full Job Description

About Prophecy 

The leader in AI-native data preparation and analysis, Prophecy is revolutionizing how the world’s top enterprises turn data chaos into reliable insights. We introduce the AI-native data lifecycle (generate, refine, deploy) where our industry leading AI agents and humans work hand-in-hand in visual and document interfaces to analyze, transform and prepare data, to ship trusted insights at enterprise scale. 

Don’t miss the rocket ship—join Prophecy and build the next data revolution.

The Principal AI Engineer (Technical Lead), will have the following: 

  • Technical Depth (one of the below)

    • ML/LLM: Led fine-tuning (SFT, DPO, RLHF), distillation, quantization with PyTorch/HuggingFace

    • Shipped production agents (LangChain, LlamaIndex, CrewAI)

    • Expert in RAG, vector DBs, prompt orchestration.

  • Hands-On Leadership Codes weekly prototypes, debugs, unblocks.

    • Mentors staff; remains top expert on toughest problems.

  • End-to-End Delivery

    • Led 2+ open-ended, user-facing AI projects from ambiguity to impact.

    • Owned vision, roadmap, MVPs.

  • Cross-Functional Leadership

    • Partnered with PMs/execs on metrics, priorities, trade-offs

    • Presented to C-suite/board.

  • Disciplined Process

    • Enforced MLOps/DevOps for agents: CI/CD, canaries, observability,

    • A/B prompt testing.

    • Championed reproducibility, governance, code reviews, on-call culture.

  • Agentic Specialization

    • Built multi-agent systems (e.g., ETL automation, code-gen loops).

    • Created eval harnesses

    • Beat reliability/latency benchmarks.

  • Cloud & Scale

    • Architected 10k+ RPS backends (AWS/GCP, k8s, serverless).

    • Fluent in Python, Go, Java, Scala.

    • Owns APIs, async, optimization.

  • Builder at Scale

    • 0→1 and 1→10: shipped greenfield, scaled 100x.Drives rapid prototyping with production rigor.

What Will Make You Stand Out

  • ML/LLM work in code generation (e.g., Codex, text-to-SQL), semantic extraction, or knowledge graphs (e.g., Neo4j, Neptune).

  • Experience with big-data engines like Spark.

  • Compiler development for languages like SQL, Python, or Scala.

  • Optimization of ML models for low-latency, high-throughput production use.

  • Contributions to open-source AI/ML projects (e.g., Hugging Face, PyTorch).

  • Expertise in retrieval systems or vector databases (e.g., Pinecone, Weaviate).

  • Skill in evaluating tech and driving build/buy decisions

Seniority: Mid to Staff Level

Experience: 7+ years in industry

Compensation:  $300,000-$350,000

Reflected is the base pay range offered for this position. Pay may vary depending on factors including but not limited to achievements, skills, experience, or work location. The range listed is just one component of the compensation package offered to candidates. 

Benefits and Perks

  • Prophecy covers 99% of employee health insurance premiums and 75% for dependents

  • We offer $200 per month towards remote work, wellness, gyms, massages, facials, and more!

  • Flexible PTO

  • Professional development allowance

  • Company sponsored Long Term Disability and Life Insurance, FSA/HSA, dental, vision, and more

  • Ability to have your fingerprint on an innovative platform

  • End-to-end ownership of your projects.

*Benefits and perks may vary per country

Our Commitment to Diversity and Inclusion

At Prophecy, we hire for merit and foster an inclusive culture where people from diverse backgrounds can excel and do their best work. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Prophecy are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and any other protected characteristics under applicable laws.

Apply Now