Role – AI Engineer — Copilot Studio & Azure AI Foundry
As an AI Engineer, you design, build, and operate intelligent agentic workflows and agents using Microsoft Copilot Studio and Azure AI Foundry. You integrate LLMs with enterprise data, implement secure and reliable AI agents, and continuously improve quality through evaluation, tracing, and structured experimentation. You own both build and run.
Qualifications:
Bachelor’s degree in technical field such as Information Technology, Computer Science with specialization in Artificial Intelligence / Machine Learning / Data Science.
Experience:
At least 4+ years of relevant professional experience.
Key Responsibilities:
1) Agent & Workflow Engineering
- Design, implement, and ship conversational and agent workflows.
- Implement RAG with vector/hybrid retrieval and integrate enterprise data sources.
- Use tool calling/actions and publish agents to chat and web with proper authentication.
- Apply software engineering best practices
2) Prompting, Quality, and LLMOps
- Design prompts, system messages, and agent behaviors for robustness and reliability.
- Run structured Prompt flow experiments and evaluations.
- Perform tracing, A/B testing, error analysis.
3) Data, Integrations & RAG Pipelines
- Connect agents to enterprise sources (SharePoint, Microsoft Graph, Azure Blob).
- Build ingestion, chunking, and embedding pipelines.
- Use Azure AI Search for vector/hybrid retrieval when needed.
- Develop clean, versioned API integrations.
4) Security, Compliance & Governance
- Enforce least‑privilege access, secrets hygiene, and managed identities.
- Apply content‑safety guardrails, prompt‑injection resilience, and input/output filtering.
- Follow environment strategies and DLP policies aligned with enterprise governance.
5) Operations, Cost & Observability
- Monitor runtime using logs, metrics, and distributed tracing; maintain dashboards.
- Define and track KPIs (cost per successful task, task‑success rate).
- Apply resilience patterns: retries, timeouts, circuit breakers, and rate limits.
Required Skills:
- Hands‑on experience with Microsoft Copilot Studio and Azure AI Foundry.
- Experience with agent patterns, Prompt flow, and evaluation/tracing.
- RAG expertise: index design, embeddings, hybrid/vector retrieval.
- Work with enterprise connectors; Custom Connectors nice‑to‑have.
- Python required; C# or JavaScript is a plus.
- API use, data modeling, and integration experience.
- Low‑code ALM (Solutions, Pipelines) and DLP guardrails.
- Strong English communication skills.
Preferred Skills:
- Shipped production agents across chat/web with measurable impact.
- A/B testing and performance evaluation.
- CI/CD practices and Infrastructure as Code (Terraform or Bicep) for reproducibility.
- Semantic Kernel for plugin orchestration and memory/vector connectors.
- Prompt flow (evaluations, tracing, experiments)
Common AI Tools & Frameworks (Experience Beneficial)
- Azure AI Foundry SDKs (Python/JavaScript/C#)
- Azure AI Search (vector, hybrid, semantic)
- Azure Monitor & Application Insights
- Power Platform ALM
- GitHub Actions / Azure DevOps Pipelines
Soft skills:
- Strong communication and collaboration abilities.
- Problem-solving mindset.
- Ability to work independently and in cross-functional teams.
- Attention to detail and commitment to quality.
- Integrity, high on ethics.
- Follow up skills, disciplined approach.
- Good Team player with ability to work with multi-cultural users and IT counterparts across globe.
Soft Skills & Ways of Working
- Clear communication of complex AI behavior to stakeholders.
- Collaborative mindset with product, business, security, and engineering teams.
- Ability to translate business use‑cases into technical agent designs.
- Proactive documentation, knowledge sharing, and enablement.
- Comfortable with iterative learning, experimentation, and rapid feedback cycles.
- Ownership mentality across design, deployment, and monitoring.
- Good Team player with ability to work with multi-cultural users and IT counterparts across globe.