AI Agent Engineer

Role Overview:
You&039;ll work closely with product, backend, and data teams to turn LLM capabilities into reliable, measurable, and maintainable agent systems – not just prompts that work once in a demo.
We are looking for a Middle/Senior AI Agent Engineer to design, build, and harden autonomous and semi- autonomous AI agents that operate within bTaskee&039;s product ecosystem (customer chat support, Tasker assistance tools, internal operations automation, and more). A core focus of this role is harness engineering – building the evaluation, testing, and orchestration infrastructure that let us safely develop, test, and continuously improve agent behavior before and after it reaches production.
Key Responsibilities:

Run systematic experiments (prompt variants, model versions, retrieval strategies) using the harness to compare performance objectively rather than by eyeballing outputs.
Stay current on agent frameworks, evaluation methodologies, and LLM tooling, and bring pragmatic recommendations back to the team.
Design, develop, and maintain multi- agent systems and autonomous AI Agents (tool- use, multi- step reasoning, memory/state management) for customer- facing and internal bTaskee products.
Build and maintain agent harnesses: test environments, simulated user/task scenarios, scoring rubrics, and regression suites that evaluate agent behavior across many conditions before deployment.
Integrate agents with internal APIs, databases, and third- party tools (search, payments, scheduling, notifications) via structured tool- calling.
Define and track evaluation metrics (task success rate, hallucination rate, latency, cost per interaction, tool- call accuracy) and build dashboards/pipelines to monitor them continuously.
Own the full agent lifecycle: prompt/context design, tool orchestration, guardrails, fallback logic, and production monitoring.

Qualifications and Skills:

Comfortable working with REST/GraphQL APIs, databases, and cloud infrastructure (AWS/GCP);
Practical experience with LLM tool- calling/function- calling, structured outputs, and context/memory management;
Hands- on experience building or operating agent harnesses/eval frameworks – i.e., systems for automated testing, scoring, and regression- checking of AI agent behavior (not just manual prompt tweaking);
Strong proficiency in Python (or similar) and experience with agent/orchestration frameworks (e.g., LangChain, LangGraph, LlamaIndex, Anthropic/OpenAI agent SDKs, or custom- built equivalents);
Experience with production ML/AI systems: logging, tracing, monitoring, and incident debugging;
Solid understanding of evaluation methodology for generative AI systems: designing test sets, scoring rubrics, human- in- the- loop review, and statistical comparison of results.
3+ years of hands- on experience building AI Agent/LLM- powered applications;

Nice to have:

Prior work on multi- agent systems or agent- to- agent coordination.
Experience with RAG pipelines and vector databases.
Experience in on- demand/marketplace or customer- support automation products.

At bTaskee, we don’t just work – we thrive with top- notch benefits!

Advance Home Care Benefit – Get a monthly bTaskee package, freeing up your time for learning, relaxation, and self- care.
KPI- Based Salary – Earn what you deserve through your contributions;
Engaging Workplace – Activities & exciting team- building events;
Comprehensive Healthcare – Regular check- ups & a premium health package;
13th- Month Bonus – Rewarded based on both your performance and the company’s success;
Competitive Salary – Rewarded based on your experience and skills;
Equipment Provided – Enjoy top- tier equipment that enhances productivity and makes your daily work easier;
Annual Performance Review – Unlock growth opportunities every year;
BYOD Support – Get an allowance while enjoying the flexibility of using your own laptop;
Generous Leave Policy – Enjoy 12–16 annual leave days per year;
Celebration Perks – Special benefits for birthdays, weddings, childbirth, and more;
SHUI Compliance – Contributions aligned with legal regulations;

Cập nhật gần nhất lúc: 2026-07-06 15:55:02