Business Analyst - Agentic AI
Company not disclosed
Job Description
About the Role We are hiring a Business Analyst to design, build, and optimize AI agents using an agentic AI platform. This role focuses on solving real logistics workflow problems by combining strong prompt engineering skills, practical understanding of APIs and tools, and the ability to translate business logic into reliable agent behavior. You will work closely with IT, product, developers, and operations teams to deliver agents that reduce manual workload, improve response quality, and unlock new automation opportunities for the business. Key Responsibilities AI Agent Development - Design, develop, and optimize AI agents using agentic platforms to solve real-world business problems. - Build conversational AI workflows and multi-step agent systems that integrate with existing tools and APIs. - Create and continuously refine prompts and system instructions to improve agent performance, reliability, and user experience. - Use workflow builders, tools, and functions to model logistics processes such as booking, quoting, track & trace, documentation, and customer inquiries. Harness Engineering - Shift focus from raw model prompting to building structured execution environments, dynamic prompt orchestration, and robust test harnesses for model evaluations. - Design reusable harness patterns, multi-agent context wrappers, and programmatic guardrails to enforce operational consistency across agents. - Maintain a harness asset repository, automated benchmark suites, and environment definitions aligned with internal engineering standards. - QA test - Conduct tests to evaluate agent performance, identify areas for improvement in reasoning, accuracy, and task completion. - Design effective evaluation frameworks and test scenarios based on real customer and operational questions. - Troubleshoot failures and refine logic, tools, and prompts to improve reliability. Collaboration - Work with product and engineering teams to prototype and iterate on AI-powered features. - Collaborate with cross-functional teams to understand real workflows and business needs and translate them into new agentic AI use cases. - Support onboarding, rollout, and continuous improvement of agents. Documentation and Knowledge Sharing - Document prompting patterns, best practices, agent architectures, and integration methods. - Maintain version control for prompt updates, workflows, and tool integrations. - Share insights with the wider team to raise the overall AI capability across the company. Requirements Experience - Minimum 3 years of experience working across digital automation and generative AI projects in a professional or project capacity. - Hands-on experience building AI agents or conversational AI applications. - Experience in logistics or supply chain operations is strongly preferred, especially areas like warehouse management, network planning, or last-mile delivery. Technical Skills - Strong understanding of prompt engineering principles including few-shot learning, chain-of-thought reasoning (implicit), and structured output design. - Familiarity with the modern AI stack and clear understanding of LLM capabilities and limitations. - Ability to work with REST APIs, JSON, and simple scripting to integrate tools and external systems. - Ability to design and run evaluation frameworks for agent performance. Soft Skills - Clear, structured thinking with a problem-solving mindset. - Eagerness and motivation to keep up with new trends in AI and be at the frontier of new technologies and AI-driven opportunities - Ability to work closely with both technical and non-technical stakeholders. - High accountability and comfort iterating quickly. - Strong communication skills and attention to detail.
Similar jobs
- Senior Associate - Clients & Markets (Business Analyst) - Audit Background Preferred
Hong Kong, Hong Kong SAR
- Business Analyst Front Office Trading - Top-tier Investment Bank - J13149
Pinpoint Asia · Hong Kong, Hong Kong SAR
- Senior Business Analyst
Fleet Management Limited · Hong Kong, Hong Kong SAR
- Product Owner / Business Analyst - AI Chatbot (12 months contract)
Protiviti Hong Kong · Hong Kong, Hong Kong SAR
- Trading Technology Business Analyst
Luxoft · Hong Kong, Hong Kong SAR
- Project Manager / Business Analyst (Fixed Income or FX)
Sanderson-iKas Hong Kong · Hong Kong, Hong Kong SAR