Let’s get started
By clicking ‘Next’, I agree to the Terms of Service
and Privacy Policy, and consent to receive emails from Rise
Jobs / Job page
Principal Architect, AI/ML image - Rise Careers
Job details

Principal Architect, AI/ML

Zencore is a fast-growing company founded by former Google Cloud leaders, architects, and engineers. We are seeking candidates with significant experience in Google Cloud to join our team. Our engagements aim to eliminate obstacles, reduce risk, and accelerate timelines for customers transitioning to Google and seeking assistance with data and application modernization. We embed within customer teams to provide strategic guidance, facilitate technology decisions, and execute projects in a collaborative, co-development style.


As a member of our Cloud Engineering team, you will be working with fast-paced innovative companies, leveraging AI as the key driver of their transformation. Our clients will look to you as their trusted advisor, someone they can rely on and who will be there to help them along their AI journey. You will be expected to cover a large spectrum of technology topics like model optimization, high-performance training on specialized hardware (TPUs), efficient model serving (vLLM), MLOps, and complex agentic systems.

 

At Zencore, a Principal Architect is a key technical leader in our engineering organization and acts as an ambassador of our technical and cloud engineering expertise. Principal Architects at Zencore are able to navigate a broad technical range but are specialized in one or more domains. They are responsible for the technical oversight and end-to-end delivery of projects within our professional services business.

 

Whilst this is remote role, we are only considering US based candidates and do not offer visa sponsorship.


What you will do...
  • Serve as Zencore’s senior-most technical authority on the practical application of advanced artificial intelligence and machine learning.
  • Partner with the sales and business development teams in a pre-sales capacity to scope opportunities, design solutions for proposals, and act as the senior technical voice in client pitches.
  • Lead the architecture and design of sophisticated, secure, and scalable AI solutions for our clients, moving beyond standard API integrations to create genuine competitive advantages.
  • Collaborate closely with Cloud & Data Architects to guarantee the design and deployment of comprehensive client solutions.
  • Address the growing demand for private, data-sovereign AI by designing systems that meet strict GDPR and data privacy requirements. Strive for model explainability and bias mitigation, ensuring solutions adhere to ethical standards and safety guardrails.
  • Architect solutions for hosting, fine-tuning, and optimizing both proprietary (e.g., Gemini, Claude) and open-source (e.g., Llama, Mistral) models on hyperscaler platforms.
  • Lead clients in selecting optimal cloud-native technologies, prioritizing Google Cloud solutions for deploying and scaling production-grade agentic systems.
  • Guide and mentor customers and Zencore's engineering teams on advanced topics, establishing best practices for high-performance training (PyTorch, JAX, TPUs), efficient model serving (vLLM), and complex agentic systems (LangGraph, Langchain, Google ADK).
  • Devise the financial architecture of AI solutions by performing ROI analysis and implementing cost-optimization strategies to ensure large-scale deployments remain economically sustainable for customers.
  • Act as an external thought leader, contributing to the Zencore brand through blog posts, conference presentations, and community engagement.
  • Act as a "player-coach," providing hands-on leadership and fostering a culture of deep technical excellence in AI/ML.


Who we need...
  • Master’s degree in Computer Science, natural sciences, mathematics, or a related technical field, or equivalent practical experience in designing and delivering high-scale AI/ML systems.
  • Extensive experience in a senior or principal architect role with a proven track record of designing and delivering complex, production-grade machine learning systems that have created measurable business value.
  • Deep, hands-on architectural experience with at least one major cloud platform (GCP, AWS, or Azure) is required.
  • Direct, hands-on experience with Google Cloud (Vertex AI, GKE, TPUs) is a significant plus.
  • Proven expertise in LLM optimization, including techniques for quantization, pruning, efficient fine-tuning (e.g., LoRA), and high-performance serving (e.g., vLLM, TensorRT-LLM).
  • Hands-on experience with high-performance ML frameworks (e.g., JAX, PyTorch/XLA) for training or fine-tuning large-scale models.
  • Expertise in designing and deploying agentic workflows using both code-centric (e.g., LangGraph, LangChain, Google ADK) and low-code (e.g., Vertex AI Agent Builder, LangSmith Agent Builder) paradigms.
  • A strong understanding of the architectural patterns required for building secure, private, and data-sovereign AI solutions.
  • Experience with LLM observability and evaluation frameworks (e.g., LangSmith, LangFuse, Vertex AI Evaluation).
  • Exceptional communication and stakeholder management skills, with the ability to articulate complex technical concepts and their business value to both technical and non-technical audiences.
  • A passion for mentoring and a drive for continuous learning in the fast-evolving AI landscape.


We are a fully remote company and offer competitive compensation and benefits.


Zencore is committed to a diverse and inclusive workplace. Zencore is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status.


Zencore Glassdoor Company Review
4.1 Glassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star icon Glassdoor star icon
Zencore DE&I Review
4.4 Glassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star icon Glassdoor star icon
CEO of Zencore
Zencore CEO photo
John Forstrom
Approve of CEO

Average salary estimate

$275000 / YEARLY (est.)
min
max
$200000K
$350000K

If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.

Similar Jobs
Photo of the Rise User
Posted 4 hours ago

Crusoe is hiring a Senior Manager, Controls Deployment to lead engineering teams deploying high-density EPMS and BMS infrastructure across multi-region construction sites.

Launch your engineering career at Rolls‑Royce as an entry-level Control Systems Engineer working on power and propulsion control systems in Indianapolis.

Support utility outage projects across the Western US as a traveling Field Engineer responsible for project execution oversight, safety, subcontract coordination, and client communication.

Photo of the Rise User
City and County of San Francisco Hybrid 1 Dr Carlton B Goodlett Pl, San Francisco, CA 94102, USA
Posted 3 hours ago

The City seeks a beginning-level environmental engineer to perform field inspections, support design and prepare engineering reports for municipal projects under supervision.

Photo of the Rise User
Posted 3 hours ago

Support San Francisco's transportation projects as a Junior Engineer performing field inspections, design support, calculations, and reporting for municipal infrastructure and traffic programs.

NODA is hiring a Tactical Communications & Networking Engineer to design, deploy, and troubleshoot tactical radio and mesh networking solutions that enable resilient multi-platform autonomy in contested environments.

Photo of the Rise User
AbbVie Hybrid Tempe, AZ, USA
Posted 15 hours ago

An engineering role at AbbVie responsible for independently designing, testing, and improving products and processes while coordinating resources and mentoring technicians within a regulated healthcare environment.

Photo of the Rise User
Posted 11 hours ago

IAV Automotive Engineering is hiring a Junior Test Engineer to support emissions testing, vehicle prep, and data validation for powertrain and OBD calibration projects.

Photo of the Rise User
Harvard University Hybrid Cambridge, Massachusetts, United States
Posted 15 hours ago

Experienced equipment engineer needed to manage and maintain RIE, CVD/PVD tools and gas systems in Harvard's high-volume CNS nanofabrication cleanroom while supporting research processes, safety, and user training.

Project Engineer needed to support large-engine electrical systems as a manufacturing liaison focused on build issue resolution, quality improvements, and traceability enhancements.

Photo of the Rise User
Posted 3 hours ago

The City and County of San Francisco seeks a licensed Civil Associate Engineer to manage engineering design, construction oversight, and supervision of technical staff on municipal projects throughout the city.

Photo of the Rise User
Awesome Motive Hybrid No location specified
Posted 2 hours ago

Lead AIM's technical vision and execution as CTO, building and scaling a hardware-software Physical AI platform that deploys autonomous earthmoving fleets into production.

Photo of the Rise User

Working Families Party is hiring a hands-on Director of Engineering to lead a small team, maintain reliable data infrastructure, and build staff-facing features that support organizing and campaigns.

Zencore is a leading cloud consulting and services firm. Above all else we value experience, hard work and the ability to keep things in perspective and have fun as we ensure our customers are delighted with the work we do. “More than anything we...

1 jobs
MATCH
Calculating your matching score...
FUNDING
DEPARTMENTS
SENIORITY LEVEL REQUIREMENT
TEAM SIZE
EMPLOYMENT TYPE
Full-time, remote
DATE POSTED
April 17, 2026
Risa star 🔮 Hi, I'm Risa! Your AI
Career Copilot
Want to see a list of jobs tailored to
you, just ask me below!