Based in Somerville, Massachusetts, Neural Magic is a series A startup backed by leading investors including Andreessen Horowitz, NEA, NEA, Pillar, VMware, Verizon Ventures, Comcast Ventures, and Amdocs. At Neural Magic we believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and VLLM to every enterprise on the planet. Neural Magic accelerates AI for the enterprise and brings operational simplicity to GenAI deployments. As a leading developer and maintainer of the vLLM project and inventor of state-of-the-art techniques for model quantization and sparsification, Neural Magic provides a stable platform for enterprises to build, optimize and scale LLM deployments.
Our Mission
Neural Magic is on a mission to bring the power of open-source LLMs and vLLM to every enterprise on the planet.
Your Role
As a Full Stack Engineer Team Lead, you'll play a pivotal role in shaping the next generation of tools and platforms for AI inference serving. You'll work closely with our product and UX teams to create intuitive monitoring dashboards, insightful analyzers, and other critical components that empower users to understand and optimize their LLM deployments.
Join us in shaping the future of AI!
Responsibilities
Lead and Collaborate: Guide a small team of front-end, full-stack, and back-end engineers, fostering a collaborative and high-performing environment
Drive the Roadmap: Partner with product management to translate business needs into technical solutions and actively contribute to our engineering and product roadmap
Build for the Future: Develop and maintain core features for our inference server platform, built upon technologies like vLLM and other cutting-edge solutions
Focus on Backend Excellence: Apply your deep expertise in Python-based backend development to build scalable, reliable, and performant systems
Full Stack Agility: Contribute to the front end using your proficiency in React, ensuring a seamless user experience
Data Expertise: Design and implement database solutions (SQL and NoSQL) that meet the unique demands of LLM-based applications
DevOps Advocate: Embrace DevOps principles and technologies (Kubernetes, CI/CD) to ensure smooth and efficient deployments
Requirements
Experience: 5 or more years of experience in full-stack development
Proven Leadership: Experience leading engineering teams and projects to successful outcomes
Cloud Savvy: Demonstrated ability to build and maintain cloud-based applications
Python Pro: Strong proficiency in Python and related backend technologies
Front-End Skills: Comfort with React and modern single-page application (SPA) development
Database Know-How: Experience with SQL and NoSQL databases, with an understanding of their trade-offs
DevOps Experience: Familiarity with Kubernetes, CI/CD pipelines, and other DevOps best practices
Strong Collaboration: Ability to work effectively with cross-functional teams, including product and UX
Benefits
Competitive compensation and stock option plan
Comprehensive health care (medical, dental, vision)
Retirement plan (401k, IRA)
Generous paid time off (vacation, sick leave, holidays)
Family leave (maternity, paternity)
Disability coverage
Professional development opportunities
Flexible work arrangements (remote options)
Wellness resources
Free food and snacks (in the office)
Neural Magic is an equal-opportunity employer committed to fostering a diverse and inclusive workplace. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.
Seniority level
Mid-Senior level
Employment type
Full-time
Job function
Engineering
Industries
Primary and Secondary Education and Non-profit Organizations
Referrals increase your chances of interviewing at Neural Magic by 2x