Job description
As an organization, Google maintains a portfolio of research projects driven by fundamental research, new product innovation, product contribution and infrastructure goals, while providing individuals and teams the freedom to emphasize specific types of work. As a Research Scientist, you'll setup large-scale tests and deploy promising ideas quickly and broadly, managing deadlines and deliverables while applying the latest theories to develop new and improved products, processes, or technologies. From creating experiments and prototyping implementations to designing new architectures, our research scientists work on real-world problems that span the breadth of computer science, such as machine (and deep) learning, data mining, natural language processing, hardware and software performance analysis, improving compilers for mobile platforms, as well as core search and much more.
As a Research Scientist, you'll also actively contribute to the wider research community by sharing and publishing your findings, with ideas inspired by internal projects as well as from collaborations with research programs at partner universities and technical institutes all over the world.
Qualifications
Job responsibilities
- Conduct cutting-edge research on efficient foundation model scaling, with a focus on areas such as:Improving the efficiency of Transformer models for long sequences.
Developing and applying MoE techniques to enhance model capacity and performance.
Exploring conditional computation methods to optimize resource allocation during training and inference.
Minimum qualifications
- PhD in machine learning, computer science, or a related field.
- Strong publication record in top machine learning conferences (e.g., ICML, NeurIPS, ACL)
- Experience with large-scale distributed training and model parallelism
Preferred qualifications
- Extensive experience with deep learning frameworks (e.g., TensorFlow, PyTorch, JAX)
- Deep understanding of Transformer architectures and their applications
- Familiarity with MoE, conditional computation, and other efficiency techniques
- Strong programming skills in Python and C++
- Excellent communication and collaboration skills