Engineer, Senior Staff

Job Title: Engineer, Senior Staff Company: Qualcomm Job Category: Machine Learning Roles & Responsibilities: We are seeking a highly skilled and motivated Language Model Engineer to join our team. The primary role of the engineer will be to train Large Language Models (LLMs) from scratch and fine\-tune existing LLMs on various datasets using state\-of\-the\-art techniques. Responsibilities Model architecture optimizations : optimize latest LLM and GenAI model architectures for NPUs, which involves reimplementing basic building blocks of models for NPUs Model Training and Fine\-tuning: Fine\-tune pre\-trained models on specific tasks or datasets to improve performance. Implement state\-of\-the\-art LLM training techniques such as Reinforcement Learning from Human Feedback (RLHF), ZeRO (Zero Redundancy Optimizer), Speculative Sampling, and other speculative techniques. Data Management: Handle large datasets effectively. Ensure data quality and integrity. Implement data cleaning and preprocessing techniques. Hands\-on with EDA is a plus. Research and Development: Stay up to date with the latest research in NLP and LLMs. Implement state\-of\-the\-art techniques and contribute to research efforts. Infrastructure development : For coming up with new optimization techniques to minimize ONNX memory footprint, export time optimizations. Applicants : Qualcomm is an equal opportunity employer. If you are an individual with a disability and need an accommodation during the application/hiring process, rest assured that Qualcomm is committed to providing an accessible process. You may e\-mail disability\-accomodations@qualcomm.com or call Qualcomm's toll\-free number found here. Upon request, Qualcomm will provide reasonable accommodations to support individuals with disabilities to be able participate in the hiring process. Qualcomm is also committed to making our workplace accessible for individuals with disabilities. (Keep in mind that this email address is used to provide reasonable accommodations for individuals with disabilities. We will not respond here to requests for updates on applications or resume inquiries). If you would like more information about this role, please contact Qualcomm Careers. Work Location: Bengaluru, Karnataka, India Availability: Full time

Required Skills And Experience Deep Learning Frameworks: Hands\-on experience with PyTorch at a granular level. Familiarity with tensor operations, automatic differentiation, and GPU acceleration in PyTorch. NLP and LLMs: Strong understanding of Natural Language Processing (NLP) and experience working with LLMs. Programming: Proficiency in Python and experience with software development best practices. Data Handling: Experience working with large datasets. Familiarity with data version control tools is a plus. Education: A degree in Computer Science, Machine Learning, AI, or related field. Advanced degree is a plus. Work experience : Open, 0-3 years of experience. Neural Architecture Search (NAS): Experience with NAS techniques for optimizing model architectures is a plus. Hands\-on experience with CUDA, CUDNN and Triton\-lang is a plus Minimum Qualifications * Bachelor's degree in Engineering, Information Systems, Computer Science, or related field and 6\+ years of Software Engineering or related work experience. Master's degree in Engineering, Information Systems, Computer Science, or related field and 5\+ years of Software Engineering or related work experience. PhD in Engineering, Information Systems, Computer Science, or related field and 4\+ years of Software Engineering or related work experience. * 3\+ years of work experience with Programming Language such as C, C\+\+, Java, Python, etc. Qualcomm expects its employees to abide by all applicable policies and procedures, including but not limited to security and other requirements regarding protection of Company confidential information and other confidential and/or proprietary information, to the extent those requirements are permissible under applicable law. Key Skills: Machine Learning, Python, PyTorch, Model Training, NLP Salary: Not disclosed