Sr. Applied Scientist, AGI Info

Sr. Applied Scientist, AGI Info - Web Information Systems

Job ID: 3005187 | Amazon.com Services LLC

Amazon’s Artificial General Intelligence (AGI) organization is developing a next-generation web search system to support RAG applications across Amazon. We are looking for a Sr. Applied Scientist with expertise in information retrieval (IR) and ranking to join the team!
If you are looking for an opportunity to develop innovative solutions to deep technical problems in web-scale information retrieval (IR), helping to deliver retrieval-augmented generation solutions, having a massive customer impact, this might be the role for you! As a Applied Scientist, you will work with smart, passionate colleagues in a fast-paced environment. You will leverage your expertise in LLMs to develop a state-of-the-art evaluation and document labeling workflow to drive automated evaluations and training data generation. You will keep up with relevant research in the field of IR and publish your work in top-tier conferences. You will develop and help lead the execution of multi-year research roadmaps, enabling the team to focus on the right technical challenges to delight our customers.

Key job responsibilities
As an Sr. Applied Scientist, you will apply scientific rigor to your work. You will deliver incrementally, setting up and executing experiments informed by rigorous failure space analysis of prior experiments. You have a knack for writing clear, succinct and informative reports of your experiments. You collaborate and seek guidance from other scientists on your team to define the next experiments. You collaborate closely with engineers to bring your innovations into production. You will continuously with customers and stakeholders to simplify and adapt to deliver for our customers. You will develop state-of-the-art web search technology, including training novel retrieval and ranking models, scaling models and optimizing performance, partnering with engineering to deploy and debug model performance in production, and building and scaling quality training data sets.

BASIC QUALIFICATIONS

- 3+ years of building machine learning models for business application experience
- PhD, or Master's degree and 6+ years of applied research experience
- Experience programming in Java, C++, Python or related language
- Experience with neural deep learning methods and machine learning

PREFERRED QUALIFICATIONS

- Experience with modeling tools such as R, scikit-learn, Spark MLLib, MxNet, Tensorflow, numpy, scipy etc.
- Experience with large scale distributed systems such as Hadoop, Spark etc.
- Experience with large scale machine learning systems such as profiling and debugging and understanding of system performance and scalability
- Deep expertise in state-of-the-art LLMs (e.g., Claude, GPT-4, Olympus) and their capabilities as evaluators
- Experience with LLM alignment techniques, including RLHF, DPO, or similar approaches
- Publications at peer-reviewed conferences (e.g. SIGIR, WWW, CIKM, ACL, EMNLP, NAACL, NeurIPS, ICLR, ICML)
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $150,400/year in our lowest geographic market up to $260,000/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit . This position will remain posted until filled. Applicants should apply via our internal or external career site.

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.