Content Adversarial Red Team Analyst
- linkCopy link
- emailEmail a friend
Minimum qualifications:
- Bachelor's degree or equivalent practical experience.
- 5 years of experience in data analysis and working with datasets.
- Experience working on counter abuse strategies for online platforms.
- Experience working with Large Language Models.
Preferred qualifications:
- Experience working on product policy analysis and identifying policy risks.
- Experience with modeling, experimentation, and causal inference.
- Experience with adversarial testing of online consumer products.
- Experience in Data Analysis and SQL.
- Exceptional communication and presentation skills to deliver findings of analysis.
- Excellent problem-solving skills with attention to detail in an ever-changing environment.
About the job
Trust & Safety team members are tasked with identifying and taking on the biggest problems that challenge the safety and integrity of our products. They use technical know-how, excellent problem-solving skills, user insights, and proactive communication to protect users and our partners from abuse across Google products like Search, Maps, Gmail, and Google Ads. On this team, you're a big-picture thinker and strategic team-player with a passion for doing what’s right. You work globally and cross-functionally with Google engineers and product managers to identify and fight abuse and fraud cases at Google speed - with urgency. And you take pride in knowing that every day you are working hard to promote trust in Google and ensuring the highest levels of user safety.
The Content Adversarial Red Team (CART) in Trust and Safety Intelligence is a new team that will use unstructured persona-based adversarial testing techniques to identify ‘unknown unknowns’ and new/unexpected loss patterns on Google’s premier generative AI products. The CART team will work alongside product, policy and enforcement teams to proactively detect harm patterns, and help build the safest possible experiences for Google users.
In this role, you will be at the forefront of generative AI testing in Trust and Safety, and support Google’s efforts to launch bold and responsible products in this space. You will be exposed to graphic, controversial, or upsetting content.
This role works with sensitive content or situations and may be exposed to graphic, controversial, or upsetting topics or content.
At Google we work hard to earn our users’ trust every day. Trust & Safety is Google’s team of abuse fighting and user trust experts working daily to make the internet a safer place. We partner with teams across Google to deliver bold solutions in abuse areas such as malware, spam and account hijacking. A diverse team of Analysts, Policy Specialists, Engineers, and Program Managers, we work to reduce risk and fight abuse across all of Google’s products, protecting our users, advertisers, and publishers across the globe in over 40 languages.
Responsibilities
- Write scripts that will help multiply the impact of the team, including through systematized/automated prompt creation and scraping of content.
- Monitor and research emerging abuse vectors for generative AI from open web and specialized sources, and work individually and collaboratively to promptly uncover new risk vectors in Google’s main Generative AI products.
- Apply insights for creative prompting of Google generative AI tools such as Gemini, Search Generative Experience, and Vertex API. Support the creation of persona-based adversarial playbooks to guide the team’s red teaming.
- Develop repeatable processes that can yield valuable insights regardless of topic and attack vector. Annotate and cluster harm types detected in structured prompting exercises.
Information collected and processed as part of your Google Careers profile, and any job applications you choose to submit is subject to Google's Applicant and Candidate Privacy Policy.
Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See also Google's EEO Policy, Know your rights: workplace discrimination is illegal, Belonging at Google, and How we hire.
If you have a need that requires accommodation, please let us know by completing our Accommodations for Applicants form.
Google is a global company and, in order to facilitate efficient collaboration and communication globally, English proficiency is a requirement for all roles unless stated otherwise in the job posting.
To all recruitment agencies: Google does not accept agency resumes. Please do not forward resumes to our jobs alias, Google employees, or any other organization location. Google is not responsible for any fees related to unsolicited resumes.