Threat Investigator (Trust & Safety)

Summary

As a threat investigator, you will be supporting our Investigations Team and responsible for detecting and/or responding to malicious uses and abuse, investigating the activity, drafting reports based on your findings, and making recommendations.This will require experience investigating threat actors, harmful behaviors, and/or other activities; as well as a strong ability to use SQL and Python to query, transform, and understand data. You will also respond to escalations and reactive leads, including those that are not caught by our existing safety systems.This role involves exposure to sensitive and distressing content, including child abuse, violent, or otherwise-disturbing material.This role includes serving in an on-call capacity that will involve resolving urgent escalations outside of normal work hours, occasionally including evenings and weekends.In This Role, You WillProactively detect and reacquire bad actors on our platformInvestigate potentially policy-violating activity by querying internal data sources (using SQL and Python) and cross-referencing open source informationDocument and share investigative findings with internal stakeholdersRequirementsU.S.-based, with the ability to work West Coast hours (9am - 5pm PT)Ability to be on-call that will involve resolving urgent escalations outside of normal work hours, including occasional evenings and weekendsFamiliarity with technical investigations, and detection pipelines, especially using SQL and PythonHave at least 3+ years of experience working on related topicsAbility to rapidly context switch across domains, modalities, and abuse areas, to include violent activities and child safetyExcited to work in a fast paced, ambiguous, and purposeful space with high impact across users and beyondDesired Qualities (but Not Required)Full professional proficiency in Arabic, Chinese, Farsi, Portuguese, Russian, or SpanishHave experience scaling and automating processes, especially with language modelsFamiliarity using language models to scaleFamiliarity with one of the following topics/areas: AI safety, child safety, digital mental health, fraud abuse, radicalization/persuasion/grooming; hateful activities and groupsPay Rate: $55-$62

Job Description

As a threat investigator, you will be supporting our Investigations Team and responsible for detecting and/or responding to malicious uses and abuse, investigating the activity, drafting reports based on your findings, and making recommendations.This will require experience investigating threat actors, harmful behaviors, and/or other activities; as well as a strong ability to use SQL and Python to query, transform, and understand data. You will also respond to escalations and reactive leads, including those that are not caught by our existing safety systems.This role involves exposure to sensitive and distressing content, including child abuse, violent, or otherwise-disturbing material.This role includes serving in an on-call capacity that will involve resolving urgent escalations outside of normal work hours, occasionally including evenings and weekends.In This Role, You WillProactively detect and reacquire bad actors on our platformInvestigate potentially policy-violating activity by querying internal data sources (using SQL and Python) and cross-referencing open source informationDocument and share investigative findings with internal stakeholdersRequirementsU.S.-based, with the ability to work West Coast hours (9am - 5pm PT)Ability to be on-call that will involve resolving urgent escalations outside of normal work hours, including occasional evenings and weekendsFamiliarity with technical investigations, and detection pipelines, especially using SQL and PythonHave at least 3+ years of experience working on related topicsAbility to rapidly context switch across domains, modalities, and abuse areas, to include violent activities and child safetyExcited to work in a fast paced, ambiguous, and purposeful space with high impact across users and beyondDesired Qualities (but Not Required)Full professional proficiency in Arabic, Chinese, Farsi, Portuguese, Russian, or SpanishHave experience scaling and automating processes, especially with language modelsFamiliarity using language models to scaleFamiliarity with one of the following topics/areas: AI safety, child safety, digital mental health, fraud abuse, radicalization/persuasion/grooming; hateful activities and groupsPay Rate: $55-$62