Employer: Twitter
What You’ll Do:
In this role, your North Star is to help the Quantitative Research team become the gold standard for research in the industry. You will lead quantitative research in your domain and spearhead cross-functional initiatives with teams like Product, Qualitative Research, and Data Science to build and improve the products, tools, and policies that are at the foundation of how customers experience and get more out of our platform. You will be an integral part of developing robust sampling and weighting methodologies for various populations and projects, and streamlining the quantitative research process via automation and standardization. You will build in research at multiple stages of the product development process to help our Product and Research partner teams understand their customers’ perceptions and achieve strategic goals. You will partner with others to identify where and how we should evaluate ideas, concepts, and existing experiences, and assist the team in making critical design decisions affecting the user experience. Your work will also require you to design the best approach for a wide variety of user experience questions, balancing timing, methodological rigor, research strategy, company goals, and business needs. Above all else, as a senior member of the team you’ll mentor junior members by investing your energy and talents in supporting the career growth and development of the people on your team.
Qualifications
Who You Are:
You’re an experienced researcher with a strong understanding of how to integrate qualitative and quantitative research methodologies. You are an expert in survey and experiment design, and have a strong, working understanding of survey methodology, statistical inference, regression modeling, exploratory data analysis, and mathematical demography. You know when to engage with teams across Product, Engineering, Design, Content Strategy, Strategy & Operations, and Data Science, what questions to ask, where to probe, and how to implement the most effective research strategies and analysis methods. You thrive in a fast-paced environment and enjoy setting your own research goals, managing workloads and expectations, and delivering actionable research findings and recommendations. You’re passionate about Twitter and believe that great experiences are always inspired by a deep understanding of the user.
Required competencies:
- Expertise in applying end-to-end survey methodology, e.g., survey design (including sampling and weighting, bias correction), principled questionnaire construction, instrumentation, and standard methodologies, to company, business, and product goals
- Strong understanding of foundational frequentist inferential statistics, e.g., experimentation, hypothesis testing, correlation vs causation
- Ability to effectively communicate complex data in an accessible and meaningful way to non-quantitative audiences, as well as build excitement and engagement about research
- Ability to connect business problems to measurable outcomes and shape business strategies, e.g., connecting user research to behaviors and/or revenue and creating actionable design/research recommendations
- Ability to transform ambiguous problem spaces into research plans that are flexible to external deadlines and priority adjustments, and to drive high visibility projects from initiation to completion
- Ability to envision and execute against a research roadmap in new and novel spaces
- Ability to execute while building, leading, and influencing collaborative cross-functional relationships with diverse groups of technical and non-technical stakeholders
Requirements:
- MS or PhD in Statistics, Political Science, Survey Methodology, or other Social Science or a related field
- 8+ years conducting user experience research and/or market research preferred
- Experience in psychometric analysis, cognitive testing, and/or developing frameworks & mental models
- Experience with Bayesian statistical models, primary data collection, field experiments, experimental design, missing data, low response rate probability samples / nonprobability samples, observational causal inference (regression adjustment, matching, propensity score stratification)
- Experience in complex data visualization (time-series, statistical distributions, maps, hierarchies, networks)
- Experience working with large scale data sets (logs analysis, surveys, experimental design)
- Expertise in statistical programming languages such as R, Python, and SQL
- Experience with large data technologies Hadoop, MapReduce, Pig, Spark, Hive, BigQuery, or Presto, preferred
- Experience working with Product and Design teams preferred
- Comfort with Data Science including machine learning, natural language processing a plus
- Experience with Tableau or similar platform a plus
