Search Quality Analyst

📋 Description

• • Join Perplexity, a rapidly growing AI-powered search engine, as a Search Quality Analyst and play a pivotal role in shaping the future of information discovery. In this remote position, you will leverage your analytical prowess and deep understanding of user behavior to drive the development of cutting-edge search technologies. Your primary mission will be to identify robust and sensitive signals from user interactions, enabling us to gather insights from A/B experiment data with unparalleled efficiency and accuracy.
• • As a Search Quality Analyst, you will be instrumental in translating complex user data into actionable strategies. You will delve into the intricacies of how users interact with our search engine, uncovering patterns and trends that inform our product roadmap and accelerate user adoption. This involves a proactive approach to understanding user needs and translating them into tangible product improvements.
• • A core aspect of your role will be formulating hypotheses about user behavior and product performance. You will then rigorously validate these hypotheses by designing, executing, and meticulously analyzing A/B tests. This data-driven approach ensures that every product iteration is backed by solid evidence, leading to more effective and user-centric search experiences.
• • You will be responsible for defining and implementing key performance indicators (KPIs) that accurately reflect the success of our search features. This includes determining the most appropriate metrics for tracking user engagement, satisfaction, and overall search quality. Furthermore, you will translate these metrics into clear, insightful visualizations and implement them in interactive dashboards, making complex data accessible to stakeholders across the organization.
• • Beyond analyzing existing data, you will contribute to the design and development of new data pipelines. These pipelines are crucial for enhancing our ranking algorithms and delivering superior search results. Your work will directly impact the quality and relevance of the information our users receive, making your contribution essential to our mission.
• • This role offers a unique opportunity to work at the forefront of AI and search technology. You will be involved in discovering novel signals that capture nuanced user intent and satisfaction. You will also be responsible for producing critical metrics that measure the effectiveness of our search algorithms and user experience.
• • A significant part of your contribution will involve constructing data labeling pipelines. These pipelines will integrate human feedback with insights generated by Large Language Models (LLMs). This hybrid approach ensures the highest quality of data for training and evaluating our AI models, directly improving the intelligence and responsiveness of our search engine.
• • You will collaborate closely with engineering, product, and research teams, acting as a bridge between raw data and strategic decision-making. Your insights will empower these teams to make informed choices, optimize user journeys, and innovate on new search paradigms.
• • The ideal candidate possesses a strong analytical mindset, a passion for problem-solving, and a keen eye for detail. You should be comfortable working with large datasets, employing statistical methods, and communicating complex findings in a clear and concise manner. This role is perfect for someone who thrives in a fast-paced, innovative environment and is eager to make a tangible impact on a product used by millions.
• • By joining Perplexity, you are not just taking on a job; you are becoming part of a mission to revolutionize how people access and interact with information. You will be empowered to experiment, learn, and grow, contributing to a product that is redefining the search landscape. Your work will directly influence the user experience, making search more intuitive, efficient, and insightful than ever before.
• • We are looking for individuals who are not afraid to challenge the status quo and are driven by a desire to build the best possible search experience. If you are passionate about data, AI, and the future of information, this is the opportunity for you to make a significant mark.