Sr. Data Engineer, Analytics Engineering

About the Role:

As a member of the Product and Engineering team at PitchBook, you will be part of a team of big thinkers, innovators, and problem solvers who strive to deepen the positive impact we have on our customers and our company every day. We value curiosity and the drive to find better ways of doing things. We thrive on customer empathy, which remains our focus when creating excellent customer experiences through product innovation.

We know that greatness is achieved through collaboration and diverse points of view, so we work closely with partners around the globe. As a team, we assume positive intent in each other's words and actions, value constructive discussions, and foster a respectful working environment built on integrity, growth, and business value. We invest heavily in our people, who are eager to learn and constantly improve. Join our team and grow with us!

As a Senior Data Engineer on the Enterprise Data Platform team, you are responsible for building data pipelines to ingest various source data from enterprise technologies and PitchBook Platform data, manipulating (cleanse, dedupe, normalize) data into well-constructed data models for data analysis, implementing business logic and standard calculations, governing (supporting, observing, documenting) the data, and making the data available to end consumers in the form of PitchBook data products built on top of our data warehouse/data lake (e.g. Snowflake). You'll work with a range of data and reporting technologies (e.g. Python, Docker, Tableau, Power BI) to build upon a strong foundation of rigor, quantitative techniques, and efficient processing. You'll join other Engineers and Analytics professionals as part of the team that develops data pipelines and insights for our internal stakeholders across Sales, Customer Success, Marketing, Research, Data Operations, Product, Finance and Administration

Your team will rely on your broad experience dealing with a wide range of data techniques and your analytical skills to deliver accurate, timely, accessible, and secure data and insights to users. You will develop the team by guiding and mentoring other data engineers. You'll collaborate closely and effectively with internal and external stakeholders of different roles and technical backgrounds, who have varying understanding of data engineering. You'll have the opportunity and ability to impact many different areas of analytics and operational thinking across enterprise technology and product engineering.

You will exhibit a growth mindset, be willing to solicit feedback, engage others with empathy, and help create a culture of belonging, teamwork, and purpose. If you love building data-centric solutions, strive for excellence every day, are adaptable and focused, and believe work should be fun, come join us!

Primary Job Responsibilities:

• Expert at building unified data technologies to support advanced and automated business analytics
• Design, develop, document, and maintain database and reporting structures used to compile insights
• Define, develop, and review extract, load, and transform (ELT) processes and data modeling solutions
• Consistently evolve data processes and techniques following industry best practices
• Establish and help define reports and dashboards used to translate business data into insights, identify and prioritize operational improvement opportunities, and measure business KPIs against objectives
• Contribute to the ongoing improvement of quality assurance standards and procedures
• Mentor and guide less experienced data engineers, contributing to their professional development
• Stay updated with the latest data engineering technologies and trends and share your insights with the team
• Support the vision and values of the company through role modeling and encouraging desired behaviors
• Participate in various company initiatives and projects as requested

Skills and Qualifications:

• Bachelor's degree in a related field (Computer Science, Engineering, etc.)
• 5+ years of experience in data engineering roles, including creating and maintaining data pipelines, data modeling, and data architecture
• 5+ years of experience in data cleansing, governance, and quality/integrity
• 5+ years of experience in advanced SQL, including expert-level skills in querying large datasets from multiple sources and developing automated reporting
• 5+ years of experience in Python, with skills for diverse components of data pipelines, including scripting, data manipulation, custom extract, transform, and loads, and statistical/regression analysis
• Expertise in extract, transform, and load (ETL) and extract, load, transform (ELT) processes and pipelines, platforms (e.g. Airflow), and distributed messaging (e.g. Kafka)
• Experience with tools that capture and control data modeling change management (e.g. SQLMesh)
• Experience building data alerting and notifications (e.g. on deviations, thresholds, etc.)
• Experience building and managing tools for data observability and documentation (e.g. DataLab)
• Proficient in data storage solutions, data warehousing, and cloud-based data platforms (e.g. Snowflake)
• Proficient in deploying data pipelines to a cloud-native, containerized deployment/delivery environment (e.g. Kubernetes)
• Knowledge and applicable working experience establishing and ensuring data governance, data quality, and compliance standards
• Exceptional problem-solving skills and a track record of designing and optimizing data pipelines
• Excellent communication and collaboration skills with the ability to engage with non-technical stakeholders
• Experience working with enterprise technologies (CRM, Enterprise Resource Planning, Marketing Automation Platforms, Financial Systems, etc.) is a plus
• Proficiency with the Microsoft Office suite including in-depth knowledge of Outlook, Word, and Excel with the ability to pick up new systems and software easily

Benefits + Compensation at PitchBook:

Physical Health

• Comprehensive health benefits
• Additional medical wellness incentives
• STD, LTD, AD&D, and life insurance

Emotional Health

• Paid sabbatical program after four years
• Paid family and paternity leave
• Annual educational stipend
• Ability to apply for tuition reimbursement
• CFA exam stipend
• Robust training programs on industry and soft skills
• Employee assistance program
• Generous allotment of vacation days, sick days, and volunteer days

Social Health

• Matching gifts program
• Employee resource groups
• Subsidized emergency childcare
• Dependent Care FSA
• Company-wide events
• Employee referral bonus program
• Quarterly team building events

Financial Health

• 401k match
• Shared ownership employee stock program
• Monthly transportation stipend

*Please be aware the above PitchBook benefit and perk offerings are subject to corresponding plan and policy documents and may change during the course of your employment.

Compensation

• Annual base salary: $180,000-$200,000
• Target annual bonus percentage: 10%

*Starting pay will be based on several factors and commensurate with qualifications & experience. We also have a location-based compensation structure; there may be different ranges for candidates by location.

Working Conditions:

We believe our business and our culture are strongest when we work together in person. We also know that it's helpful to have some flexibility to work remotely. Most roles work in the office 3+ days/week, and some are expected to work in the office 4-5 days/week. The current expectation for this role is that you are working in the office 3+ days/week and that you are in the office full-time during the training period, for which the length varies by role. During an initial phone screen, the team will discuss expectations for this specific position.

The job conditions for this position are in a standard office setting. Employees in this position use PC and phone on an on-going basis throughout the day. Limited corporate travel may be required to remote offices or other business meetings and events.

Life At PB:

We are consistently recognized as a Best Place to Work and our culture is at the heart of our success. It's our fundamental belief that people do and create great things and that people are the cornerstone of prosperity. We believe that proactively seeking out different points of view, listening to others, learning, and reflecting on what we've heard creates a sense of belonging within PitchBook and strengthens the PitchBook community.

We are excited to get to know you and your background. Concerned that you might not meet every requirement? We encourage you to still apply as you might be the right candidate for the role or other roles at PitchBook.

#LI-EO1