Data Engineer - Needham Massachusetts

Company: Stepstone
Location: Needham, Massachusetts
Posted On: 05/13/2024

Company Description Appcast is the global leader in programmatic recruitment advertising technology and services. With advanced technology, unmatched market data and a team of the industry's best recruitment marketers, Appcast's technology and services manage job advertising annually for enterprise clients across industries. Headquartered in Lebanon, N.H. with offices in the U.S., Canada and Europe. Appcast is part of the Stepstone group, a leading digital recruitment platform that connects companies with the right talent and helps people find the right job.--- - Job Description The data engineer will serve as a liaison between its core developers and downstream analysts. The data engineer's primary job is to code automated processes that extract data from disparate sources; efficiently build and manage transformations into a cloud data warehouse; and build pipelines that load data into tools used by economists, data scientist, data analysts, and many other stakeholders. SQL and Python/R skills are a must. Experience managing data warehouses and ELT/ETL processes in an OLAP database is strongly desired. The employee can be in the U.S., Canada, Belarus, or Poland. - Job Responsibilities - Move data between systems: - -

• Extraction - Appcast has several disparate internal proprietary, external proprietary and external public sources that all serve our customers in several ways. A data engineer's primary job is to build automated processes that extract data from these disparate sources for downstream use by data analysts. -
• Transform - A data engineer will transform data from disparate sources into distinct tables using a relational data model, so that analysts can pull them together in one unified workflow. -
• Load - A data engineer will need to load the new tables into a cloud data warehouse using efficient, low-latency methods. - Manage cloud data warehouse: - -
  • Monitor performance - As data needs grow, the data engineer will need to monitor essential performance queries used by downstream analysts to ensure data is being delivered in a timely manner that does not cause slowdowns. - -
  • Data quality - Ensuring both internal and external data sources are accurate and up to date to provide the best quality for our clients and media partners. - - Serve data to downstream users ("democratize data"): - -
    • Liaison with the Appcast core software development team on data extraction from its proprietary database. -
    • Data visualization/dashboards - Ensure BI tools (e.g., Tableau) are accurate and up to date, functioning as data dashboards both internally and externally. -
    • Data permissions/access - Manage the onboarding and offboarding of data permissions, who is given access to the cloud data warehouse and ensuring proper security protocols are being followed. - Set data strategy for company: - -
      • Control cost - Work with procurement specialists to keep negotiated contracts controlled with external data vendors; research/keep up to date with new data vendors that can provide Appcast with a competitive advantage in our competitive market - -
      • Data awareness/education - Educate analysts on basic data "hygiene" on how to manage and clean data, and where to access data sources - -
      • Data security and governance - Develop a deep understanding of Appcast data, work with the CTO and head of Data & Insights to decide on what data is proper to share with clients/media due to sample size and quality - - Qualifications
        • Strong problem-solving skills and attention to detail - - -
        • Excellent communication and collaboration skills - - Education and Experience -
          • Bachelor's degree (or higher) in Computer Science, Information Technology, or a related field - -
          • 5 years or more of experience in data engineering - - -
          • Expert experience in writing SQL queries - -
          • Strong experience in writing Python and/or R code - -
          • Strong experience in managing data warehouses and ETL/ELT/OLAP processes - -
          • Experience with PostgreSQL, Tableau, or AWS tools is a plus - - Additional Information Appcast recognized as one of Inc Magazine's "Best Workplaces" for 2021 & 2022! -
            • We're the best at what we do.---We're the global leader in programmatic recruitment advertising. With advanced technology, unmatched market data and a team of the industry's best recruitment marketers. -
            • We have an amazing culture driven by great people.---Headquartered in Lebanon, N.H. with offices in the U.S., Canada and Europe, Appcast is part of the Stepstone group. To better understand our company culture, read---Our Story---and check out---Working at Appcast---on our website. - -
            • We take care of our employees.---We're dedicated to creating an inviting environment where individuals from diverse backgrounds can thrive and develop. We believe in providing competitive compensation and comprehensive benefits, ensuring our team can support their loved ones and one another. We enjoy fostering a sense of community through dedicated employee networks, fun gatherings, delicious food, and even welcoming furry friends into our workspace. We live our values each day including volunteering and giving back to our communities. - All your information will be kept confidential according to EEO guidelines. - Appcast is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. More...

                  

              ---

              Register an account with us and set up job agents! We'll email you immediately when jobs like this are posted on our site.

              ---