Senior Big Data Engineer - New York New York

Company: Integral Ad Science
Location: New York, New York
Posted On: 04/26/2024

Integral Ad Science (IAS) is a global technology and data company that builds verification, optimization, and analytics solutions for the advertising industry and we're looking for A Senior Data Engineer to join our team. If you are excited by technology that has the power to handle hundreds of thousands of transactions per second; collect tens of billions of events each day; and evaluate thousands of data-points in real-time all while responding in just a few milliseconds, then IAS is the place for you!
What you'll get to do:

• Architect, design, code and maintain components for aggregating tens of billions of daily transactions
  
• Work on Big Data technologies such as Spark, Spark streaming, Kafka, NoSql, EMR & other AWS tech stack
  
• Contribute to the entire software lifecycle including hands-on development, code reviews, testing, deployment, and documentation for streaming & batch ETL and RESTful APIs
  
• Provide leadership, work collaboratively, and be a mentor in an awesome team
  
  You should apply if you have most of this:
  
  
  
  • Bachelors or Masters in Computer Engineering, Computer Science, Electrical Engineering or related field
    
  • 5+ years of recent hands-on in Java
    
  • 5+ years of experience designing and building data pipelines and data-intensive applications
    
  • Experience using Big Data frameworks (e.g.,Spark, Flink) , databases (e.g., NoSql, Delta Tables, Mysql / Postgres) for complex data assembly and transformation
    
  • Strong knowledge of collections, multi-threading, JVM memory model, etc.
    
  • In-depth understanding of algorithms, performance, scalability, and reliability in a Big Data setting
    
  • Solid understanding of OLTP and OLAP systems, database fundamentals
    
  • Solid knowledge of SQL
    
  • Experience in full software development, Agile, and CI/CD
    
  • Experience building production level systems in AWS cloud environment
    
    What puts you over the top:
    
    
    
    • Experience with Spark streaming or Flink
      
    • Familiarity with messaging frameworks like Kafka and / or NoSql databases (Aerospike, Cassandra)
      
    • Orchestrating data pipelines using tools such as Airflow
      
      
      New York Applicants: The salary range for this position is $100,800 - $172,800. Actual pay may vary based on experience or geographic location.
      About Integral Ad Science
      
      Integral Ad Science (IAS) is a leading global media measurement and optimization platform that delivers the industry's most actionable data to drive superior results for the world's largest advertisers, publishers, and media platforms. IAS's software provides comprehensive and enriched data that ensures ads are seen by real people in safe and suitable environments, while improving return on ad spend for advertisers and yield for publishers. Our mission is to be the global benchmark for trust and transparency in digital media quality. For more information, visit integralads.com.
      
      Equal Opportunity Employer:
      IAS is an equal opportunity employer, committed to our diversity and inclusiveness. We will consider all qualified applicants without regard to race, color, nationality, gender, gender identity or expression, sexual orientation, religion, disability or age. We strongly encourage women, people of color, members of the LGBTQIA community, people with disabilities and veterans to apply.
      California Applicant Pre-Collection Notice:
      We collect personal information (PI) from you in connection with your application for employment or engagement with IAS, including the following categories of PI: identifiers, personal records, commercial information, professional or employment or engagement information, non-public education records, and inferences drawn from your PI. We collect your PI for our purposes, including performing services and operations related to your potential employment or engagement. For additional details or if you have questions, contact us at compliance@integralads.com.
      To learn more about us, please visit http://integralads.com/ and https://muse.cm/2t8eGlN
      Attention agency/3rd party recruiters: IAS does not accept any unsolicited resumes or candidate profiles. If you are interested in becoming an IAS recruiting partner, please send an email introducing your company to recruitingagencies@integralads.com. We will get back to you if there's interest in a partnership.
      #LI-Hybrid More...

          

      ---

      Register an account with us and set up job agents! We'll email you immediately when jobs like this are posted on our site.

      ---