Current Statistics
1,748,663 Total Jobs 393,294 Jobs Today 17,936 Cities 222,695 Job Seekers 146,729 Resumes |
|
|
|
|
|
|
ETL Engineer Senior - Huntsville Alabama
Company: Disability Solutions Location: Huntsville, Alabama
Posted On: 05/03/2024
Job Description As a member of our team, you will join a diverse group of driven professionals who design the products and systems that support enhanced capabilities, protect national security, and keep critical information and infrastructure secure. With us, you will be able to make an impact while you hone your skills and grow in your career.BAE Systems is looking for an experienced ETL Engineer to join a strong team supporting our government customer. This position will provide the ability to make a significant impact to the mission.Successful candidate will need to be able to maintain existing software as the transition from server-based to cloud-based occurs. The candidate will work with a GOTS-based Extract, Transform and Load (ETL) system that loads information into Postgres database with billions of rows and deals with a file repository that is in a Petabyte range. In addition, the candidate will be highly involved in the engineering planning and transition of the existing system software / data into a Cloud-based (currently AWS) solution. - Design, develop, and maintain the ETL (Extract, Transform, Load) processes for master data management (MDM) system.
- Build and optimize data pipelines to extract data from various sources, transform it into the required format, and load using Databricks and AWS services.
- Collaborate with stakeholders to gather data requirements, understand data sources, and ensure data quality and integrity throughout the ETL process.
- Implement data validation, cleansing, and enrichment techniques to improve the accuracy and completeness of data.
- Monitor and troubleshoot ETL processes to identify and resolve issues in a timely manner.Required Education, Experience, & Skills
- Bachelor's degree in Engineering, Computer Science, or other related analytical, scientific, or technical discipline
- At least 6 years' experience with ETL
- Strong proficiency in programming languages such as Scala, or Java.
- Experience in designing and developing ETL workflows using tools like Apache Spark or AWS Glue.
- In-depth knowledge of ETL best practices, data integration techniques, and data quality management.
- Familiarity with different data storage technologies and databases, such as Amazon S3 or Amazon Redshift.Preferred Education, Experience, & Skills
|
|
|
|
|
|
|