|
Data Integration Engineer - TS/SCI - Bethesda Maryland
Company: Xcelerate Solutions Location: Bethesda, Maryland
Posted On: 04/28/2024
Description Data Integration Engineer -TS/SCI Xcelerate Solution is seeking our next TS/SCI clearedData Integration Engineersupporting the National Media Exploitation Center (NMEC) under our 10-year DOMEX Technology Platform (DTP) contract. Have impact as part of a mission focused, solutions oriented, and adaptive team that values innovation, collaboration, and professional development. Your job will be to design, implement, maintain, and monitor data pipelines, both in support of R&D prototypes and production pipelines. You succeed through effective cross functional collaboration in areas such as, but not limited to, development, product, and QA in a dynamic and fast paced environment. While most work is conducted on-site at our client location in Bethesda, MD, we offer a flexible schedule and, some unclassified development tasks may be performed remotely. Percentage of remote work will vary based on client requirements/deliverables. Come join our award-winning organization and work with some of the most talented and brightest minds in the GovCon industry. Location: Bethesda, MD (Hybrid) Security Clearance: TS/SCI Responsibilities - Perform Database builds, installs, configuration, administration, and troubleshooting of database systems (e.g., MariaDB/MySQL, Postgres, Elasticsearch, Qdrant, Milvus, etc.)
- Ensure data integrity by performing employing data engineering best practices
- Maintain database and data pipeline documentation, data dictionaries, and system diagrams Minimum Requirement
- Bachelor's Degree and 12+ years of prior relevant experience or Masters with 10+ years of prior relevant experience
- Experience with SQL, NoSQL, and vector databases such as MSSQL, MySQL, PostgreSQL, Redis, FAISS, Milvus, Qdrant, etc.
- Experience designing and maintaining ETL and ELT pipelines with technologies such as Spark, Airflow, Dagster, Prefect, Argocd, Metaflow, Kubeflow, etc.
- Experience with DevOps / MLOps, using CI/CD methodology with data pipelines, and cloud-native deployment paradigms
- Must possess an active Secret clearance and the ability to obtain and maintain a TS/SCI with Polygraph
- Experience with database design, implementation, maintenance, monitoring, performance tuning, and optimization.
- Expertise in data profiling techniques and understanding the content from both a data quality and business perspective
- Experience with data quality and accuracy evaluation techniques
- Experience with Agile practices
- Development experience with Python
- Experience on data model development, modification and migration, and maintenance
- Strong verbal and written communication skills
- Enthusiastic with the ability to work well on a team and a self-starter who can work independently. Preferred Qualification
|
|