Data Integration Engineer -TS/SCI
Location: Bethesda, MD (Hybrid)
Security Clearance: active Secret clearance and the ability to obtain and maintain a TS/SCI with Polygraph
Our Client is seeking for the next TS/SCI cleared
Data Integration Engineer for the National Media Exploitation Center (NMEC) under our 10-year DOMEX Technology Platform (DTP) contract. Make a meaningful impact within a mission-focused, solution-oriented, and adaptive environment that prioritizes innovation, collaboration, and professional growth. In this role, you will be responsible for designing, implementing, maintaining, and monitoring data pipelines, supporting both R&D prototypes and production pipelines. Success in this position hinges on your ability to collaborate effectively across functional teams, including development, product management, and quality assurance, in a fast-paced and dynamic setting. If you're ready to contribute your expertise and creativity to our mission-driven work, we invite you to join our team.
Responsibilities
- Perform Database builds, installs, configuration, administration, and troubleshooting of database systems (e.g., MariaDB/MySQL, Postgres, Elasticsearch, Qdrant, Milvus, etc.)
- Ensure data integrity by performing employing data engineering best practices
- Maintain database and data pipeline documentation, data dictionaries, and system diagrams
Minimum Requirement
- Bachelor’s Degree and 12+ years of prior relevant experience or Masters with 10+ years of prior relevant experience
- Experience with SQL, NoSQL, and vector databases such as MSSQL, MySQL, PostgreSQL, Redis, FAISS, Milvus, Qdrant, etc.
- Experience designing and maintaining ETL and ELT pipelines with technologies such as Spark, Airflow, Dagster, Prefect, Argocd, Metaflow, Kubeflow, etc.
- Experience with DevOps / MLOps, using CI/CD methodology with data pipelines, and cloud-native deployment paradigms
- Must possess an active Secret clearance and the ability to obtain and maintain a TS/SCI with Polygraph
- Experience with database design, implementation, maintenance, monitoring, performance tuning, and optimization.
- Expertise in data profiling techniques and understanding the content from both a data quality and business perspective
- Experience with data quality and accuracy evaluation techniques
- Experience with Agile practices
- Development experience with Python
- Experience on data model development, modification and migration, and maintenance
- Strong verbal and written communication skills
- Enthusiastic with the ability to work well on a team and a self-starter who can work independently.
Preferred Qualification
- An active TS/SCI clearance
- Experience supporting data teams and data scientists
- Experience on a production/ enterprise system
- Experience in air-gapped environments
- Application development and deployment in an AWS environment
- AWS certifications