Job Description
Description Senior Data Engineer Herndon, VA / Chantilly, VA
@Orchard LLC has been retained by a true innovator within the Intelligence and Defense community, committed to putting the well-being of their employees at a similar level of importance as their focus on client mission. We are supporting their search for a Senior Data Engineer to join the team that is deploying and delivering a cloud-based, multi-domain Common Data Fabric (CDF), which provides data sharing services to the entire DoD Intelligence Community (IC). The CDF connects all IC data providers and consumers. It uses fully automated policy-based access controls to create a machine-to-machine data brokerage service, which is enabling the transition away from legacy point-to-point solutions across the IC enterprise.
As a Data Engineer you will: - Lead the design, development, and maintenance of complex, scalable data pipelines.
- Optimize and troubleshoot data pipelines for performance, reliability, and scalability.
- Collaborate with engineers and analysts to understand data requirements and deliver high-quality data solutions.
- Implement and manage ETL processes using advanced tools like Apache Airflow, Spark, or similar.
- Ensure data quality and consistency through rigorous testing, validation, and governance practices.
- Deploy, monitor, and maintain data infrastructure in cloud environments (AWS, GCP, Azure).
- Implement DevOps practices to streamline data workflows, including CI/CD pipelines, Docker, and Kubernetes.
- Mentor and provide guidance to junior data engineers, fostering a culture of continuous improvement and collaboration.
- Stay up-to-date with industry trends and emerging technologies to drive innovation within the data engineering team.
Data Engineer Qualifications: - Active Top Secret clearance with an ability to obtain SCI access and willingness to obtain CI Polygraph
- US Citizenship required
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- 7+ years of experience in data engineering or related roles.
- Advanced proficiency in SQL and experience with relational databases (e.g., PostgreSQL, MySQL).
- Extensive experience with big data technologies (e.g., Hadoop, Spark).
- Deep understanding of cloud platforms (AWS, GCP, Azure) and their data services.
- 2+ Experience in Python Development
- Strong understanding and practical experience with DevOps practices and tools (CI/CD, Docker, Kubernetes).
- Proven ability to optimize and troubleshoot complex data systems and pipelines.
- Excellent problem-solving skills and attention to detail.
- Strong communication and leadership abilities, with experience mentoring junior engineers.
Additional Skills We'd Like to See: - Advanced organizational skills with the ability to handle multiple assignments
- Strong written and oral communication skills
- DoD 8570 IAT Level II Certification (Security+)
- Experience or expertise using, managing, and/or testing API Gateway tools and Rest APIs
- Experience or expertise configuring an LDAP client to connect to IPA
- Experience with Apache Hadoop and ETL
Established in 2010, @Orchard LLC, also known as, Talent Orchard has an exceptional reputation, providing staffing solutions to time-sensitive, talent scarcity issues to deliver better talent management ROI. Our specialty lies in the critical area of program talent acquisition and resource management, not in one narrow skillset, but across many areas of technical and functional delivery. To learn more about our other exciting opportunities, visit our Jobs Page at
Job Tags