Integration Engineer Job at Open Systems Technologies Corporation
Open Systems Technologies Corporation is looking for an experienced Data Integration Engineer with DoD experience in data integration and processing. The successful candidate will be responsible for designing, implementing, maintaining, and optimizing complex data integration processes using tools such as SQL, Spark, NiFi/Streamsets, or Databricks, Python or Java and enhancing overall data quality and data flow across various data sources and destinations. Additionally, the candidate will need to have a strong understanding of AWS services like EC2, S3, and/or RDS and will be responsible for managing data pipelines and ensuring their reliability and scalability.
Responsibilities:
Our company OST has been operating since 1996 and have various contracts with Government agencies. We offer a comprehensive benefit package that includes 3 weeks paid time off, 2 weeks Holiday pay, medical/dental coverage, STD, LTD, Life Insurance, ADD, 401k with up to 4% match, and end of year profit sharing paid out in 401k.
Please Note :
clarksqn.com is the go-to platform for job seekers looking for the best job postings from around the web. With a focus on quality, the platform guarantees that all job postings are from reliable sources and are up-to-date. It also offers a variety of tools to help users find the perfect job for them, such as searching by location and filtering by industry. Furthermore, clarksqn.com provides helpful resources like resume tips and career advice to give job seekers an edge in their search. With its commitment to quality and user-friendliness, Site.com is the ideal place to find your next job.
Responsibilities:
- Develop, design, implement and maintain complex data integration processes using SQL, Spark, NiFi/Streamsets, or Databricks, Python or Java.
- Manage the overall data quality across various data sources and destinations.
- Manage data pipelines in AWS EC2, S3, and/or RDS and ensure their reliability and scalability.
- Develop and deploy data processing pipelines in AWS to improve data processing efficiency.
- Design and implement batch or real-time data processing pipelines.
- Develop ETL (Extract, Transform, Load) processes to move large amounts of data across systems.
- Deploy and manage data analysis and modeling tools to extract insights from raw data.
- Collaborate with the DevOps team to ensure proper deployment, operation, and support of systems.
- Clearance: Secret or Interim Secret
- Bachelors degree in computer science, engineering, or related technical field.
- At least 8 years of professional experience in data integration or related field.
- Experience working with DoD systems and networks is preferred.
- Strong experience in SQL, Spark, NiFi/Streamsets, or Databricks, Python or Java.
- Experience in designing and building data processing pipelines using AWS EC2, S3, and/or RDS.
- Experience with batch or real-time ETL to move large amounts of data across systems.
- Experience with data analysis and modeling tools.
- Experience with DevOps tools such as Jenkins, Git, or Ansible.
- Strong analytical, problem-solving, and troubleshooting skills, and the ability to work well in a team environment.
Our company OST has been operating since 1996 and have various contracts with Government agencies. We offer a comprehensive benefit package that includes 3 weeks paid time off, 2 weeks Holiday pay, medical/dental coverage, STD, LTD, Life Insurance, ADD, 401k with up to 4% match, and end of year profit sharing paid out in 401k.
Please Note :
clarksqn.com is the go-to platform for job seekers looking for the best job postings from around the web. With a focus on quality, the platform guarantees that all job postings are from reliable sources and are up-to-date. It also offers a variety of tools to help users find the perfect job for them, such as searching by location and filtering by industry. Furthermore, clarksqn.com provides helpful resources like resume tips and career advice to give job seekers an edge in their search. With its commitment to quality and user-friendliness, Site.com is the ideal place to find your next job.