Data Engineer/Maven SME

Due to security requirements, this position is primarily required to be performed on-site, and requires and Active TS/SCI security clearance.

Responsibilities:

• Design, implement, and operate data management systems for intelligence needs
• Use Python and other scripting languages to automate data workflows
• Design algorithms databases, and pipelines to access, and optimize data retrieval, storage, use, integration and management by different data regimes and digital systems
• Work with data users to determine, create, and populate optimal data architectures, structures, and systems; and plan, design, and optimize data throughput and query performance
• Participate in the selection of backend database technologies (e.g. SQL, NoSQL, etc.), its configuration and utilization, and the optimization of the full data pipeline infrastructure to support the actual content, volume, ETL, and periodicity of data to support the intended kinds of queries and analysis to match expected responsiveness
• Use expertise in Maven Smart System/Palantir Foundry suite of tools to create digital solutions as outlined above
• Assist and advise the Government with developing, constructing, and maintaining data architectures
• Research, study, and present technical information, in the form of briefings or written papers, on relevant data engineering methodologies and technologies of interest to or as requested by the Government
• Align data architecture, acquisition, and processes with intelligence and analytic requirements
• Prepare data for predictive and prescriptive modeling deploying analytics programs, machine learning and statistical methods to find hidden patterns, discover tasks and processes which can be automated and make recommendations to streamline data processes and visualizations
• Design, implement, and support scalable data infrastructure solutions to integrate with multi heterogeneous data sources, aggregate and retrieve data in a fast and safe mode, curate data that can be used in reporting, analysis, machine learning models and ad-hoc data requests
• Utilize Amazon Web Services (AWS) hosted big data technologies to store, format, process, compute, and manipulate data in order to draw conclusions and make predictions

Qualifications:

• Active DoD Top Secret/SCI clearance required
• 8+ years of demonstrated experience in data or software engineering
• 4+ Years of experience with Maven Smart System/Palantir systems
• Bachelor’s degree in computer science or a related field.