Jobs at Janus Soft Inc

View all jobs

Data Engineer - McLean VA

Mc Lean, VA · Computer/Software

Position Title: Data Engineer 

Job Description:

  • Develop new tools, code & services for data engineering activities
  • Execute data movement of structured & unstructured data using approved methods
  • Perform data ingestion activities for local or enterprise storage
  • View and analyze data in source format
  • Develop code for data exploration formatting
  • Collaborate with Data Scientists & partners to determine optimal data formats and transformations
  • Create tools for one-time & ongoing data formatting/transformations
  • Implement ETL code following best practices/standards
  • Develop ETL Code Transition Plans
  • Create comprehensive documentation including:
    • ETL mappings
    • Code usage guides
    • Code location & access instructions
  • Facilitate Code Reviews
  • Provide consulting services for:
    • Data transport
    • Data ingestion
    • Data conditioning
    • Data access
    • Data management

Mandatory Skills:

  • Extract, Transform and Load (ETL) tools and processes
  • Python
  • AWS
  • SQL
  • APIs
  • Linux
  • Geospatial tools/data experience

Desired Skills:

  • Docker
  • Jenkins
  • Hadoop/Spark
  • Kibana
  • Kafka
  • NiFi
  • ElasticSearch

Share This Job

Powered by