Find A Job › Information Technology

SEARCH:

Junior Data Engineer

  • Location: Deerfield Beach, FL
  • Job Type: Direct Placement
  • Ref No: 21-05194
  • Date: September 16, 2021
  • Job title:

Job Description - Junior Data Engineer

An ICS client is seeking a Junior Data Engineer to join their team direct hire. 



This is a brand new division and someone will be coming in at an early stage. This should excite you as you will help define the architecture and ETL pipelines for the movement of large amounts of data, enabling the end to end deployment of complex Client pipelines.

 

Job Responsibilities:

  • Implement and maintain highly available and stable data ingestion pipelines using industry standard ETL/ELT best practices
  • Collaborate closely with Client scientists and BI engineers/analysts to facilitate fast and efficient algorithm development
  • Create an environment that allows for the exploration and exploitation of our rich datasets
  • Interpret requirements from the business analysis and data science teams to deliver optimal solutions
  • Continuous integration, automation, change control, as well as scalable and performant designs
  • Guide the constant improvement of the analytics data ingestion and routing mechanism and ensure that the systems stay current and up to date
  • Quickly identify weaknesses, data integrity lapses and bugs in our data ingestion pipelines and remedy them
  • Make data more available



Qualifications: 

  •  Bachelor's degree in Computer Science, Computer Engineering or Statistics or equivalent experience
  • 1+ years of experience building large scale data pipelines, designing cloud architectures, working with scientists who work in various reporting and analytics capacities
  • 1+ years of experience working in an AWS heavy environment and a breadth of knowledge and familiarity with core AWS storage and data pipelining services. (Redshift, EMR, RDS, Glue, Kinesis, Dynamo DB, Firehose)
  • 1+ years of experience working in Python
  • 1+ years of experience with PySpark including experience interfacing with a wide variety of data sources and targets using PySpark
  • Experience writing highly optimized and efficient SQL

Nice to Have:

  • High level understanding and knowledge of core statistical and data science concepts are a plus
  • Experience with the standard software development lifecycle including code reviews, source control management, CI/CD etc.
  • Experience working with Snowflake data warehouses
  • Experience executing spark jobs through YARN on EMR clusters
  • Experience working in a big data environment, moving large amounts of data through complex pipelines
  • Experience with both Object Oriented and Functional programming paradigms



Related Job Listings

Job Location Type Posted  
Software Engineer (Java) - REMOTE REMOTE, FL Direct Placement October 21
Senior Software Engineer Miami, FL Direct Placement October 19
Senior Software Engineer, Site Reliability Wynwood, FL Direct Placement October 19
Software Engineer Wynwood, FL Direct Placement October 18
QA Tester - Python Development Wynwood, FL Direct Placement October 13