Job Description
Job Description
Job Description
Job Title: Junior Data Engineer
Location: New York City, NY (Onsite)
Type: Contract
- The Data Engineer will expand and optimize the data and data pipeline architecture, as well as optimize data flow and collection for cross functional teams.
- The Data Engineer will perform data architecture analysis, design, development and testing to deliver data applications, services, interfaces, ETL processes, reporting and other workflow and management initiatives.
- The role also will follow modern SDLC principles, test driven development and source code reviews and change control standards in order to maintain compliance with policies.
- This role requires a highly motivated individual with strong technical ability, data capability, excellent communication and collaboration skills including the ability to develop and troubleshoot a diverse range of problems.
Responsibilities:
- Design and develop enterprise data / data architecture solutions using Hadoop and other data technologies like Spark, Scala, JAVA, Python, SQL etc.
- Handle the end to end development of ETL/ELT process from discovery, design, coding all the way to production deployment Address assigned tickets and deliver code in a timely manner Work with business, product and technical stakeholders Research and provide thoughtful solutions Identify dependencies and raise risks early Participate in on-call rotation Research and fix production issues and take initiative in identifying and solving problems Review code and approve pull requests Drive implementation of standards and best practices Collaborate with team members Should have excellent analytical skills, able to recognize data patterns and troubleshoot the data.
Qualifications:
- Undergraduate degree required, MS or other advanced degree preferred.
- 3+ year of experience as a member of an information technology team.
- 3+ year of relevant experience architecting the complete end to end design of enterprise wide solution using latest technologies Hadoop, Spring boot/Spring Cloud, Rest API, SQL 3+ year of professional experience in Python or Core Java, AWS, Rest API, Microservices, Spring Boot, Spring cloud etc.
- Experience with data modeling, complex data structures, data processing, and data quality and data lifecycle Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
- Experience building and optimizing big data data pipelines, architectures and data sets. Passion and drive for continuous improvement and transformational change, with a business owner mentality. Strong written and verbal communication skills
Position Overview Summary:
- The Data Engineer will expand and optimize the data and data pipeline architecture, as well as optimize data flow and collection for cross functional teams.
- The Data Engineer will perform data architecture analysis, design, development and testing to deliver data applications, services, interfaces, ETL processes, reporting and other workflow and management initiatives.
- The role also will follow modern SDLC principles, test driven development and source code reviews and change control standards in order to maintain compliance with policies. This role requires a highly motivated individual with strong technical ability, data capability, excellent communication and collaboration skills including the ability to develop and troubleshoot a diverse range of problems.
Responsibilities:
- Design and develop enterprise data / data architecture solutions using Hadoop and other data technologies like Spark, Scala, JAVA, Python, SQL etc.
- Handle the end to end development of ETL/ELT process from discovery, design, coding all the way to production deployment Address assigned tickets and deliver code in a timely manner Work with business, product and technical stakeholders Research and provide thoughtful solutions Identify dependencies and raise risks early Participate in on-call rotation Research and fix production issues and take initiative in identifying and solving problems Review code and approve pull requests Drive implementation of standards and best practices Collaborate with team members Should have excellent analytical skills, able to recognize data patterns and troubleshoot the data.
- Qualifications Undergraduate degree required, MS or other advanced degree preferred.
- 3+ year of experience as a member of an information technology team.
- 3+ year of relevant experience architecting the complete end to end design of enterprise wide solution using latest technologies
- Hadoop, Spring boot/Spring Cloud, Rest API, SQL 3+ year of professional experience in Python or Core Java, AWS, Rest API, Microservices, Spring Boot, Spring cloud etc. Experience with data modeling, complex data structures, data processing, and data quality and data lifecycle Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
- Experience building and optimizing big data data pipelines, architectures and data sets. Passion and drive for continuous improvement and transformational change, with a business owner mentality.
- Strong written and verbal communication skills
Job Tags
Contract work,