Senior ETL Hadoop Developer Job at Cloud Analytics Technologies LLC, California

TGJYMmtTaTNFT2Flc09HN2xFaVFZQ0hmVHc9PQ==
  • Cloud Analytics Technologies LLC
  • California

Job Description

Job Description 

Description:

Position requires resource to work with business team to understand data requirements and work with source systems
Requires extracting data from source systems and loading into Hadoop(Spark)
Requires investing and resolving data and system issues, provide support

Proven experience in Designing & building data lake on Hadoop using latest technologies
Experience in building integration layer to integrate data from multiple systems to Hadoop
Experience in Architecture and solution design of analytics on Hadoop
Experience in building pipeline to ingest data into Hadoop
Working experience in dealing with data in multiple formats (csv, txt, xml, JSON)
10 Years of experience in building DW/ETL applications
5+ Years of experience in working with Hadoop echo system
Working experience with Hive, Spark, Python, Hadoop libraries
Experience in building data lake in Hadoop is must
Experience in building ETL and data aggregations
Experience with sqoop/ flumes/ spark is required
Excellent SQL knowledge is required
Experience in working in extracting data from RDBMS, SAS applications using API's

Must have skills 

10+ yrs experience in building DW/ETL applications / 5+ yrs experience in working with Hadoop echo system / Knowledge of Hive, Spark, Python, Hadoop libraries / experience building data lake in Hadoop / Experience with sqoop, flumes, spark / Excellent SQL knowledge

Nice to have skills 

Visualization skills, Power BI experience.experience

Roles and responsibilities 

Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborating with support system partners to troubleshoot issues. See JD

Job Tags

Work experience placement,

Similar Jobs

Georgia Tech

Cord, Com, Plan & Ext Relation Job at Georgia Tech

 ...Work outside of normal business hours may be required) Pay Band: B9 Salary to be commensurate with the qualifications of the selected candidate within the established range (generally minimum midpoint) of the position. Recruitment Period: Until Filled... 

AdventHealth Corporate

Second Level Reviewer I Job at AdventHealth Corporate

 ...management staff to resolve discrepancies with diagnostic assignments and other coding issues. Completes well-timed follow-up case reviews on all cases, prioritizing those with clinical documentation clarifications. Participates in department meetings, providing feedback... 

Housekeeper.com

Housekeeper Wanted - Experienced Professional Cleaners Needed In New York! Job at Housekeeper.com

 ...attention to detail and a thorough understanding of effective cleaning techniques. Responsibilities will include general housekeeping tasks such as vacuuming, dusting, mopping, and bathroom and kitchen cleaning. Additionally, the candidate should have reliable... 

Games For Love

Esports Streamer Job at Games For Love

 ...goal with your intelligent contribution. Job Description Games for Love League of Pros is looking for passionate and skilled esports streamers to join our team as part-time contractors. As an Esports Streamer, you will play a crucial role in promoting our mission... 

Go Spindle

Special Education Teacher in Stockton, CA Job at Go Spindle

 ...Job Description Job Description Bachelor's or Master's degree in Special Education, active Special Education Teacher license and minimum 1+ years Special Education Teacher experience required. Applicants who do not meet these qualifications will not be considered....