Senior ETL Hadoop Developer Job at Cloud Analytics Technologies LLC, California

TGJYMmtTaTNFT2Flc09HN2xFaVFZQ0hmVHc9PQ==
  • Cloud Analytics Technologies LLC
  • California

Job Description

Job Description 

Description:

Position requires resource to work with business team to understand data requirements and work with source systems
Requires extracting data from source systems and loading into Hadoop(Spark)
Requires investing and resolving data and system issues, provide support

Proven experience in Designing & building data lake on Hadoop using latest technologies
Experience in building integration layer to integrate data from multiple systems to Hadoop
Experience in Architecture and solution design of analytics on Hadoop
Experience in building pipeline to ingest data into Hadoop
Working experience in dealing with data in multiple formats (csv, txt, xml, JSON)
10 Years of experience in building DW/ETL applications
5+ Years of experience in working with Hadoop echo system
Working experience with Hive, Spark, Python, Hadoop libraries
Experience in building data lake in Hadoop is must
Experience in building ETL and data aggregations
Experience with sqoop/ flumes/ spark is required
Excellent SQL knowledge is required
Experience in working in extracting data from RDBMS, SAS applications using API's

Must have skills 

10+ yrs experience in building DW/ETL applications / 5+ yrs experience in working with Hadoop echo system / Knowledge of Hive, Spark, Python, Hadoop libraries / experience building data lake in Hadoop / Experience with sqoop, flumes, spark / Excellent SQL knowledge

Nice to have skills 

Visualization skills, Power BI experience.experience

Roles and responsibilities 

Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborating with support system partners to troubleshoot issues. See JD

Job Tags

Work experience placement,

Similar Jobs

Intuit

QuickBooks Online Mid-Market Premium Specialist - Hybrid Job at Intuit

 ...identify root causes, and communicate effective solutions. Hybrid Work Requirement: Minimum requirement of 2 days in the office 4...  ...internet connection (DSL, cable, or fiber) is required for Work from Home. Responsibilities: What You'll Do Deliver Expert... 

Mediacom Communications

Installer / Broadband Tech -- FT Job at Mediacom Communications

 ...As a Broadband Specialist I (Field Technician), you will be primarily focused on new installations of our cable television and broadband services. You'll drive a company van, go into customer homes, and represent Mediacom every day to our customers. You'll also learn... 

Pacific Shipyards International, LLC

Marine Welder - Fabrication & Shipyard Expert Job at Pacific Shipyards International, LLC

 ...A leading shipyard in Hawaii is seeking a full-time Welder to join their team in Honolulu. The ideal candidate will have experience with various welding techniques, including SMAW and GMAW, and must be able to read blueprints. Candidates must reside on Oahu and have the... 

General Dynamics Information Technology

Marine Electrician Job at General Dynamics Information Technology

 ...safety procedures. \n Participates in special projects as required. \n Must be able to obtain all necessary badges (DBIDS and shipyard). \n Able to work on and climb ladders, work in extreme temperature environments, aboard ships, in shipyards, under industrial... 

Air Evac Lifeteam

Aircraft Maintenance Technician - RW (NE) Job at Air Evac Lifeteam

Job Description: Aircraft Maintenance Technician (AMT) IMMEDIATELY HIRING! A&P Mechanic- Rotor Wing FULL-TIME Opportunity in Olney, IL Starting Salary:$71,635...  ...Two (2) years turbine powered helicopter experience Valid Airframe and Powerplant (A&P) license...