Data Engineering - Must have Databricks Certification

Bedminster, NJ 07921

Posted: 11/19/2024 Employment Type: Direct Hire Job Number: 604 Pay Rate: 130,000

Job Description

Data Engineer - Must have Databricks Certification

Note:
Need them to have a Data Bricks Certificate that is current. They have to have at least 3 to 5 years IT experience and knowledge of Python, Azure, Airflow and Databricks and Data Warehousing. Paying $130K and there is no bonus. Right now it is hybrid, with maybe one day a week in the office.

Responsibilities:
  • Build data pipelines / data orchestrator and data structures for existing operational data stores, Azure data lake & data warehouse.
  • Develop proof-of-concepts to evaluate new technologies and suggest improved and better ways to re-architect existing data loading processes and data structures.
  • Design and develop ELT / ETL to load data from internal sources into operational data stores, Azure data lake and data warehouse.
  • Create APIs, data structures and schemas to store and retrieve data.
  • Create and maintain data mappings, data definitions, architecture, and data flow diagrams.
  • Implement solutions to validate and test data quality.
  • Build proof-of-concepts to determine viability of new processes and technologies.
  • Deploy and manage code in non-prod and prod environments.
  • Troubleshoot data related issues and fix defects.
  • Optimize and performance tune databases and queries.
  • Participate in code reviews and train other team members.
  • Document code and create code templates based on industry best practices.
 
Requirements:
  • Bachelor’s Degree and/or equivalent experience required.
  • Minimum 5 years of experience working as a Data Engineer, ETL Engineer, Data/ETL Architect or similar roles.
  • 3 -5 years of solid experience with Databricks, Python, Airflow, Azure, and Data Warehousing.
  • Data Bricks Certificate that is current is a must.
#Recruitps

Meet Your Recruiter

Jason Destro

Over 20 years’ of recruiting experience with hands-on recruiting and placement of I.T. professionals (Full Time, Temp 2 Perm, & Contingent) in the NJ/NY/CT/PA marketplace for a wide variety of today's demanding IT skill sets. Focused on delivering exceptional service by understanding client’s objectives and goals.

Send an email reminder to:

Share This Job:

Related Jobs:

Login to save this search and get notified of similar positions.

About Bedminster, NJ

Discover your next career opportunity in the vibrant area around Bedminster, New Jersey! Nestled in the picturesque Somerset County, this region offers a blend of suburban tranquility and bustling business opportunities. With proximity to major cities like New York, Philadelphia, and the scenic Delaware River, Bedminster provides a perfect balance of professional growth and quality of life. Explore job listings in this charming area filled with historic landmarks like the Jacobus Vanderveer House and the scenic Natirar Park. Indulge in local cuisine at charming eateries like the Pluckemin Inn, and immerse yourself in culture at the Alba Vineyard or the historic Red Mill Museum. Join us in Bedminster and unlock a world of career possibilities in a truly enchanting setting!