Job Title: AZURE Databricks Data Engineer (Utility Domain)
***Location: Des Moines - IA - ONSITE 5 DAYS
***This is a C2H role. Candidates should be willing to join the end client directly. Please ensure that this is communicated and agreed to before submitting.
Experience Level: (8+ years)
About Us: We are seeking a highly experienced Data Engineers to join our dynamic team and lead our data engineering initiatives using Azure ML and Databricks.
Job Description:
Responsibilities:
Design, develop, and maintain scalable data pipelines and ETL processes to support data science and analytics initiatives.
Utilize Azure ML and Databricks to build and optimize data architectures and workflows.
Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and ensure data availability and quality.
Implement data integration solutions to consolidate data from various sources into a unified data platform.
Analyze the generation patterns from various Solar Generation facilities and help filed teams to identify the anomalies in generation.
Ensure data security, privacy, and compliance with relevant regulations and best practices.
Monitor and troubleshoot data pipelines and workflows to ensure reliability and performance.
Stay up-to-date with the latest advancements in data engineering, big data technologies, and cloud platforms, and apply them to improve existing processes and systems.
Qualifications:
Bachelor’s degree in computer science, Data Engineering, or a related field.
10+ years of experience in data engineering, data integration, and ETL processes.
Extensive experience with Azure ML and Databricks, including hands-on experience in building and optimizing data pipelines.
Proficiency in programming languages such as Python, SQL, and Scala.
Strong understanding of data engineering principles and best practices.
Experience with big data technologies such as Hadoop, Spark, and Kafka.
Excellent problem-solving skills and the ability to work independently and as part of a team.
Strong communication and interpersonal skills, with the ability to convey complex technical information to a non-technical audience.
Experience in solar generation data analysis is a plus.
...Guide team to world-class status. You might be our perfect Elite Coach if: You lead with a perfect balance of compassion,... ...competitive compensationexcellence in education shouldn't require financial sacrifice Premium benefits package and liberal paid time off...
...Novo Holdings is seeking an Associate to join the Growth Investments team in its San Francisco office. Novo Holdings is a holding and investment company that is responsible for managing the assets and the wealth of the Novo Nordisk Foundation. The purpose of Novo Holdings...
...Job Description Job Description At K2 Medical Research, a privately-owned clinical research facility in the greater Orlando and Central Florida... ...population of our world. K2 is seeking a Clinical Research Assistant for our Winter Garden, Florida clinic. The Clinical...
...passion? Join Marvin and step into what some say is an engineering paradise." As a Manufacturing Engineer II, you'll support safety, quality,... ...household goods, temporary housing, and much more in addition to a relocation counselor to assist you throughout the...
...Job Description Job Description Vegan District is coming to Anaheim! Now hiring for all positions! Vegan District is the exciting new vegan Asian Eatery, first opened in the city of Loma Linda, now opening our second location in the city of Anaheim. By the creators...