Design and build scalable data pipelines in Databricks using Spark (PySpark/Scala) .
Develop batch and streaming data workflows from diverse data sources into cloud data lakes (Delta Lake).
Optimize Spark jobs for performance, scalability, and reliability.
Work with stakeholders to understand data requirements and deliver clean, transformed datasets.
Implement and manage data governance and security with Unity Catalog or other catalog tools.
Collaborate with DevOps teams to deploy notebooks and jobs via CI/CD pipelines.
Develop documentation and reusable components to standardize data engineering practices.
Monitor and troubleshoot data pipeline performance and errors.
3+ years of hands-on experience with Databricks and Apache Spark .
Strong programming skills in Python or Scala .
Deep understanding of Delta Lake , Medallion Architecture , and ELT/ETL processing.
Experience working with cloud services such as Azure Data Lake , AWS S3 , or GCP Cloud Storage .
Solid SQL skills for querying structured and semi-structured data.
Knowledge of Databricks Workflows , Jobs API , and Cluster management .
Familiarity with data orchestration tools like Azure Data Factory , Airflow , or DBT .
Experience with CI/CD tools such as GitHub Actions, Azure DevOps, or Jenkins.
...financial security.Qualifications:Minimum of 20 year(s) of experience in Section 106 of the NHPA OR PhD Degree in Anthropology, Archaeology, Environmental Compliance, Project ManagerArchaeology, experience with Secretary of Interior?s Standards for the Treatment of Historic...
...Senior Data Analyst We are seeking a highly skilled Senior Data Analyst to join our Financial... ...actionable insights. ~ Experience working in a major financial institution or consulting... ...firm preferred. This role is work from home (United States). K2 Integrity
Join a Team Thats Redefining Patient Care Patient Implant Care Coordinator At DFW Oral Surgeons , were more than just an elite oral surgery practice were a passionate team dedicated to delivering exceptional care to our patients and concierge-level service...
...healthcare provider. We are seeking a(an) Operating Room Nurse Internship to join our healthcare family. This Nurse Residency... ...training licensed Registered Nurses with no prior operating room experience to work in the intra-operative environment. This program is open...
...94; Starting Rate: $20 /hour &##127979; Environment: Special Education Program Spectrum Center Schools and Programs , a growing,... ...assigned. Qualifications Required: Bachelor's degree or higher in education or a closely related field of study. Hold currently...