Design and implement data pipelines using Databricks, working with multiple data sources including structured and unstructured data
Job Summary
Design and implement data pipelines using Databricks, working with multiple data sources including structured and unstructured data.
Integrate Databricks with other tools and services such as Azure, AWS, Tableau, and various databases.
DXC Technology prioritizes in-person collaboration while offering flexibility to support wellbeing, productivity, individual work styles, and life circumstances.
Matching Summary
Design and implement data pipelines using Databricks, working with multiple data sources including structured and unstructured data.
Skills & Requirements
Must-have
Databricks Expert
design and implement data pipelines
work with multiple data sources
integrate Databricks with other tools
manage data storage and lifecycle
diagnose and resolve Databricks issues
Nice-to-have
fostering an inclusive environment
prioritizes in-person collaboration
offering flexibility to support wellbeing
Key Requirements
Professional experience using Databricks
Knowledge of Azure Data Factory, AWS Glue, or Google DataPrep
Strong foundation in data engineering concepts
Proficiency in Python, Scala
Good understanding of cloud platforms (AWS, Azure, or Google Cloud)