IDC Technologies (Singapore) Pte. Ltd. is seeking a Data Architect with extensive experience in Databricks and data engineering to design and implement data architectures that meet business needs. The ideal candidate will have a strong technical background in data processing, cloud platforms, and collaboration with cross-functional teams, along with experience in presales support
Job Summary
The role involves designing and implementing robust Databricks-based data architectures to meet complex business requirements.
Candidates must possess over a decade of experience in building and optimizing large-scale ETL/ELT pipelines using PySpark, Scala, or SQL.
The position requires establishing secure Lakehouse architectures that handle both batch and streaming data ingestion on cloud platforms.
Matching Summary
Match Score: 85
IDC Technologies (Singapore) Pte. Ltd. is seeking a Data Architect with extensive experience in Databricks and data engineering to design and implement data architectures that meet business needs. The ideal candidate will have a strong technical background in data processing, cloud platforms, and collaboration with cross-functional teams, along with experience in presales support.
Skills & Requirements
Must-have
12+ years data engineering experience
Databricks platform architecture expertise
Azure Data Factory and Synapse Analytics
PySpark Scala SQL proficiency
Delta Lake and medallion architecture
Streaming data with Kafka and Spark
Unity Catalog and RBAC security
Nice-to-have
Snowflake or Microsoft Fabric experience
MLOps and DataOps knowledge
Presales solution design support
Cost optimization strategies
CI/CD integration for workflows
Key Requirements
Bachelor's degree in Computer Science or IT
Proven experience as a Databricks Architect
Databricks certification (e.g., Certified Data Engineer)