Principal Data Engineer / Architect - Individual Contributor
Smartsheet
Bangalore, India
On-site
Databricks lakehouse
Ai/data infrastructure patterns
Ai/mlops workflows on databricks
Designing and overseeing the architecture of scalable and reliable data platforms, including data pipelines, storage solutions, and processing systems
Job Summary
Designing and overseeing the architecture of scalable and reliable data platforms, including data pipelines, storage solutions, and processing systems.
Building and optimising data pipelines for ingesting, processing, and transforming large datasets from various sources.
Staying abreast of emerging data technologies and exploring opportunities for innovation to improve the organisation’s data infrastructure.
Matching Summary
Designing and overseeing the architecture of scalable and reliable data platforms, including data pipelines, storage solutions, and processing systems.
Skills & Requirements
Must-have
Databricks Lakehouse
AI/Data infrastructure patterns
AI/MLOps workflows on Databricks
Cloud Platforms (AWS, Azure, GCP)
Python, SQL, Java, Scala
Modern software engineering practices
Nice-to-have
driving engineering excellence initiatives
solution cost optimisations
Snowflake and Airflow/Airbyte exposure
Terraform for IAC
Key Requirements
Enterprise SaaS software solutions
Large scale structured and unstructured data handling
Building and maintaining data platform systems
Working with Product engineering team
Petabytes of data experience
Experience in modern AI/Data infrastructure patterns