Drive the overall implementation of security cloud architecture in the Compliance division
Job Summary
Drive the overall implementation of security cloud architecture in the Compliance division.
Develop applications using Spring and Web Services (RESTFUL), and implement Business Logic using Java, OOPs concepts, Multi-threading, Java Concurrency, and various Spring modules.
Utilize Apache Spark, Apache Airflow, Apache Kafka, Apache NiFi, Apache HBase, and GCP services for data processing, analytics, and pipeline automation.
Matching Summary
Drive the overall implementation of security cloud architecture in the Compliance division.
Salary
$150,000 – $165,000/year
Skills & Requirements
Must-have
Spring Boot
Spring MVC
Spring Batch
Java Concurrency
Apache Kafka
Google Cloud Pub/Sub
Dataflow
Apache Airflow
Cloud Composer
Apache Spark
GCP Dataproc
BigQuery
Apache NiFi
Cloud Storage
Apache HBase
GCP Bigtable
Nice-to-have
acting responsibly
thinking commercially
taking initiative
working collaboratively
inclusive work environment
Key Requirements
Master’s degree in Information Technology or related field or equivalent
Three (3) years of experience
Analyzing and performing iterative development using Agile methodology
Developing applications using Spring and Web Services (RESTFUL)
Developing and configuring Spring Controllers using annotations
Developing SSIS scripts to migrate production data
Implementing Business Logic using Java, OOPs concepts, Multi-threading, Java Concurrency, Spring (Core), Spring MVC, Spring Boot, Spring Batch, JavaScript (Angular, jQuery), JDBC and Hibernate
Utilizing Apache Spark on GCP Dataproc
Designing and orchestrating ETL workflows using Apache Airflow via Cloud Composer
Implementing real-time data ingestion pipelines using Apache Kafka integrated with Google Cloud Pub/Sub and Dataflow
Developing data transformation queries using Apache Hive and Presto on Dataproc and BigQuery
Utilizing Apache NiFi to automate data flows
Managing high-throughput, low-latency NoSQL workloads using Apache HBase and GCP Bigtable
Designing data lake architectures combining Hadoop HDFS and Google Cloud Storage