The Software Engineer shall possess extensive expertise in dataflow design, data transport mechanisms, and Apache Spark based distributed processing
Job Summary
The Software Engineer shall possess extensive expertise in dataflow design, data transport mechanisms, and Apache Spark based distributed processing.
In this role, the Software Engineer shall be responsible for designing, implementing, and optimizing data ingress/egress pathways to ensure efficient, scalable, and reliable processing of the organization’s analytics workloads.
Erias Ventures provides a complete package of wealth, health, and happiness benefits, with an expected salary range of $229,000 - $251,000.
Matching Summary
The Software Engineer shall possess extensive expertise in dataflow design, data transport mechanisms, and Apache Spark based distributed processing.
Salary
$229,000 - $251,000
Skills & Requirements
Must-have
Linux CLI and tools
Bash scripting automation
Python and Java development
Apache Spark distributed processing
SQL technologies
Jupyter Notebook usage
Pandas and NumPy for data wrangling
Git Source Control System
Nice-to-have
HPC Job Scheduling tools
Atlassian Tool Suite experience
Key Requirements
Master's degree + 5 years experience OR Bachelor's degree + 7 years experience OR 9 years experience
Top-Secret/SCI with polygraph clearance (within 7 years)