Open source components (hadoop, spark, flink, kafka)
Participate in the overall architecture design of the big data platform, covering the full link of data collection, storage, computing, analysis, and visualization, ensuring system high availability, high performance, and scalability
Job Summary
Participate in the overall architecture design of the big data platform, covering the full link of data collection, storage, computing, analysis, and visualization, ensuring system high availability, high performance, and scalability.
Evaluate and introduce cutting-edge technologies (such as AI large models, cloud-native technologies) to optimize data processing efficiency and resource utilization.
Lead medium and large data platform projects (such as data warehouses, data lakes, real-time analysis systems), from participating in requirement analysis to landing delivery.
Matching Summary
Participate in the overall architecture design of the big data platform, covering the full link of data collection, storage, computing, analysis, and visualization, ensuring system high availability, high performance, and scalability.
Skills & Requirements
Must-have
Big data platform architecture
Cloud platform technologies (Aliyun/AWS)
Open source components (Hadoop, Spark, Flink, Kafka)