Participate in the overall architecture design of the big data platform, covering the full link of data collection, storage, computing, analysis, and visualization, ensuring system high availability, high performance, and scalability
Job Summary
Participate in the overall architecture design of the big data platform, covering the full link of data collection, storage, computing, analysis, and visualization, ensuring system high availability, high performance, and scalability.
Evaluate and introduce cutting-edge technologies (such as AI large models, cloud-native technologies) to optimize data processing efficiency and resource utilization.
Lead medium and large data platform projects (such as data warehouses, data lakes, real-time analysis systems), from participating in requirement analysis to landing delivery.
Matching Summary
Participate in the overall architecture design of the big data platform, covering the full link of data collection, storage, computing, analysis, and visualization, ensuring system high availability, high performance, and scalability.
Skills & Requirements
Must-have
Big data platform architecture
Cloud platform technologies (Aliyun/AWS)
Open-source big data components
Distributed system design
Real-time computing engines
Performance tuning and fault diagnosis
Data governance and compliance
Nice-to-have
AI large models
Cloud-native technologies
DataOps process optimization
Data-driven decision support
Key Requirements
8+ years big data experience
3+ years big data architecture design
Led 2+ medium/large projects
Familiar with Aliyun or AWS cloud platforms
Proficient in Hadoop, Spark, Flink, Kafka, HBase, Elasticsearch