Data Engineer

Responsible for data warehouse layered modeling, developing offline and near-real time data pipelines, optimizing SQL queries, and ensuring production data availability.

Chengdu, Sichuan, China
Full-time
Posted Nov 6, 2026

INDUSTRYSoftware & InternetIT Support & Networking

Apply with RefersoAI Apply on careers page

Responsibilities

Responsible for data warehouse layered modeling, completing ODS, DWD, DWS, ADS design and metric definition.
Develop offline and near-realtime data pipelines using Hive, Spark, Flink to ensure timely data entry.
Connect with business requirements to implement reports and metrics into reusable models and data services.
Establish data quality checks, handle task failures, delays, and metric inconsistencies.
Optimize SQL, jobs, and storage to reduce batch processing time and computing costs.
Complete scheduling deployment, monitoring, and documentation to ensure production data availability.
Use Java capabilities to participate in Java project development.

Requirements

Bachelor's degree in Computer Science or related fields from 985 or 211 universities
Experience in a Data Engineering
Experience in a Data Warehousing

Nice to have: AI development project experience

Skills

SQL Python Spark PySparkSpark SQLHiveHDFSJavaAzkabanHiveSparkFlinkSQL Python JavaHDFSAzkaban

Benefits

Formal programs on leadership and professional development
Global Life Empowerment Assistance Program
Diversity, Equity & Inclusion inclusive education
Onboarding program
Internal peer-led inclusive communities and activities

Full description

岗位职责： 1. 负责数仓分层建模，完成 ODS、DWD、DWS、ADS 设计与指标口径定义。 2. 使用 Hive、Spark、Flink 开发离线和准实时数据链路，保障数据按时入仓。 3. 对接业务需求，把报表和指标落到可复用的模型和数据服务。 4. 建立数据质量校验，处理任务失败、延迟和口径不一致。 5. 优化 SQL、作业和存储，降低跑批时间与计算成本。 6. 完成调度上线、监控和文档，保障生产数据可用。 7. 有Java能力并参与Java项目开发。任职要求： 1.985，211正规院校计算机或相关专业本科及以上学历，2年及以上工作经验。 2. 熟练使用 SQL，能独立完成复杂关联、窗口函数、性能调优。 3. 熟练 Python，能编写可维护的 ETL 脚本与数据处理程序。 4. 有Spark（PySpark / Spark SQL）生产经验，理解分区、shuffle、宽表加工等基本优化手段。 5. 熟悉数仓分层与常见存储（Hive / HDFS /对象存储等至少一类）。 6. 了解调度与运维（Azkaban 等），能排查作业失败与数据延迟。 7. 具备数据质量意识：对账、主键唯一、空值处理、增量/全量策略能讲清楚。 8. 熟练掌握Java开发技术，有Java项目开发经验的优先。 9.工作积极主动、有责任心，具有良好的团队精神，具备跨团队沟通协作能力。 10. 普通话标准，英语四级及以上，能熟练阅读和使用英文进行沟通。优先考虑：有 AI 开发项目经验者。 At TD SYNNEX, our values guide everything we do: Together, We Own It, We Dare to Go, We Grow and Win, and above all, We Do the Right Thing. These principles shape how we work with each other, our partners, and our communities as we drive innovation and create lasting impact. What’s In It For You? Elective Benefits: Our programs are tailored to your country to best accommodate your lifestyle. Grow Your Career: Accelerate your path to success (and keep up with the future) with formal programs on leadership and professional development, and many more on-demand courses. Elevate Your Personal Well-Being: Boost your financial, physical, and mental well-being through seminars, events, and our global Life Empowerment Assistance Program. Diversity, Equity & Inclusion: It’s not just a phrase to us; valuing every voice is how we succeed. Join us in celebrating our global diversity through inclusive education, meaningful peer-to-peer conversations, and equitable growth and development opportunities. Make the Most of our Global Organization: Network with other new co-workers within your first 30 days through our onboarding program. Connect with Your Community: Participate in internal, peer-led inclusive communities and activities, including business resource groups, local volunteering events, and more environmental and social initiatives. Don’t meet every single requirement? Apply anyway. At TD SYNNEX, we’re proud to be recognized as a great place to work and a leader in the promotion and practice of diversity, equity and inclusion. If you’re excited about working for our company and believe you’re a good fit for this role, we encourage you to apply. You may be exactly the person we’re looking for!